2024-09-10T15:11:37.739 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T15:11:37.756 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T15:11:37.828 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133 branch: wip-tejas-testing-2024-09-09-1611-squid description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} email: tchandra@redhat.com first_in_suite: false job_id: '7899133' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-tejas-testing-2024-09-09-1611-squid ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 rgw: frontend: beast s3tests: force-branch: ceph-squid thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-tejas-testing-2024-09-09-1611-squid sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 owner: scheduled_tchandra@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 1683 sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 sleep_before_teardown: 0 suite: rgw suite_branch: wip-tejas-testing-2024-09-09-1611-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPJTNCC0CQuVbPcbDmzcQO1glZiGYqAaZ4STX/PyLttl5gqrq1j9vk8ADxTs7mssyUeSIjd9CHNxlV6bclVl8xQ= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfsKntELVWNwONVPS/7djXVoioHYgX9jaszZK0AZGaDaM6ohZiOdt5VL/WmPH46kGBh9KpGhWS75kVVtnP3Res= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_multipart_upload.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_07:44:33 tube: smithi user: tchandra verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T15:11:37.828 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa; will attempt to use it 2024-09-10T15:11:37.829 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa/tasks 2024-09-10T15:11:37.829 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T15:11:37.831 INFO:teuthology.task.internal:Checking packages... 2024-09-10T15:11:37.850 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7162ca8a22368558b9ec845c47e93c7afc45e8c3' 2024-09-10T15:11:37.850 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T15:11:37.850 INFO:teuthology.packaging:ref: None 2024-09-10T15:11:37.850 INFO:teuthology.packaging:tag: None 2024-09-10T15:11:37.850 INFO:teuthology.packaging:branch: wip-tejas-testing-2024-09-09-1611-squid 2024-09-10T15:11:37.850 INFO:teuthology.packaging:sha1: 7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:11:37.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-tejas-testing-2024-09-09-1611-squid 2024-09-10T15:11:37.991 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:11:37.992 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T15:11:37.999 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T15:11:37.999 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T15:11:38.028 INFO:teuthology.task.internal:Saving configuration 2024-09-10T15:11:38.041 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T15:11:38.046 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T15:11:38.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 15:05:43.278348', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDlOoGJb5zmnOWUmEMwNsUtEbwihnl7Gd1LtEUr+ahn3'} 2024-09-10T15:11:38.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 15:05:43.276299', 'locked_by': 'scheduled_tchandra@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDmfF6sYXqi/C9fa106+lCRyFiV/qxlCEl8zNX2XwKzV'} 2024-09-10T15:11:38.083 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T15:11:38.089 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-10T15:11:38.089 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-10T15:11:38.089 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T15:11:38.157 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4773ef30a0>, signals=[15]) 2024-09-10T15:11:38.157 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T15:11:38.163 INFO:teuthology.task.internal:Opening connections... 2024-09-10T15:11:38.163 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:11:38.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:11:38.250 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:11:38.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:11:38.332 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T15:11:38.339 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-09-10T15:11:38.344 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-09-10T15:11:38.344 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-09-10T15:11:38.392 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T15:11:38.393 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T15:11:38.393 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T15:11:38.393 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T15:11:38.393 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-09-10T15:11:38.393 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-09-10T15:11:38.413 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-09-10T15:11:38.419 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-09-10T15:11:38.419 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-09-10T15:11:38.464 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="22.04" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=jammy 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T15:11:38.465 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=jammy 2024-09-10T15:11:38.465 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-09-10T15:11:38.489 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T15:11:38.498 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T15:11:38.512 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T15:11:38.512 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-09-10T15:11:38.516 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-09-10T15:11:38.520 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T15:11:38.527 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T15:11:38.527 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-09-10T15:11:38.561 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-09-10T15:11:38.573 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T15:11:38.627 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T15:11:38.641 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T15:11:38.641 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T15:11:38.642 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T15:11:38.642 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T15:11:38.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:11:38.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:11:38.647 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-10T15:11:38.648 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-10T15:11:38.692 INFO:teuthology.orchestra.run.smithi159.stdout:5.15.0-56-generic 2024-09-10T15:11:38.693 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.15.0-56-generic 2024-09-10T15:11:38.693 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get clean 2024-09-10T15:11:38.696 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-56-generic 2024-09-10T15:11:38.696 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.15.0-56-generic 2024-09-10T15:11:38.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-09-10T15:11:38.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-10T15:11:38.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update 2024-09-10T15:11:38.940 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T15:11:38.944 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T15:11:38.945 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T15:11:38.966 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T15:11:38.986 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T15:11:39.020 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T15:11:39.057 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T15:11:39.079 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T15:11:39.168 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T15:11:39.188 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T15:11:39.243 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T15:11:39.243 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T15:11:39.280 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T15:11:39.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T15:11:39.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T15:11:39.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T15:11:39.304 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T15:11:39.305 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T15:11:39.305 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T15:11:39.306 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T15:11:39.312 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T15:11:39.316 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T15:11:39.317 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T15:11:39.319 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T15:11:39.319 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T15:11:39.321 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T15:11:39.324 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T15:11:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T15:11:39.325 INFO:teuthology.orchestra.run.smithi159.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T15:11:39.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T15:11:39.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T15:11:39.347 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T15:11:39.348 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T15:11:39.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T15:11:39.352 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T15:11:39.353 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T15:11:39.353 INFO:teuthology.orchestra.run.smithi159.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T15:11:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T15:11:39.358 INFO:teuthology.orchestra.run.smithi159.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T15:11:39.365 INFO:teuthology.orchestra.run.smithi159.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,122 kB] 2024-09-10T15:11:39.375 INFO:teuthology.orchestra.run.smithi159.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T15:11:39.378 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T15:11:39.381 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T15:11:39.381 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T15:11:39.386 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,122 kB] 2024-09-10T15:11:39.393 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T15:11:39.394 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-10T15:11:39.394 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T15:11:39.395 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T15:11:39.395 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T15:11:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-10T15:11:39.402 INFO:teuthology.orchestra.run.smithi159.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T15:11:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T15:11:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T15:11:39.403 INFO:teuthology.orchestra.run.smithi159.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T15:11:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T15:11:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T15:11:39.404 INFO:teuthology.orchestra.run.smithi159.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T15:11:39.410 INFO:teuthology.orchestra.run.smithi159.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T15:11:39.417 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T15:11:39.417 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T15:11:39.418 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T15:11:39.418 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T15:11:39.419 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T15:11:39.419 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T15:11:39.419 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T15:11:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T15:11:39.428 INFO:teuthology.orchestra.run.smithi159.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T15:11:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T15:11:39.429 INFO:teuthology.orchestra.run.smithi159.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T15:11:39.436 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T15:11:39.436 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T15:11:39.516 INFO:teuthology.orchestra.run.smithi159.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T15:11:39.799 INFO:teuthology.orchestra.run.smithi159.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T15:11:39.971 INFO:teuthology.orchestra.run.smithi159.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T15:11:39.983 INFO:teuthology.orchestra.run.smithi159.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T15:11:39.984 INFO:teuthology.orchestra.run.smithi159.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T15:11:39.985 INFO:teuthology.orchestra.run.smithi159.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T15:11:40.070 INFO:teuthology.orchestra.run.smithi159.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T15:11:40.078 INFO:teuthology.orchestra.run.smithi159.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T15:11:40.078 INFO:teuthology.orchestra.run.smithi159.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T15:11:40.092 INFO:teuthology.orchestra.run.smithi159.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T15:11:40.128 INFO:teuthology.orchestra.run.smithi159.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T15:11:40.134 INFO:teuthology.orchestra.run.smithi159.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T15:11:40.134 INFO:teuthology.orchestra.run.smithi159.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T15:11:40.135 INFO:teuthology.orchestra.run.smithi159.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T15:11:40.135 INFO:teuthology.orchestra.run.smithi159.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T15:11:40.216 INFO:teuthology.orchestra.run.smithi159.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T15:11:45.565 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 15.8 MB in 2s (7,565 kB/s) 2024-09-10T15:11:45.690 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 15.8 MB in 2s (7,302 kB/s) 2024-09-10T15:11:47.053 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-10T15:11:47.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T15:11:47.138 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-10T15:11:47.145 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2024-09-10T15:11:47.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T15:11:47.226 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2024-09-10T15:11:47.352 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-10T15:11:47.352 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-10T15:11:47.435 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2024-09-10T15:11:47.436 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2024-09-10T15:11:47.539 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T15:11:47.539 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T15:11:47.539 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T15:11:47.540 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T15:11:47.540 INFO:teuthology.orchestra.run.smithi099.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T15:11:47.540 INFO:teuthology.orchestra.run.smithi099.stdout: python2.7-minimal 2024-09-10T15:11:47.540 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T15:11:47.541 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-10T15:11:47.541 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T15:11:47.542 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T15:11:47.542 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T15:11:47.543 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-10T15:11:47.543 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T15:11:47.543 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-09-10T15:11:47.543 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2024-09-10T15:11:47.590 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-10T15:11:47.590 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T15:11:47.590 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T15:11:47.591 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T15:11:47.592 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-09-10T15:11:47.592 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T15:11:47.609 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T15:11:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T15:11:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T15:11:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T15:11:47.610 INFO:teuthology.orchestra.run.smithi159.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T15:11:47.611 INFO:teuthology.orchestra.run.smithi159.stdout: python2.7-minimal 2024-09-10T15:11:47.611 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T15:11:47.612 INFO:teuthology.orchestra.run.smithi159.stdout:The following additional packages will be installed: 2024-09-10T15:11:47.612 INFO:teuthology.orchestra.run.smithi159.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T15:11:47.612 INFO:teuthology.orchestra.run.smithi159.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T15:11:47.612 INFO:teuthology.orchestra.run.smithi159.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T15:11:47.614 INFO:teuthology.orchestra.run.smithi159.stdout:Suggested packages: 2024-09-10T15:11:47.614 INFO:teuthology.orchestra.run.smithi159.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T15:11:47.614 INFO:teuthology.orchestra.run.smithi159.stdout:Recommended packages: 2024-09-10T15:11:47.614 INFO:teuthology.orchestra.run.smithi159.stdout: thermald 2024-09-10T15:11:47.644 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T15:11:47.645 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 113 MB of archives. 2024-09-10T15:11:47.645 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T15:11:47.645 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T15:11:47.667 INFO:teuthology.orchestra.run.smithi159.stdout:The following NEW packages will be installed: 2024-09-10T15:11:47.667 INFO:teuthology.orchestra.run.smithi159.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T15:11:47.667 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T15:11:47.667 INFO:teuthology.orchestra.run.smithi159.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T15:11:47.668 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages will be upgraded: 2024-09-10T15:11:47.669 INFO:teuthology.orchestra.run.smithi159.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T15:11:47.719 INFO:teuthology.orchestra.run.smithi159.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T15:11:47.719 INFO:teuthology.orchestra.run.smithi159.stdout:Need to get 113 MB of archives. 2024-09-10T15:11:47.719 INFO:teuthology.orchestra.run.smithi159.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T15:11:47.720 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T15:11:48.076 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T15:11:48.158 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T15:11:48.187 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T15:11:48.273 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T15:11:49.020 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T15:11:49.020 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T15:11:49.020 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T15:11:49.050 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T15:11:49.051 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T15:11:49.051 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T15:11:49.145 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T15:11:49.168 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T15:11:49.170 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T15:11:49.264 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T15:11:49.557 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 113 MB in 2s (72.2 MB/s) 2024-09-10T15:11:49.661 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 113 MB in 2s (71.4 MB/s) 2024-09-10T15:11:49.755 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T15:11:49.822 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T15:11:51.793 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T15:11:51.797 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:11:51.869 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:11:51.959 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T15:11:51.963 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:11:52.036 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:11:54.188 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T15:11:54.210 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:11:54.297 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:11:54.410 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T15:11:54.432 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:11:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:11:54.725 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T15:11:54.745 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:11:54.783 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:11:54.980 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T15:11:55.000 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:11:55.038 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:01.393 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T15:12:01.512 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T15:12:01.811 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T15:12:01.840 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T15:12:01.932 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T15:12:01.971 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T15:12:02.234 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T15:12:02.257 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T15:12:02.280 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T15:12:02.301 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T15:12:02.408 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T15:12:02.703 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T15:12:02.724 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T15:12:02.761 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T15:12:07.695 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T15:12:07.732 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:12:07.769 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:08.614 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T15:12:08.650 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T15:12:08.688 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:11.263 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T15:12:11.385 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T15:12:11.710 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T15:12:11.840 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:11.966 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T15:12:12.103 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:12.131 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T15:12:12.279 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T15:12:12.620 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T15:12:12.750 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:12.893 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T15:12:12.997 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:13.421 INFO:teuthology.orchestra.run.smithi159.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T15:12:13.421 INFO:teuthology.orchestra.run.smithi159.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T15:12:13.421 INFO:teuthology.orchestra.run.smithi159.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T15:12:13.421 INFO:teuthology.orchestra.run.smithi159.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:13.588 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:14.323 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T15:12:14.323 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T15:12:14.323 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T15:12:14.323 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:14.497 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:15.422 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:15.932 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:16.816 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T15:12:16.941 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T15:12:17.077 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:17.146 INFO:teuthology.orchestra.run.smithi159.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T15:12:17.146 INFO:teuthology.orchestra.run.smithi159.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:17.409 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T15:12:17.534 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T15:12:17.652 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T15:12:17.711 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T15:12:17.711 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:31.158 INFO:teuthology.orchestra.run.smithi159.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T15:12:31.158 INFO:teuthology.orchestra.run.smithi159.stdout:Sourcing file `/etc/default/grub' 2024-09-10T15:12:31.169 INFO:teuthology.orchestra.run.smithi159.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T15:12:31.200 INFO:teuthology.orchestra.run.smithi159.stdout:Generating grub configuration file ... 2024-09-10T15:12:31.461 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T15:12:31.480 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:31.755 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T15:12:31.761 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T15:12:31.834 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T15:12:31.840 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T15:12:31.981 INFO:teuthology.orchestra.run.smithi159.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T15:12:31.981 INFO:teuthology.orchestra.run.smithi159.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T15:12:31.982 INFO:teuthology.orchestra.run.smithi159.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T15:12:32.018 INFO:teuthology.orchestra.run.smithi159.stdout:done 2024-09-10T15:12:32.469 DEBUG:teuthology.orchestra.run.smithi159:> dpkg -s linux-image-generic 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Package: linux-image-generic 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Status: install ok installed 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Priority: optional 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Section: kernel 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Installed-Size: 21 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: amd64 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Source: linux-meta 2024-09-10T15:12:32.486 INFO:teuthology.orchestra.run.smithi159.stdout:Version: 5.15.0.119.119 2024-09-10T15:12:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T15:12:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T15:12:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:Recommends: thermald 2024-09-10T15:12:32.487 INFO:teuthology.orchestra.run.smithi159.stdout:Description: Generic Linux kernel image 2024-09-10T15:12:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: This package will always depend on the latest generic kernel image 2024-09-10T15:12:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: available. 2024-09-10T15:12:32.487 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T15:12:32.487 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T15:12:32.487 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T15:12:32.488 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-10T15:12:32.488 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T15:12:32.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get clean 2024-09-10T15:12:32.541 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T15:12:32.541 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2024-09-10T15:12:32.554 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T15:12:32.571 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2024-09-10T15:12:32.658 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update 2024-09-10T15:12:32.800 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T15:12:32.808 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T15:12:32.826 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T15:12:32.861 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T15:12:32.888 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:32.905 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T15:12:33.185 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T15:12:33.190 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T15:12:33.261 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T15:12:33.266 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T15:12:33.428 INFO:teuthology.orchestra.run.smithi099.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T15:12:33.428 INFO:teuthology.orchestra.run.smithi099.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T15:12:33.428 INFO:teuthology.orchestra.run.smithi099.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T15:12:33.471 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-09-10T15:12:33.852 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-09-10T15:12:33.872 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.119.119 2024-09-10T15:12:33.873 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T15:12:33.873 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T15:12:33.873 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-09-10T15:12:33.873 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-09-10T15:12:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-09-10T15:12:33.873 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-09-10T15:12:33.873 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T15:12:33.873 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T15:12:33.873 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T15:12:33.873 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T15:12:33.873 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T15:12:33.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-09-10T15:12:34.059 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-10T15:12:34.186 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T15:12:34.195 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T15:12:34.213 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T15:12:34.258 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2024-09-10T15:12:34.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T15:12:34.308 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T15:12:34.330 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2024-09-10T15:12:34.516 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2024-09-10T15:12:34.517 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2024-09-10T15:12:34.685 INFO:teuthology.orchestra.run.smithi159.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T15:12:34.686 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T15:12:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T15:12:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T15:12:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T15:12:34.686 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T15:12:34.687 INFO:teuthology.orchestra.run.smithi159.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T15:12:34.687 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T15:12:34.727 INFO:teuthology.orchestra.run.smithi159.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T15:12:34.729 DEBUG:teuthology.orchestra.run.smithi159:> dpkg -s linux-image-generic 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Package: linux-image-generic 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Status: install ok installed 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Priority: optional 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Section: kernel 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Installed-Size: 21 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: amd64 2024-09-10T15:12:34.784 INFO:teuthology.orchestra.run.smithi159.stdout:Source: linux-meta 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout:Version: 5.15.0.119.119 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout:Recommends: thermald 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout:Description: Generic Linux kernel image 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: This package will always depend on the latest generic kernel image 2024-09-10T15:12:34.785 INFO:teuthology.orchestra.run.smithi159.stdout: available. 2024-09-10T15:12:34.785 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-09-10T15:12:34.832 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.UPe2KbYhi1 2024-09-10T15:12:34.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UPe2KbYhi1 2024-09-10T15:12:34.886 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.UPe2KbYhi1 2024-09-10T15:12:34.999 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.UPe2KbYhi1 is 10KB 2024-09-10T15:12:35.012 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.UPe2KbYhi1 2024-09-10T15:12:35.017 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T15:12:35.072 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:12:35.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T15:12:35.073 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T15:12:35.139 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T15:12:35.139 DEBUG:teuthology.orchestra.run.smithi159:> sudo update-grub 2024-09-10T15:12:35.606 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-10T15:12:35.626 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T15:12:35.688 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-10T15:12:35.897 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-10T15:12:35.898 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-10T15:12:36.082 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T15:12:36.083 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T15:12:36.083 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T15:12:36.083 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T15:12:36.083 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T15:12:36.083 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T15:12:36.084 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T15:12:36.084 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T15:12:36.124 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T15:12:36.126 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-09-10T15:12:36.141 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-09-10T15:12:36.141 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-09-10T15:12:36.141 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-09-10T15:12:36.141 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.119.119 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-09-10T15:12:36.142 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-09-10T15:12:36.143 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-10T15:12:36.187 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.zsSkjbKU6t 2024-09-10T15:12:36.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.zsSkjbKU6t 2024-09-10T15:12:36.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.zsSkjbKU6t 2024-09-10T15:12:36.328 INFO:teuthology.orchestra.run.smithi159.stderr:Sourcing file `/etc/default/grub' 2024-09-10T15:12:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T15:12:36.332 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-09-10T15:12:36.363 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.zsSkjbKU6t is 10KB 2024-09-10T15:12:36.412 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.zsSkjbKU6t 2024-09-10T15:12:36.417 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T15:12:36.470 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:12:36.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T15:12:36.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T15:12:36.515 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T15:12:36.521 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:36.538 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T15:12:36.539 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2024-09-10T15:12:36.753 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T15:12:36.758 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T15:12:36.797 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T15:12:36.801 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T15:12:36.909 INFO:teuthology.orchestra.run.smithi159.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T15:12:36.909 INFO:teuthology.orchestra.run.smithi159.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T15:12:36.909 INFO:teuthology.orchestra.run.smithi159.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T15:12:36.918 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-09-10T15:12:36.931 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-09-10T15:12:37.772 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2024-09-10T15:12:37.773 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T15:12:37.775 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-09-10T15:12:37.960 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T15:12:37.965 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T15:12:38.194 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T15:12:38.199 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T15:12:38.236 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T15:12:38.241 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T15:12:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T15:12:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T15:12:38.352 INFO:teuthology.orchestra.run.smithi099.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T15:12:38.363 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-09-10T15:12:38.380 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-09-10T15:13:06.961 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-10T15:13:06.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:13:06.963 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:13:08.384 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T15:13:08.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:13:08.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:13:25.313 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-10T15:13:26.845 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-10T15:13:34.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:13:34.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:13:35.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:13:35.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:13:37.377 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-10T15:13:38.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-10T15:13:49.387 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:13:49.388 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:13:50.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:13:50.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:13:52.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2024-09-10T15:14:07.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:14:07.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:14:09.345 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-09-10T15:14:24.357 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:14:24.358 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:14:24.844 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-10T15:14:25.988 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:14:25.988 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T15:14:25.988 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-09-10T15:14:25.994 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-119-generic 2024-09-10T15:14:25.994 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T15:14:25.994 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T15:14:25.994 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T15:14:26.995 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T15:14:26.995 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T15:14:27.140 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-09-10T15:14:27.172 DEBUG:teuthology.parallel:result is None 2024-09-10T15:14:39.305 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-10T15:14:39.831 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:14:39.831 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-10T15:14:39.832 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-09-10T15:14:39.879 INFO:teuthology.orchestra.run.smithi159.stdout:5.15.0-119-generic 2024-09-10T15:14:39.879 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T15:14:39.879 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T15:14:39.879 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T15:14:40.880 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-10T15:14:40.880 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T15:14:40.952 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2024-09-10T15:14:40.981 DEBUG:teuthology.parallel:result is None 2024-09-10T15:14:40.981 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T15:14:40.989 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T15:14:40.990 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T15:14:40.993 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T15:14:40.999 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T15:14:41.020 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T15:14:41.054 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T15:14:41.054 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T15:14:41.056 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T15:14:41.076 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T15:14:41.087 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T15:14:41.087 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T15:14:41.115 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T15:14:41.132 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T15:14:41.134 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T15:14:41.142 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T15:14:41.142 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T15:14:41.143 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T15:14:41.155 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T15:14:41.156 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T15:14:41.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T15:14:41.201 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T15:14:41.210 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T15:14:41.210 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T15:14:41.243 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T15:14:41.249 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T15:14:41.295 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T15:14:41.342 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:14:41.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T15:14:41.410 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T15:14:41.416 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T15:14:41.463 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:14:41.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T15:14:41.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-09-10T15:14:41.528 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-09-10T15:14:41.609 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T15:14:41.617 INFO:teuthology.task.internal:Starting timer... 2024-09-10T15:14:41.617 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T15:14:41.649 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T15:14:41.681 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2024-09-10T15:14:41.681 DEBUG:teuthology.task.selinux:Excluding smithi159: OS 'ubuntu' does not support SELinux 2024-09-10T15:14:41.681 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T15:14:41.681 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T15:14:41.681 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T15:14:41.681 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T15:14:41.718 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T15:14:41.729 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T15:14:41.730 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T15:22:11.342 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2024-09-10T15:22:11.344 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:22:11.345 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:22:11.434 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-09-10T15:22:11.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-09-10T15:22:11.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:22:11.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T15:22:11.625 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-09-10T15:22:11.705 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-09-10T15:22:11.705 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T15:22:11.716 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T15:22:11.716 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T15:22:11.717 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T15:22:11.719 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T15:22:11.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T15:22:11.749 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T15:22:11.750 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Command line: ntpd -gq 2024-09-10T15:22:11.750 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: ---------------------------------------------------- 2024-09-10T15:22:11.750 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T15:22:11.750 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T15:22:11.751 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: corporation. Support and training for ntp-4 are 2024-09-10T15:22:11.751 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: available at https://www.nwtime.org/support 2024-09-10T15:22:11.751 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: ---------------------------------------------------- 2024-09-10T15:22:11.751 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: proto: precision = 0.063 usec (-24) 2024-09-10T15:22:11.751 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: basedate set to 2022-02-04 2024-09-10T15:22:11.752 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: gps base set to 2022-02-06 (week 2196) 2024-09-10T15:22:11.752 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T15:22:11.752 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T15:22:11.752 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T15:22:11.753 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T15:22:11.753 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T15:22:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T15:22:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T15:22:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2024-09-10T15:22:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listen normally on 4 lo [::1]:123 2024-09-10T15:22:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2024-09-10T15:22:11.754 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:11 ntpd[18429]: Listening on routing socket on fd #22 for interface updates 2024-09-10T15:22:11.779 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T15:22:11.779 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Command line: ntpd -gq 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: ---------------------------------------------------- 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: corporation. Support and training for ntp-4 are 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: available at https://www.nwtime.org/support 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: ---------------------------------------------------- 2024-09-10T15:22:11.780 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: proto: precision = 0.044 usec (-24) 2024-09-10T15:22:11.781 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: basedate set to 2022-02-04 2024-09-10T15:22:11.781 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: gps base set to 2022-02-06 (week 2196) 2024-09-10T15:22:11.781 INFO:teuthology.orchestra.run.smithi159.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T15:22:11.781 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T15:22:11.781 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T15:22:11.782 INFO:teuthology.orchestra.run.smithi159.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T15:22:11.782 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T15:22:11.783 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T15:22:11.783 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T15:22:11.783 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listen normally on 3 enp3s0f1 172.21.15.159:123 2024-09-10T15:22:11.783 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listen normally on 4 lo [::1]:123 2024-09-10T15:22:11.783 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:724f%5]:123 2024-09-10T15:22:11.783 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:11 ntpd[18493]: Listening on routing socket on fd #22 for interface updates 2024-09-10T15:22:12.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:12 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:12.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:12 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:12 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:12 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:12 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:12.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:12 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:12.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:12 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:12.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:12 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:12.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:12 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:12.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:12 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:12.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:12 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:12.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:12 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:13 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:13 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:13 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:13.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:13 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:13 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:13.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:13 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:13.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:13 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:13.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:13 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:14 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:14 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:14.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:14 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:14.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:14 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:14.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:14 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:14.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:14 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:14.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:14 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:14.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:14 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:14.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:14 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:14.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:14 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:14.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:14 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:14.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:14 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:15.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:15.751 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:15 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:15.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:15 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:15.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:15 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:15.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:15 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:15.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:15 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:15.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:15 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:15.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:15 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:16.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:16.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:16 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:16.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:16.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:16 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:17.752 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:17.753 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:17.753 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:17 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:17.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:17 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:17.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:17 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:17.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:17 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:17.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:17 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:17.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:17 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:17.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:17 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:18.749 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:18.750 INFO:teuthology.orchestra.run.smithi099.stdout:10 Sep 15:22:18 ntpd[18429]: ntpd: time slew -0.001684 s 2024-09-10T15:22:18.750 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew -0.001684s 2024-09-10T15:22:18.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T15:22:18.750 INFO:teuthology.orchestra.run.smithi099.stderr:10 Sep 15:22:18 ntpd[18429]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T15:22:18.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:18.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:18.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:18.780 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stdout:10 Sep 15:22:18 ntpd[18493]: ntpd: time slew -0.001082 s 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stdout:ntpd: time slew -0.001082s 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T15:22:18.781 INFO:teuthology.orchestra.run.smithi159.stderr:10 Sep 15:22:18 ntpd[18493]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T15:22:18.803 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T15:22:18.804 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-09-10T15:22:18.804 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.804 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.804 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.804 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.833 INFO:teuthology.orchestra.run.smithi159.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T15:22:18.833 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================== 2024-09-10T15:22:18.833 INFO:teuthology.orchestra.run.smithi159.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.833 INFO:teuthology.orchestra.run.smithi159.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.833 INFO:teuthology.orchestra.run.smithi159.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.833 INFO:teuthology.orchestra.run.smithi159.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:22:18.834 INFO:teuthology.run_tasks:Running task install... 2024-09-10T15:22:18.843 DEBUG:teuthology.task.install:project ceph 2024-09-10T15:22:18.843 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}} 2024-09-10T15:22:18.843 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'} 2024-09-10T15:22:18.843 INFO:teuthology.task.install:Using flavor: default 2024-09-10T15:22:18.850 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T15:22:18.850 INFO:teuthology.task.install:extra packages: [] 2024-09-10T15:22:18.850 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2024-09-10T15:22:18.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-key list | grep Ceph 2024-09-10T15:22:18.903 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T15:22:18.929 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T15:22:18.930 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T15:22:18.930 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T15:22:18.930 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:22:18.935 INFO:teuthology.orchestra.run.smithi159.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T15:22:18.964 INFO:teuthology.orchestra.run.smithi159.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T15:22:18.965 INFO:teuthology.orchestra.run.smithi159.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T15:22:18.965 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T15:22:18.965 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:22:19.080 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-10T15:22:19.080 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:22:19.104 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default/ 2024-09-10T15:22:19.104 INFO:teuthology.task.install.deb:Package version is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:22:19.202 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:22:19.203 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T15:22:19.217 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-09-10T15:22:19.228 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:22:19.228 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T15:22:19.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update 2024-09-10T15:22:19.410 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T15:22:19.419 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T15:22:19.436 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T15:22:19.443 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T15:22:19.464 INFO:teuthology.orchestra.run.smithi159.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T15:22:19.464 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-10T15:22:19.485 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-10T15:22:19.487 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T15:22:19.507 INFO:teuthology.orchestra.run.smithi159.stdout:Ign:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T15:22:19.509 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-10T15:22:19.528 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-10T15:22:19.529 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T15:22:19.529 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T15:22:19.533 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T15:22:19.550 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,419 B] 2024-09-10T15:22:19.554 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-10T15:22:19.592 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T15:22:19.673 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T15:22:19.756 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 28.9 kB in 0s (86.2 kB/s) 2024-09-10T15:22:19.901 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 28.9 kB in 0s (58.0 kB/s) 2024-09-10T15:22:20.751 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2024-09-10T15:22:20.768 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:22:20.821 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2024-09-10T15:22:20.941 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-10T15:22:20.957 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-304-g7162ca8a-1jammy cephadm=19.1.1-304-g7162ca8a-1jammy ceph-mds=19.1.1-304-g7162ca8a-1jammy ceph-mgr=19.1.1-304-g7162ca8a-1jammy ceph-common=19.1.1-304-g7162ca8a-1jammy ceph-fuse=19.1.1-304-g7162ca8a-1jammy ceph-test=19.1.1-304-g7162ca8a-1jammy ceph-volume=19.1.1-304-g7162ca8a-1jammy radosgw=19.1.1-304-g7162ca8a-1jammy python3-rados=19.1.1-304-g7162ca8a-1jammy python3-rgw=19.1.1-304-g7162ca8a-1jammy python3-cephfs=19.1.1-304-g7162ca8a-1jammy python3-rbd=19.1.1-304-g7162ca8a-1jammy libcephfs2=19.1.1-304-g7162ca8a-1jammy libcephfs-dev=19.1.1-304-g7162ca8a-1jammy librados2=19.1.1-304-g7162ca8a-1jammy librbd1=19.1.1-304-g7162ca8a-1jammy rbd-fuse=19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:22:21.006 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2024-09-10T15:22:21.006 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2024-09-10T15:22:21.009 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-09-10T15:22:21.189 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T15:22:21.189 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T15:22:21.189 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T15:22:21.190 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T15:22:21.190 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout:The following additional packages will be installed: 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T15:22:21.191 INFO:teuthology.orchestra.run.smithi159.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T15:22:21.192 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T15:22:21.192 INFO:teuthology.orchestra.run.smithi159.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T15:22:21.192 INFO:teuthology.orchestra.run.smithi159.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T15:22:21.192 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T15:22:21.192 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T15:22:21.193 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet zip 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout:Suggested packages: 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T15:22:21.194 INFO:teuthology.orchestra.run.smithi159.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T15:22:21.195 INFO:teuthology.orchestra.run.smithi159.stdout:Recommended packages: 2024-09-10T15:22:21.195 INFO:teuthology.orchestra.run.smithi159.stdout: btrfs-tools 2024-09-10T15:22:21.195 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-09-10T15:22:21.195 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout:The following NEW packages will be installed: 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T15:22:21.298 INFO:teuthology.orchestra.run.smithi159.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T15:22:21.299 INFO:teuthology.orchestra.run.smithi159.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T15:22:21.299 INFO:teuthology.orchestra.run.smithi159.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T15:22:21.299 INFO:teuthology.orchestra.run.smithi159.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T15:22:21.299 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T15:22:21.300 INFO:teuthology.orchestra.run.smithi159.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T15:22:21.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T15:22:21.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T15:22:21.301 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T15:22:21.301 INFO:teuthology.orchestra.run.smithi159.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T15:22:21.379 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T15:22:21.380 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T15:22:21.380 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T15:22:21.380 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T15:22:21.380 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T15:22:21.380 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T15:22:21.380 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T15:22:21.381 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-09-10T15:22:21.381 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T15:22:21.381 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T15:22:21.381 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-10T15:22:21.381 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T15:22:21.383 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet zip 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-09-10T15:22:21.384 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-09-10T15:22:21.385 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2024-09-10T15:22:21.443 INFO:teuthology.orchestra.run.smithi159.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T15:22:21.444 INFO:teuthology.orchestra.run.smithi159.stdout:Need to get 181 MB of archives. 2024-09-10T15:22:21.444 INFO:teuthology.orchestra.run.smithi159.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-10T15:22:21.444 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-10T15:22:21.486 INFO:teuthology.orchestra.run.smithi099.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T15:22:21.488 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi099.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T15:22:21.489 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T15:22:21.630 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T15:22:21.631 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 181 MB of archives. 2024-09-10T15:22:21.631 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-10T15:22:21.631 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-304-g7162ca8a-1jammy [3,590 kB] 2024-09-10T15:22:21.631 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-10T15:22:21.676 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T15:22:21.681 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-10T15:22:21.690 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-10T15:22:21.698 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-10T15:22:21.699 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-10T15:22:21.702 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-10T15:22:21.703 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-10T15:22:21.709 INFO:teuthology.orchestra.run.smithi159.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-10T15:22:21.855 INFO:teuthology.orchestra.run.smithi159.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-10T15:22:21.856 INFO:teuthology.orchestra.run.smithi159.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-10T15:22:21.863 INFO:teuthology.orchestra.run.smithi159.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-10T15:22:21.908 INFO:teuthology.orchestra.run.smithi159.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T15:22:21.920 INFO:teuthology.orchestra.run.smithi159.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T15:22:21.994 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-304-g7162ca8a-1jammy [3,243 kB] 2024-09-10T15:22:22.001 INFO:teuthology.orchestra.run.smithi159.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T15:22:22.096 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T15:22:22.108 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T15:22:22.189 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T15:22:22.214 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-304-g7162ca8a-1jammy [720 kB] 2024-09-10T15:22:22.230 INFO:teuthology.orchestra.run.smithi159.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T15:22:22.241 INFO:teuthology.orchestra.run.smithi159.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T15:22:22.271 INFO:teuthology.orchestra.run.smithi159.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T15:22:22.271 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-304-g7162ca8a-1jammy [356 kB] 2024-09-10T15:22:22.301 INFO:teuthology.orchestra.run.smithi159.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T15:22:22.302 INFO:teuthology.orchestra.run.smithi159.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T15:22:22.303 INFO:teuthology.orchestra.run.smithi159.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T15:22:22.319 INFO:teuthology.orchestra.run.smithi159.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T15:22:22.321 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-304-g7162ca8a-1jammy [32.8 kB] 2024-09-10T15:22:22.322 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-304-g7162ca8a-1jammy [180 kB] 2024-09-10T15:22:22.323 INFO:teuthology.orchestra.run.smithi159.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T15:22:22.327 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-304-g7162ca8a-1jammy [67.6 kB] 2024-09-10T15:22:22.327 INFO:teuthology.orchestra.run.smithi159.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T15:22:22.328 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-304-g7162ca8a-1jammy [333 kB] 2024-09-10T15:22:22.329 INFO:teuthology.orchestra.run.smithi159.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T15:22:22.335 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-304-g7162ca8a-1jammy [6,873 kB] 2024-09-10T15:22:22.394 INFO:teuthology.orchestra.run.smithi159.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T15:22:22.398 INFO:teuthology.orchestra.run.smithi159.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T15:22:22.403 INFO:teuthology.orchestra.run.smithi159.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T15:22:22.406 INFO:teuthology.orchestra.run.smithi159.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T15:22:22.407 INFO:teuthology.orchestra.run.smithi159.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T15:22:22.418 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T15:22:22.429 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T15:22:22.459 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T15:22:22.468 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T15:22:22.469 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T15:22:22.470 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T15:22:22.475 INFO:teuthology.orchestra.run.smithi159.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T15:22:22.478 INFO:teuthology.orchestra.run.smithi159.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T15:22:22.479 INFO:teuthology.orchestra.run.smithi159.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T15:22:22.480 INFO:teuthology.orchestra.run.smithi159.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T15:22:22.480 INFO:teuthology.orchestra.run.smithi159.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T15:22:22.488 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T15:22:22.493 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T15:22:22.498 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T15:22:22.500 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T15:22:22.535 INFO:teuthology.orchestra.run.smithi159.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-10T15:22:22.557 INFO:teuthology.orchestra.run.smithi159.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T15:22:22.557 INFO:teuthology.orchestra.run.smithi159.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T15:22:22.558 INFO:teuthology.orchestra.run.smithi159.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T15:22:22.564 INFO:teuthology.orchestra.run.smithi159.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T15:22:22.565 INFO:teuthology.orchestra.run.smithi159.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T15:22:22.582 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T15:22:22.586 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T15:22:22.587 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-304-g7162ca8a-1jammy [112 kB] 2024-09-10T15:22:22.589 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-304-g7162ca8a-1jammy [472 kB] 2024-09-10T15:22:22.591 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T15:22:22.594 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T15:22:22.596 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T15:22:22.597 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T15:22:22.599 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T15:22:22.599 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T15:22:22.600 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T15:22:22.604 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-304-g7162ca8a-1jammy [25.9 MB] 2024-09-10T15:22:22.611 INFO:teuthology.orchestra.run.smithi159.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-10T15:22:22.613 INFO:teuthology.orchestra.run.smithi159.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-10T15:22:22.615 INFO:teuthology.orchestra.run.smithi159.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-10T15:22:22.638 INFO:teuthology.orchestra.run.smithi159.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T15:22:22.639 INFO:teuthology.orchestra.run.smithi159.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T15:22:22.641 INFO:teuthology.orchestra.run.smithi159.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T15:22:22.642 INFO:teuthology.orchestra.run.smithi159.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T15:22:22.642 INFO:teuthology.orchestra.run.smithi159.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T15:22:22.644 INFO:teuthology.orchestra.run.smithi159.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-10T15:22:22.663 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T15:22:22.683 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T15:22:22.684 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T15:22:22.685 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T15:22:22.690 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T15:22:22.691 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T15:22:22.719 INFO:teuthology.orchestra.run.smithi159.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T15:22:22.721 INFO:teuthology.orchestra.run.smithi159.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T15:22:22.722 INFO:teuthology.orchestra.run.smithi159.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T15:22:22.733 INFO:teuthology.orchestra.run.smithi159.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T15:22:22.733 INFO:teuthology.orchestra.run.smithi159.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T15:22:22.745 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T15:22:22.746 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T15:22:22.748 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T15:22:22.749 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T15:22:22.790 INFO:teuthology.orchestra.run.smithi159.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-10T15:22:22.801 INFO:teuthology.orchestra.run.smithi159.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T15:22:22.802 INFO:teuthology.orchestra.run.smithi159.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T15:22:22.805 INFO:teuthology.orchestra.run.smithi159.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T15:22:22.810 INFO:teuthology.orchestra.run.smithi159.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T15:22:22.810 INFO:teuthology.orchestra.run.smithi159.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T15:22:22.826 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T15:22:22.828 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T15:22:22.830 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T15:22:22.832 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T15:22:22.842 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T15:22:22.882 INFO:teuthology.orchestra.run.smithi159.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T15:22:22.884 INFO:teuthology.orchestra.run.smithi159.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T15:22:22.889 INFO:teuthology.orchestra.run.smithi159.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T15:22:22.890 INFO:teuthology.orchestra.run.smithi159.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T15:22:22.891 INFO:teuthology.orchestra.run.smithi159.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T15:22:22.907 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T15:22:22.908 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T15:22:22.910 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T15:22:22.912 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T15:22:22.916 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T15:22:22.964 INFO:teuthology.orchestra.run.smithi159.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T15:22:22.988 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T15:22:22.991 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T15:22:22.993 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T15:22:22.998 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T15:22:22.999 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T15:22:23.070 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T15:22:23.075 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T15:22:23.086 INFO:teuthology.orchestra.run.smithi159.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T15:22:23.088 INFO:teuthology.orchestra.run.smithi159.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T15:22:23.127 INFO:teuthology.orchestra.run.smithi159.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T15:22:23.128 INFO:teuthology.orchestra.run.smithi159.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T15:22:23.130 INFO:teuthology.orchestra.run.smithi159.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T15:22:23.161 INFO:teuthology.orchestra.run.smithi159.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T15:22:23.165 INFO:teuthology.orchestra.run.smithi159.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T15:22:23.165 INFO:teuthology.orchestra.run.smithi159.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T15:22:23.228 INFO:teuthology.orchestra.run.smithi159.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T15:22:23.228 INFO:teuthology.orchestra.run.smithi159.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T15:22:23.238 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T15:22:23.240 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T15:22:23.243 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T15:22:23.244 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T15:22:23.246 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T15:22:23.281 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T15:22:23.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T15:22:23.284 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T15:22:23.289 INFO:teuthology.orchestra.run.smithi159.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T15:22:23.290 INFO:teuthology.orchestra.run.smithi159.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T15:22:23.290 INFO:teuthology.orchestra.run.smithi159.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T15:22:23.292 INFO:teuthology.orchestra.run.smithi159.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T15:22:23.293 INFO:teuthology.orchestra.run.smithi159.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T15:22:23.293 INFO:teuthology.orchestra.run.smithi159.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T15:22:23.300 INFO:teuthology.orchestra.run.smithi159.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T15:22:23.348 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T15:22:23.348 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T15:22:23.350 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T15:22:23.370 INFO:teuthology.orchestra.run.smithi159.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T15:22:23.405 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T15:22:23.406 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T15:22:23.407 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T15:22:23.408 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T15:22:23.410 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T15:22:23.416 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T15:22:23.429 INFO:teuthology.orchestra.run.smithi159.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T15:22:23.431 INFO:teuthology.orchestra.run.smithi159.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-10T15:22:23.431 INFO:teuthology.orchestra.run.smithi159.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T15:22:23.431 INFO:teuthology.orchestra.run.smithi159.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-10T15:22:23.445 INFO:teuthology.orchestra.run.smithi159.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-10T15:22:23.451 INFO:teuthology.orchestra.run.smithi159.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T15:22:23.458 INFO:teuthology.orchestra.run.smithi159.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T15:22:23.461 INFO:teuthology.orchestra.run.smithi159.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T15:22:23.463 INFO:teuthology.orchestra.run.smithi159.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T15:22:23.474 INFO:teuthology.orchestra.run.smithi159.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T15:22:23.475 INFO:teuthology.orchestra.run.smithi159.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T15:22:23.483 INFO:teuthology.orchestra.run.smithi159.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-10T15:22:23.483 INFO:teuthology.orchestra.run.smithi159.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T15:22:23.488 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T15:22:23.490 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T15:22:23.492 INFO:teuthology.orchestra.run.smithi159.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-10T15:22:23.492 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T15:22:23.494 INFO:teuthology.orchestra.run.smithi159.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-10T15:22:23.501 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T15:22:23.533 INFO:teuthology.orchestra.run.smithi159.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T15:22:23.535 INFO:teuthology.orchestra.run.smithi159.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T15:22:23.535 INFO:teuthology.orchestra.run.smithi159.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T15:22:23.541 INFO:teuthology.orchestra.run.smithi159.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-10T15:22:23.568 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T15:22:23.571 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T15:22:23.573 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T15:22:23.584 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T15:22:23.586 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T15:22:23.594 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T15:22:23.614 INFO:teuthology.orchestra.run.smithi159.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T15:22:23.616 INFO:teuthology.orchestra.run.smithi159.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T15:22:23.636 INFO:teuthology.orchestra.run.smithi159.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T15:22:23.637 INFO:teuthology.orchestra.run.smithi159.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T15:22:23.638 INFO:teuthology.orchestra.run.smithi159.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T15:22:23.643 INFO:teuthology.orchestra.run.smithi159.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T15:22:23.645 INFO:teuthology.orchestra.run.smithi159.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T15:22:23.649 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T15:22:23.651 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T15:22:23.652 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T15:22:23.656 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T15:22:23.731 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T15:22:23.742 INFO:teuthology.orchestra.run.smithi159.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-10T15:22:23.742 INFO:teuthology.orchestra.run.smithi159.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-10T15:22:23.751 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T15:22:23.752 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T15:22:23.753 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T15:22:23.759 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T15:22:23.761 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T15:22:23.940 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-304-g7162ca8a-1jammy [5,145 kB] 2024-09-10T15:22:24.154 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-304-g7162ca8a-1jammy [245 kB] 2024-09-10T15:22:24.159 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-304-g7162ca8a-1jammy [124 kB] 2024-09-10T15:22:24.162 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-304-g7162ca8a-1jammy [1,555 kB] 2024-09-10T15:22:24.237 INFO:teuthology.orchestra.run.smithi099.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-304-g7162ca8a-1jammy [6,143 kB] 2024-09-10T15:22:24.556 INFO:teuthology.orchestra.run.smithi099.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-304-g7162ca8a-1jammy [22.8 MB] 2024-09-10T15:22:25.260 INFO:teuthology.orchestra.run.smithi159.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-10T15:22:25.264 INFO:teuthology.orchestra.run.smithi159.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-10T15:22:25.266 INFO:teuthology.orchestra.run.smithi159.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-10T15:22:25.380 INFO:teuthology.orchestra.run.smithi099.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-304-g7162ca8a-1jammy [14.1 kB] 2024-09-10T15:22:25.380 INFO:teuthology.orchestra.run.smithi099.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-304-g7162ca8a-1jammy [877 kB] 2024-09-10T15:22:25.393 INFO:teuthology.orchestra.run.smithi099.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-304-g7162ca8a-1jammy [2,460 kB] 2024-09-10T15:22:25.427 INFO:teuthology.orchestra.run.smithi099.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-304-g7162ca8a-1jammy [794 kB] 2024-09-10T15:22:25.455 INFO:teuthology.orchestra.run.smithi099.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-304-g7162ca8a-1jammy [152 kB] 2024-09-10T15:22:25.458 INFO:teuthology.orchestra.run.smithi099.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-304-g7162ca8a-1jammy [2,284 kB] 2024-09-10T15:22:25.546 INFO:teuthology.orchestra.run.smithi159.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-10T15:22:25.547 INFO:teuthology.orchestra.run.smithi099.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-304-g7162ca8a-1jammy [8,625 kB] 2024-09-10T15:22:25.691 INFO:teuthology.orchestra.run.smithi099.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-304-g7162ca8a-1jammy [14.2 kB] 2024-09-10T15:22:25.691 INFO:teuthology.orchestra.run.smithi099.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-304-g7162ca8a-1jammy [51.4 MB] 2024-09-10T15:22:26.108 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 181 MB in 4s (42.7 MB/s) 2024-09-10T15:22:26.270 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T15:22:26.367 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T15:22:26.373 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T15:22:26.452 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T15:22:26.789 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T15:22:26.793 INFO:teuthology.orchestra.run.smithi099.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-304-g7162ca8a-1jammy [130 kB] 2024-09-10T15:22:26.796 INFO:teuthology.orchestra.run.smithi099.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-304-g7162ca8a-1jammy [39.0 kB] 2024-09-10T15:22:26.797 INFO:teuthology.orchestra.run.smithi099.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-304-g7162ca8a-1jammy [13.6 MB] 2024-09-10T15:22:26.814 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T15:22:26.855 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T15:22:26.989 INFO:teuthology.orchestra.run.smithi099.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-tejas-testing-2024-09-09-1611-squid/7162ca8a22368558b9ec845c47e93c7afc45e8c3/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-304-g7162ca8a-1jammy [91.5 kB] 2024-09-10T15:22:27.183 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T15:22:27.209 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T15:22:27.250 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T15:22:27.548 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 181 MB in 5s (32.9 MB/s) 2024-09-10T15:22:27.620 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T15:22:27.647 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T15:22:27.678 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T15:22:27.694 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:22:27.776 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T15:22:27.782 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T15:22:27.860 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T15:22:28.090 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T15:22:28.116 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T15:22:28.156 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:22:28.172 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T15:22:28.198 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T15:22:28.238 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T15:22:28.485 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T15:22:28.511 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T15:22:28.551 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:22:28.567 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T15:22:28.593 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T15:22:28.633 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T15:22:28.846 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T15:22:28.872 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T15:22:28.904 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T15:22:29.012 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T15:22:29.038 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T15:22:29.078 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:22:29.215 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librados2. 2024-09-10T15:22:29.241 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:29.282 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:29.482 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T15:22:29.508 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T15:22:29.548 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:22:29.735 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librbd1. 2024-09-10T15:22:29.761 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:29.801 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:29.885 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T15:22:29.911 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T15:22:29.968 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:22:30.221 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T15:22:30.247 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:30.271 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T15:22:30.279 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:30.297 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T15:22:30.330 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T15:22:30.640 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rados. 2024-09-10T15:22:30.641 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librados2. 2024-09-10T15:22:30.667 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:30.668 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-librados2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:30.698 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:30.708 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:31.001 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T15:22:31.028 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:31.068 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:31.152 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librbd1. 2024-09-10T15:22:31.179 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-librbd1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:31.219 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:31.337 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T15:22:31.352 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:31.395 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:31.622 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T15:22:31.648 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:31.680 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:31.706 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T15:22:31.733 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:31.773 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:31.933 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2024-09-10T15:22:31.948 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-python3-rados_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:31.991 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:32.109 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T15:22:32.136 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T15:22:32.176 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T15:22:32.311 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T15:22:32.337 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:32.377 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:32.471 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T15:22:32.497 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T15:22:32.537 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T15:22:32.630 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T15:22:32.657 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:32.697 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:32.756 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T15:22:32.772 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:32.815 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:32.983 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T15:22:33.009 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:33.041 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:33.168 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T15:22:33.194 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T15:22:33.234 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T15:22:33.361 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T15:22:33.388 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T15:22:33.428 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T15:22:33.512 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T15:22:33.538 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T15:22:33.578 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T15:22:33.747 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T15:22:33.773 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T15:22:33.814 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T15:22:33.881 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T15:22:33.896 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T15:22:33.932 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T15:22:34.094 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T15:22:34.120 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:34.160 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:34.243 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package lua5.1. 2024-09-10T15:22:34.269 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T15:22:34.309 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T15:22:34.621 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package lua-any. 2024-09-10T15:22:34.636 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T15:22:34.679 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T15:22:34.713 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T15:22:34.739 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T15:22:34.780 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T15:22:34.923 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package zip. 2024-09-10T15:22:34.939 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T15:22:34.973 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T15:22:35.049 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T15:22:35.075 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T15:22:35.116 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T15:22:35.235 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package unzip. 2024-09-10T15:22:35.261 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T15:22:35.293 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T15:22:35.369 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T15:22:35.384 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T15:22:35.427 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T15:22:35.672 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package luarocks. 2024-09-10T15:22:35.698 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T15:22:35.739 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T15:22:35.756 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua5.1. 2024-09-10T15:22:35.782 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T15:22:35.822 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T15:22:36.105 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librgw2. 2024-09-10T15:22:36.117 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-any. 2024-09-10T15:22:36.120 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:36.132 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-10T15:22:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:36.184 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T15:22:36.403 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package zip. 2024-09-10T15:22:36.429 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-10T15:22:36.470 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T15:22:36.640 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T15:22:36.655 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:36.699 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:36.781 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package unzip. 2024-09-10T15:22:36.807 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T15:22:36.848 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T15:22:37.044 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T15:22:37.070 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T15:22:37.110 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T15:22:37.261 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package luarocks. 2024-09-10T15:22:37.287 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T15:22:37.327 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T15:22:37.413 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T15:22:37.439 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:37.479 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:37.694 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2024-09-10T15:22:37.720 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-librgw2_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:37.752 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:37.850 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-common. 2024-09-10T15:22:37.876 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:37.916 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:38.363 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T15:22:38.378 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:38.421 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:38.766 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T15:22:38.792 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T15:22:38.832 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T15:22:39.144 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T15:22:39.170 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:39.210 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:39.288 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-base. 2024-09-10T15:22:39.315 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:39.364 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:39.647 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2024-09-10T15:22:39.673 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-ceph-common_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:39.855 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:40.097 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T15:22:40.124 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T15:22:40.293 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T15:22:40.596 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T15:22:40.622 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T15:22:40.662 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T15:22:40.974 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T15:22:40.999 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T15:22:41.040 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T15:22:41.286 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2024-09-10T15:22:41.292 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T15:22:41.308 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T15:22:41.312 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-ceph-base_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:41.351 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T15:22:41.362 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:41.679 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T15:22:41.708 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T15:22:41.737 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T15:22:41.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T15:22:41.967 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T15:22:42.015 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T15:22:42.023 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T15:22:42.050 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T15:22:42.090 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T15:22:42.310 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T15:22:42.337 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T15:22:42.377 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T15:22:42.393 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-portend. 2024-09-10T15:22:42.420 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T15:22:42.460 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T15:22:42.663 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T15:22:42.679 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T15:22:42.713 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T15:22:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T15:22:42.790 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T15:22:42.829 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T15:22:42.991 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T15:22:43.018 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T15:22:43.057 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T15:22:43.099 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T15:22:43.125 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T15:22:43.165 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T15:22:43.361 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T15:22:43.388 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T15:22:43.427 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T15:22:43.511 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T15:22:43.537 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T15:22:43.577 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T15:22:43.705 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T15:22:43.732 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T15:22:43.763 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T15:22:43.872 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T15:22:43.899 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T15:22:43.930 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T15:22:44.033 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-portend. 2024-09-10T15:22:44.060 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-10T15:22:44.100 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T15:22:44.200 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T15:22:44.226 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T15:22:44.266 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T15:22:44.403 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T15:22:44.430 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T15:22:44.469 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T15:22:44.578 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-mako. 2024-09-10T15:22:44.604 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T15:22:44.644 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T15:22:44.764 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T15:22:44.791 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T15:22:44.972 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T15:22:44.999 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T15:22:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T15:22:45.054 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T15:22:45.351 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T15:22:45.378 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T15:22:45.384 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T15:22:45.410 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T15:22:45.418 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T15:22:45.442 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T15:22:45.713 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T15:22:45.739 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T15:22:45.753 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-webob. 2024-09-10T15:22:45.779 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T15:22:45.780 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T15:22:45.820 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T15:22:46.057 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T15:22:46.084 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T15:22:46.115 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T15:22:46.156 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T15:22:46.183 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T15:22:46.226 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T15:22:46.418 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2024-09-10T15:22:46.445 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T15:22:46.485 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T15:22:46.534 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T15:22:46.560 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T15:22:46.600 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T15:22:46.822 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T15:22:46.848 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T15:22:46.887 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-paste. 2024-09-10T15:22:46.888 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T15:22:46.914 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T15:22:46.953 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T15:22:47.191 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T15:22:47.218 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T15:22:47.258 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T15:22:47.265 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T15:22:47.281 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T15:22:47.323 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T15:22:47.511 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2024-09-10T15:22:47.524 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T15:22:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T15:22:47.609 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T15:22:47.636 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T15:22:47.676 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T15:22:47.847 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T15:22:47.874 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T15:22:47.916 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T15:22:47.963 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T15:22:47.978 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T15:22:48.020 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T15:22:48.217 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T15:22:48.244 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T15:22:48.283 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T15:22:48.332 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T15:22:48.359 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T15:22:48.398 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T15:22:48.595 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2024-09-10T15:22:48.622 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T15:22:48.661 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T15:22:48.753 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T15:22:48.781 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T15:22:48.820 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T15:22:48.973 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T15:22:48.989 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T15:22:49.031 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T15:22:49.173 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-idna. 2024-09-10T15:22:49.200 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T15:22:49.239 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T15:22:49.343 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T15:22:49.370 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T15:22:49.409 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T15:22:49.551 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T15:22:49.577 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T15:22:49.609 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T15:22:49.729 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T15:22:49.756 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T15:22:49.796 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T15:22:49.912 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-requests. 2024-09-10T15:22:49.939 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T15:22:49.970 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T15:22:50.082 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T15:22:50.098 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T15:22:50.132 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T15:22:50.265 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T15:22:50.292 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T15:22:50.331 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T15:22:50.445 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T15:22:50.461 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T15:22:50.504 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T15:22:50.760 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T15:22:50.786 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:50.817 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:50.823 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-idna. 2024-09-10T15:22:50.850 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T15:22:50.890 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T15:22:51.202 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T15:22:51.214 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T15:22:51.228 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T15:22:51.241 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:51.268 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T15:22:51.281 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:51.550 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T15:22:51.566 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T15:22:51.596 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests. 2024-09-10T15:22:51.600 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T15:22:51.623 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T15:22:51.663 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T15:22:51.895 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T15:22:51.922 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T15:22:51.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T15:22:51.961 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T15:22:51.968 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T15:22:51.999 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T15:22:52.294 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T15:22:52.298 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T15:22:52.321 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:52.324 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:52.361 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:52.364 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:52.732 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T15:22:52.751 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T15:22:52.759 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:52.778 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:52.799 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:52.817 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:53.119 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T15:22:53.146 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T15:22:53.185 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T15:22:53.430 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T15:22:53.447 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T15:22:53.456 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:53.474 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T15:22:53.496 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:53.505 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T15:22:53.866 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T15:22:53.893 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:53.933 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:54.345 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T15:22:54.372 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:54.411 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:54.491 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph. 2024-09-10T15:22:54.506 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:54.549 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:55.661 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T15:22:55.688 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:55.727 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:55.958 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T15:22:56.106 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:56.106 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:56.330 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T15:22:56.358 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:56.397 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:56.792 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package cephadm. 2024-09-10T15:22:56.819 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:56.875 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:57.044 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2024-09-10T15:22:57.072 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-ceph_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:57.111 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:57.186 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T15:22:57.213 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T15:22:57.261 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T15:22:57.439 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T15:22:57.465 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:57.505 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:57.572 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T15:22:57.587 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T15:22:57.630 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T15:22:57.800 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T15:22:57.824 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:57.883 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:58.278 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2024-09-10T15:22:58.305 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-cephadm_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:22:58.345 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:58.576 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-babel. 2024-09-10T15:22:58.604 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T15:22:58.639 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T15:22:58.651 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T15:22:58.666 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T15:22:58.705 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T15:22:58.954 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T15:22:58.981 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T15:22:59.008 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T15:22:59.021 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T15:22:59.024 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T15:22:59.066 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T15:22:59.357 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T15:22:59.384 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:22:59.424 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:22:59.752 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T15:22:59.779 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T15:22:59.818 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T15:23:00.122 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-routes. 2024-09-10T15:23:00.122 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-babel. 2024-09-10T15:23:00.137 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T15:23:00.149 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T15:23:00.180 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T15:23:00.188 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T15:23:00.508 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T15:23:00.516 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T15:23:00.536 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:00.543 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T15:23:00.574 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:00.583 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T15:23:00.945 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T15:23:00.972 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:01.011 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:01.348 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T15:23:01.375 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T15:23:01.414 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T15:23:01.751 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2024-09-10T15:23:01.778 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T15:23:01.817 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T15:23:01.840 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T15:23:01.868 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T15:23:01.907 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T15:23:02.162 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T15:23:02.189 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:02.229 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:02.377 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T15:23:02.404 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T15:23:02.443 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T15:23:02.814 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T15:23:02.842 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T15:23:02.872 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T15:23:03.149 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T15:23:03.177 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T15:23:03.216 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T15:23:03.467 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T15:23:03.483 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T15:23:03.517 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T15:23:03.900 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T15:23:03.927 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:03.979 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T15:23:03.995 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T15:23:04.029 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T15:23:04.043 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:04.383 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T15:23:04.410 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T15:23:04.449 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T15:23:04.744 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T15:23:04.759 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T15:23:04.794 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T15:23:05.022 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T15:23:05.049 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T15:23:05.089 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T15:23:05.366 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T15:23:05.393 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T15:23:05.411 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T15:23:05.426 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:05.433 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T15:23:05.738 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:05.744 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T15:23:05.772 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T15:23:05.802 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T15:23:06.123 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T15:23:06.150 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T15:23:06.189 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T15:23:06.667 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T15:23:06.682 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T15:23:06.684 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T15:23:06.712 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T15:23:06.716 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T15:23:06.751 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T15:23:07.020 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T15:23:07.047 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T15:23:07.071 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T15:23:07.088 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T15:23:07.098 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T15:23:07.137 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T15:23:07.406 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T15:23:07.415 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T15:23:07.433 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T15:23:07.442 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T15:23:07.473 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T15:23:07.473 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T15:23:07.777 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T15:23:07.785 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T15:23:07.804 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T15:23:07.811 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-10T15:23:07.843 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T15:23:07.851 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T15:23:08.130 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T15:23:08.157 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T15:23:08.188 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T15:23:08.475 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T15:23:08.499 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T15:23:08.501 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T15:23:08.527 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:08.541 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T15:23:08.565 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:08.853 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T15:23:08.880 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T15:23:08.893 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T15:23:08.919 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T15:23:08.921 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T15:23:08.960 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T15:23:09.239 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T15:23:09.254 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T15:23:09.266 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T15:23:09.282 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T15:23:09.305 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T15:23:09.312 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T15:23:09.566 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package jq. 2024-09-10T15:23:09.593 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T15:23:09.632 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T15:23:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package socat. 2024-09-10T15:23:09.901 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T15:23:09.943 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T15:23:09.978 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T15:23:09.994 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:10.036 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:10.221 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T15:23:10.237 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T15:23:10.279 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T15:23:10.297 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T15:23:10.313 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T15:23:10.347 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T15:23:10.642 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-test. 2024-09-10T15:23:10.670 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:10.693 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T15:23:10.708 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:10.720 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T15:23:10.759 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T15:23:11.038 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2024-09-10T15:23:11.065 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T15:23:11.104 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T15:23:11.348 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2024-09-10T15:23:11.376 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T15:23:11.415 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T15:23:11.712 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T15:23:11.739 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T15:23:11.778 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T15:23:12.108 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2024-09-10T15:23:12.124 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-ceph-test_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:12.157 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:13.063 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T15:23:13.091 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:13.129 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:13.428 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T15:23:13.453 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:13.492 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:13.795 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T15:23:13.823 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T15:23:13.861 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T15:23:14.174 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T15:23:14.202 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T15:23:14.241 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T15:23:14.412 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T15:23:14.440 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-304-g7162ca8a-1jammy_all.deb ... 2024-09-10T15:23:14.479 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:14.569 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T15:23:14.597 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T15:23:14.628 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T15:23:14.774 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T15:23:14.790 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:14.824 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:15.000 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package pkg-config. 2024-09-10T15:23:15.027 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T15:23:15.069 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T15:23:15.085 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T15:23:15.098 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T15:23:15.126 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T15:23:15.336 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T15:23:15.363 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T15:23:15.402 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T15:23:15.440 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T15:23:15.467 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T15:23:15.506 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T15:23:15.814 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T15:23:15.841 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T15:23:15.869 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T15:23:15.889 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T15:23:15.896 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T15:23:15.935 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T15:23:16.325 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T15:23:16.353 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T15:23:16.391 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T15:23:16.712 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T15:23:16.739 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T15:23:16.765 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pkg-config. 2024-09-10T15:23:16.778 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T15:23:16.793 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T15:23:16.832 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T15:23:17.051 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T15:23:17.067 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T15:23:17.101 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T15:23:17.298 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T15:23:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T15:23:17.364 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T15:23:17.488 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T15:23:17.504 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T15:23:17.538 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T15:23:17.684 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-py. 2024-09-10T15:23:17.711 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T15:23:17.750 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T15:23:17.849 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T15:23:17.876 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T15:23:17.915 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T15:23:18.070 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T15:23:18.098 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T15:23:18.137 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T15:23:18.236 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T15:23:18.263 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T15:23:18.302 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T15:23:18.583 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T15:23:18.588 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T15:23:18.610 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T15:23:18.616 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T15:23:18.646 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T15:23:18.649 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T15:23:18.910 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-toml. 2024-09-10T15:23:18.926 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T15:23:18.960 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T15:23:18.983 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2024-09-10T15:23:19.010 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-10T15:23:19.050 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T15:23:19.246 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T15:23:19.274 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T15:23:19.313 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T15:23:19.345 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T15:23:19.372 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T15:23:19.403 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T15:23:19.650 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T15:23:19.677 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T15:23:19.716 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T15:23:19.807 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T15:23:19.823 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T15:23:19.857 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T15:23:19.994 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T15:23:20.021 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T15:23:20.052 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T15:23:20.159 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-toml. 2024-09-10T15:23:20.187 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-10T15:23:20.226 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T15:23:20.537 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T15:23:20.565 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T15:23:20.604 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T15:23:20.773 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package radosgw. 2024-09-10T15:23:20.801 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:20.839 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:20.924 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T15:23:20.952 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T15:23:20.990 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T15:23:21.260 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T15:23:21.275 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T15:23:21.318 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T15:23:21.634 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T15:23:21.658 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:21.700 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:21.988 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T15:23:22.181 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2024-09-10T15:23:22.208 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../116-radosgw_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:22.247 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:22.247 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T15:23:22.373 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T15:23:22.642 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T15:23:22.983 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T15:23:23.050 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T15:23:23.066 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-304-g7162ca8a-1jammy_amd64.deb ... 2024-09-10T15:23:23.108 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:23.405 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T15:23:23.410 INFO:teuthology.orchestra.run.smithi159.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T15:23:23.483 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:23.647 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T15:23:23.773 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T15:23:24.016 INFO:teuthology.orchestra.run.smithi159.stdout:Adding system user cephadm....done 2024-09-10T15:23:24.036 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T15:23:24.189 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T15:23:24.391 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T15:23:24.466 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T15:23:24.717 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T15:23:24.831 INFO:teuthology.orchestra.run.smithi099.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T15:23:24.843 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T15:23:24.900 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:25.102 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T15:23:25.354 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T15:23:25.408 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2024-09-10T15:23:25.480 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T15:23:25.564 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T15:23:25.773 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T15:23:25.840 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T15:23:26.092 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T15:23:26.133 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T15:23:26.218 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T15:23:26.401 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T15:23:26.486 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T15:23:26.677 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T15:23:26.738 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T15:23:26.863 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T15:23:26.979 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T15:23:27.173 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T15:23:27.480 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T15:23:27.525 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T15:23:27.756 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T15:23:27.776 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T15:23:28.045 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T15:23:28.132 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:28.321 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T15:23:28.392 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T15:23:28.518 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T15:23:28.572 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T15:23:28.644 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T15:23:28.770 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T15:23:28.840 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T15:23:29.021 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T15:23:29.099 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:29.359 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T15:23:29.485 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T15:23:29.576 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T15:23:29.594 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T15:23:29.610 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T15:23:29.674 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T15:23:29.720 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T15:23:29.800 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T15:23:29.980 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T15:23:30.160 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T15:23:30.285 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T15:23:30.408 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T15:23:30.461 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T15:23:30.525 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T15:23:30.545 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T15:23:30.651 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T15:23:30.804 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T15:23:31.002 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T15:23:31.097 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T15:23:31.120 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T15:23:31.223 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T15:23:31.379 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T15:23:31.647 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T15:23:31.892 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T15:23:32.143 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T15:23:32.265 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T15:23:32.269 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T15:23:32.391 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T15:23:32.395 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T15:23:32.696 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T15:23:33.069 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T15:23:33.098 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T15:23:33.311 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T15:23:33.349 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T15:23:33.437 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T15:23:33.563 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T15:23:33.717 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T15:23:33.856 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T15:23:34.010 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T15:23:34.257 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T15:23:34.353 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T15:23:34.500 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T15:23:34.604 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T15:23:34.730 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:34.852 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T15:23:35.040 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T15:23:35.137 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T15:23:35.357 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T15:23:35.480 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T15:23:35.730 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T15:23:35.857 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:36.176 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T15:23:36.476 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T15:23:36.521 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T15:23:36.773 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:23:36.907 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T15:23:37.175 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T15:23:37.301 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T15:23:37.427 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T15:23:37.657 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T15:23:37.720 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T15:23:37.900 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:23:37.979 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T15:23:38.018 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T15:23:38.231 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:23:38.302 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T15:23:38.357 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T15:23:38.428 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T15:23:38.554 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T15:23:38.650 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T15:23:38.856 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T15:23:38.884 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T15:23:39.124 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T15:23:39.160 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T15:23:39.375 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:23:39.420 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T15:23:39.484 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T15:23:39.662 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T15:23:39.761 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T15:23:39.930 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T15:23:40.012 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T15:23:40.056 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T15:23:40.271 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T15:23:40.341 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T15:23:40.467 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T15:23:40.531 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T15:23:40.760 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T15:23:40.782 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T15:23:41.058 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T15:23:41.061 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T15:23:41.159 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T15:23:41.312 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T15:23:41.421 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T15:23:41.427 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T15:23:41.539 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T15:23:41.553 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T15:23:41.653 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T15:23:41.863 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T15:23:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T15:23:42.008 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T15:23:42.181 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T15:23:42.385 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T15:23:42.440 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T15:23:42.566 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T15:23:42.675 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T15:23:42.692 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T15:23:42.764 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T15:23:42.985 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T15:23:43.029 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T15:23:43.112 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T15:23:43.280 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:23:43.406 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T15:23:43.505 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T15:23:43.724 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T15:23:43.773 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T15:23:43.899 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T15:23:44.033 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T15:23:44.150 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T15:23:44.276 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T15:23:44.292 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T15:23:44.418 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T15:23:44.585 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T15:23:44.694 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T15:23:44.887 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T15:23:44.962 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T15:23:45.171 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T15:23:45.297 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T15:23:45.324 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T15:23:45.565 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T15:23:45.701 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T15:23:45.833 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T15:23:45.986 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T15:23:46.170 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T15:23:46.313 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T15:23:46.439 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:46.546 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T15:23:46.557 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:46.658 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T15:23:46.831 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T15:23:46.994 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.121 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.167 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T15:23:47.246 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T15:23:47.293 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.420 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsqlite3-mod-ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.533 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.554 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T15:23:47.659 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.785 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.890 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:47.999 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T15:23:47.999 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T15:23:48.000 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.109 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T15:23:48.378 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.495 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.504 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.621 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.630 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.747 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:48.860 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T15:23:48.860 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T15:23:48.873 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T15:23:49.364 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:49.490 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:49.616 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:49.743 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T15:23:50.102 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:50.228 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:50.337 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:50.438 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:50.564 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:50.913 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:51.047 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:51.149 INFO:teuthology.orchestra.run.smithi159.stdout:Adding group ceph....done 2024-09-10T15:23:51.173 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:51.299 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:51.426 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:51.525 INFO:teuthology.orchestra.run.smithi159.stdout:Adding system user ceph....done 2024-09-10T15:23:51.703 INFO:teuthology.orchestra.run.smithi159.stdout:Setting system user ceph properties....done 2024-09-10T15:23:51.721 INFO:teuthology.orchestra.run.smithi159.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T15:23:51.858 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T15:23:51.977 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2024-09-10T15:23:52.133 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T15:23:52.329 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2024-09-10T15:23:52.472 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2024-09-10T15:23:52.492 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T15:23:52.624 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:52.626 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T15:23:52.758 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:52.949 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T15:23:53.236 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T15:23:53.236 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T15:23:53.411 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:53.537 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:53.702 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:54.000 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T15:23:54.000 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T15:23:54.057 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T15:23:54.455 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:54.512 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:54.734 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T15:23:54.734 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T15:23:54.809 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T15:23:55.239 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:55.274 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:55.454 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T15:23:55.454 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T15:23:55.505 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T15:23:55.505 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T15:23:55.932 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:55.934 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:56.149 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T15:23:56.149 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T15:23:56.174 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T15:23:56.175 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T15:23:56.619 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:56.659 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:56.785 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:56.897 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T15:23:56.897 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T15:23:56.936 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:57.150 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T15:23:57.150 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T15:23:57.404 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:57.530 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:57.629 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:57.681 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:57.780 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:57.906 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:58.049 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:58.074 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T15:23:58.075 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T15:23:58.402 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T15:23:58.511 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T15:23:58.550 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:58.655 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T15:23:58.701 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:58.828 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:58.979 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-volume (19.1.1-304-g7162ca8a-1jammy) ... 2024-09-10T15:23:59.332 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T15:23:59.433 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T15:23:59.585 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T15:23:59.740 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T15:24:00.408 INFO:teuthology.orchestra.run.smithi159.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T15:24:00.415 DEBUG:teuthology.parallel:result is None 2024-09-10T15:24:00.705 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T15:24:01.375 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T15:24:01.381 DEBUG:teuthology.parallel:result is None 2024-09-10T15:24:01.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:24:01.528 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2024-09-10T15:24:01.546 INFO:teuthology.orchestra.run.smithi099.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:24:01.546 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:24:01.546 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-10T15:24:01.548 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:24:01.690 DEBUG:teuthology.orchestra.run.smithi159:> dpkg-query -W -f '${Version}' ceph 2024-09-10T15:24:01.709 INFO:teuthology.orchestra.run.smithi159.stdout:19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:24:01.710 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-304-g7162ca8a-1jammy 2024-09-10T15:24:01.710 INFO:teuthology.task.install:The correct ceph version 19.1.1-304-g7162ca8a-1jammy is installed. 2024-09-10T15:24:01.711 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T15:24:01.712 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:01.712 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T15:24:01.727 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:01.727 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T15:24:01.766 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T15:24:01.766 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:01.766 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T15:24:01.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T15:24:01.841 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:01.841 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T15:24:01.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T15:24:01.908 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T15:24:01.909 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:01.909 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T15:24:01.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T15:24:01.977 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:01.977 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T15:24:01.990 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T15:24:02.048 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T15:24:02.048 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:02.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T15:24:02.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T15:24:02.117 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:02.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T15:24:02.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T15:24:02.184 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T15:24:02.263 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T15:24:02.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-09-10T15:24:02.265 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2024-09-10T15:24:02.278 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T15:24:02.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T15:24:02.319 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T15:24:02.331 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T15:24:02.332 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T15:24:02.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T15:24:02.397 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T15:24:02.397 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-10T15:24:02.397 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133', 'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}', 'email': 'tchandra@redhat.com', 'first_in_suite': False, 'job_id': '7899133', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'owner': 'scheduled_tchandra@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 1683, 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7162ca8a22368558b9ec845c47e93c7afc45e8c3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3', 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPJTNCC0CQuVbPcbDmzcQO1glZiGYqAaZ4STX/PyLttl5gqrq1j9vk8ADxTs7mssyUeSIjd9CHNxlV6bclVl8xQ=', 'smithi159.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfsKntELVWNwONVPS/7djXVoioHYgX9jaszZK0AZGaDaM6ohZiOdt5VL/WmPH46kGBh9KpGhWS75kVVtnP3Res='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_multipart_upload.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_07:44:33', 'tube': 'smithi', 'user': 'tchandra', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T15:24:02.398 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T15:24:02.431 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T15:24:02.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T15:24:02.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T15:24:02.492 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:02.492 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T15:24:02.538 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T15:24:02.538 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-09-10T15:24:02.586 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T15:24:02.586 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:02.586 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-10T15:24:02.587 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:02.587 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 15:18:41.088642712 +0000 2024-09-10T15:24:02.587 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 15:18:40.844644891 +0000 2024-09-10T15:24:02.587 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 15:18:40.844644891 +0000 2024-09-10T15:24:02.587 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-10T15:24:02.587 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T15:24:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T15:24:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T15:24:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000453943 s, 1.1 MB/s 2024-09-10T15:24:02.642 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T15:24:02.691 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-09-10T15:24:02.738 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 15:18:41.580638318 +0000 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 15:18:41.324640604 +0000 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 15:18:41.324640604 +0000 2024-09-10T15:24:02.739 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-10T15:24:02.739 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T15:24:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T15:24:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T15:24:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000355167 s, 1.4 MB/s 2024-09-10T15:24:02.794 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T15:24:02.844 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-09-10T15:24:02.890 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 15:18:42.088633779 +0000 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 15:18:41.824636138 +0000 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 15:18:41.824636138 +0000 2024-09-10T15:24:02.891 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-10T15:24:02.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T15:24:02.944 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T15:24:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T15:24:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000439012 s, 1.2 MB/s 2024-09-10T15:24:02.946 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T15:24:02.995 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-09-10 15:18:42.588629314 +0000 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-09-10 15:18:42.312631780 +0000 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-09-10 15:18:42.312631780 +0000 2024-09-10T15:24:03.042 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-09-10T15:24:03.043 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T15:24:03.096 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-09-10T15:24:03.096 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-09-10T15:24:03.096 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000288751 s, 1.8 MB/s 2024-09-10T15:24:03.097 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T15:24:03.145 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:03.145 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:03.145 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T15:24:03.151 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T15:24:03.151 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 15:18:38.580659388 +0000 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 15:18:38.308661818 +0000 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 15:18:38.308661818 +0000 2024-09-10T15:24:03.198 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2024-09-10T15:24:03.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T15:24:03.251 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T15:24:03.251 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T15:24:03.251 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000344497 s, 1.5 MB/s 2024-09-10T15:24:03.253 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T15:24:03.303 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 15:18:39.016655493 +0000 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 15:18:38.800657423 +0000 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 15:18:38.800657423 +0000 2024-09-10T15:24:03.349 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2024-09-10T15:24:03.350 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T15:24:03.403 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T15:24:03.404 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T15:24:03.404 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000434472 s, 1.2 MB/s 2024-09-10T15:24:03.405 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T15:24:03.454 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-09-10T15:24:03.501 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T15:24:03.501 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:03.501 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-09-10T15:24:03.501 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:03.501 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 15:18:39.504651135 +0000 2024-09-10T15:24:03.501 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 15:18:39.260653314 +0000 2024-09-10T15:24:03.502 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 15:18:39.260653314 +0000 2024-09-10T15:24:03.502 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2024-09-10T15:24:03.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T15:24:03.555 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T15:24:03.555 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T15:24:03.555 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000369239 s, 1.4 MB/s 2024-09-10T15:24:03.556 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T15:24:03.606 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-09-10 15:18:40.000646705 +0000 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-09-10 15:18:39.736649063 +0000 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-09-10 15:18:39.736649063 +0000 2024-09-10T15:24:03.654 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2024-09-10T15:24:03.654 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T15:24:03.707 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-09-10T15:24:03.708 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-09-10T15:24:03.708 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000397364 s, 1.3 MB/s 2024-09-10T15:24:03.709 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T15:24:03.758 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:03.758 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T15:24:03.758 INFO:tasks.ceph:Generating config... 2024-09-10T15:24:03.760 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-10T15:24:03.760 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T15:24:03.760 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T15:24:03.760 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T15:24:03.760 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T15:24:03.760 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T15:24:03.760 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-10T15:24:03.760 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-10T15:24:03.760 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-10T15:24:03.760 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T15:24:03.761 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-10T15:24:03.762 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T15:24:03.762 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-10T15:24:03.762 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T15:24:03.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T15:24:03.797 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T15:24:03.811 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T15:24:03.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T15:24:03.945 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.c', '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]'), ('mon.b', '172.21.15.159')] 2024-09-10T15:24:03.945 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.159'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-10T15:24:03.946 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:03.946 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T15:24:03.992 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --addv c '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]' --add b 172.21.15.159 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:04.076 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:04.076 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid 4e8f2598-e62a-4186-9762-b22671b00e14 2024-09-10T15:24:04.076 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-09-10T15:24:04.076 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:fsid 4e8f2598-e62a-4186-9762-b22671b00e14 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-09-10T15:24:04.077291+0000 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-10T15:24:04.077291+0000 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.b 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-09-10T15:24:04.077 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-10T15:24:04.078 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T15:24:04.126 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4e8f2598-e62a-4186-9762-b22671b00e14... 2024-09-10T15:24:04.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T15:24:04.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T15:24:04.199 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-09-10T15:24:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-09-10T15:24:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T15:24:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-09-10T15:24:04.199 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.200 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T15:24:04.201 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.159" 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = 4e8f2598-e62a-4186-9762-b22671b00e14 2024-09-10T15:24:04.202 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-09-10T15:24:04.203 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-09-10T15:24:04.204 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-09-10T15:24:04.205 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: osd blocked scrub grace period = 3600 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: osd max markdown count = 1000 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: osd shutdown pgref assert = True 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-10T15:24:04.206 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-09-10T15:24:04.207 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-09-10T15:24:04.208 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = true 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout: rgw relaxed s3 bucket names = True 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-09-10T15:24:04.209 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2024-09-10T15:24:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T15:24:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2024-09-10T15:24:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.159" 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 4e8f2598-e62a-4186-9762-b22671b00e14 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2024-09-10T15:24:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd mclock profile = high_recovery_ops 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug trim objects = true 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2024-09-10T15:24:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2024-09-10T15:24:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: bdev async discard = True 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: bdev enable discard = True 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore allocator = bitmap 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 1/20 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 1/20 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 4/10 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T15:24:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: osd blocked scrub grace period = 3600 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: osd max markdown count = 1000 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: osd shutdown pgref assert = True 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2024-09-10T15:24:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2024-09-10T15:24:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: # 1m isn't quite enough 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: mon_down_mkfs_grace = 2m 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_filestore_osds = false 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-09-10T15:24:04.219 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: rgw relaxed s3 bucket names = True 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2024-09-10T15:24:04.220 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2024-09-10T15:24:04.221 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T15:24:04.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T15:24:04.309 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T15:24:04.310 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:04.310 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T15:24:04.315 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:04.315 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T15:24:04.362 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:24:04.362 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:04.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T15:24:04.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T15:24:04.424 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:04.425 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:04.470 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:24:04.470 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:04.470 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T15:24:04.470 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T15:24:04.493 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:04.493 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:04.541 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T15:24:04.541 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T15:24:04.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T15:24:04.585 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-10T15:24:04.588 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T15:24:04.631 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T15:24:04.648 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T15:24:04.648 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T15:24:04.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T15:24:04.683 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T15:24:04.693 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-10T15:24:04.727 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-10T15:24:04.736 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T15:24:04.737 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-10T15:24:04.737 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T15:24:04.752 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:04.752 INFO:tasks.ceph:role: osd.0 2024-09-10T15:24:04.753 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:24:04.753 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T15:24:04.813 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:04.814 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:05.273 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T15:24:05.275 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T15:24:05.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T15:24:05.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T15:24:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:05.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:05.383 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T15:24:05.439 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:05.439 INFO:tasks.ceph:role: osd.1 2024-09-10T15:24:05.439 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:24:05.439 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:05.504 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:05.505 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:05.505 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:05.965 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T15:24:05.968 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T15:24:05.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T15:24:06.120 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T15:24:06.131 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:06.132 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:06.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T15:24:06.185 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:06.186 INFO:tasks.ceph:role: osd.2 2024-09-10T15:24:06.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:24:06.186 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T15:24:06.250 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:06.250 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:06.250 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:06.251 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:06.694 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T15:24:06.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T15:24:06.697 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T15:24:06.830 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T15:24:06.842 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:06.843 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:06.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T15:24:06.898 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:06.898 INFO:tasks.ceph:role: osd.3 2024-09-10T15:24:06.898 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:24:06.898 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:06.962 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:06.963 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:06.963 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:07.394 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-09-10T15:24:07.395 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-09-10T15:24:07.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-10T15:24:07.471 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T15:24:07.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:07.523 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:07.524 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:07.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:07.637+0000 7f82c70147c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T15:24:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:07.641+0000 7f82c70147c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T15:24:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:07.641+0000 7f82c70147c0 -1 bdev(0x55f49db7f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:07.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:07.641+0000 7f82c70147c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T15:24:10.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T15:24:10.820 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:10.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:10.897+0000 7fc3481d37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T15:24:10.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:10.897+0000 7fc3481d37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T15:24:10.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:10.897+0000 7fc3481d37c0 -1 bdev(0x55a52fca3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:10.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:10.897+0000 7fc3481d37c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T15:24:14.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T15:24:14.090 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:14.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:14.169+0000 7fc835dc57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T15:24:14.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:14.173+0000 7fc835dc57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T15:24:14.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:14.173+0000 7fc835dc57c0 -1 bdev(0x55d41e495800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:14.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:14.173+0000 7fc835dc57c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T15:24:17.335 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T15:24:17.391 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:17.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:17.473+0000 7fa0365527c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T15:24:17.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:17.473+0000 7fa0365527c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T15:24:17.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:17.473+0000 7fa0365527c0 -1 bdev(0x562530e2f800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:17.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-09-10T15:24:17.473+0000 7fa0365527c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T15:24:20.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T15:24:20.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T15:24:20.682 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:20.682 INFO:tasks.ceph:role: osd.4 2024-09-10T15:24:20.683 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:24:20.683 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:20.745 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:20.746 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:21.200 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-09-10T15:24:21.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-09-10T15:24:21.202 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-10T15:24:21.296 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T15:24:21.305 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:21.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:21.306 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T15:24:21.361 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:21.362 INFO:tasks.ceph:role: osd.5 2024-09-10T15:24:21.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:24:21.362 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T15:24:21.428 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:21.428 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:21.428 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:21.428 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:21.428 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:21.429 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:21.429 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:21.429 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:21.429 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:21.429 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:21.904 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-09-10T15:24:21.906 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-09-10T15:24:21.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-10T15:24:22.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T15:24:22.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:22.075 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:22.075 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-10T15:24:22.127 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:22.128 INFO:tasks.ceph:role: osd.6 2024-09-10T15:24:22.128 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:24:22.128 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:22.191 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:22.672 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-09-10T15:24:22.674 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-09-10T15:24:22.674 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-10T15:24:22.819 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-10T15:24:22.830 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:22.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:22.831 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-10T15:24:22.885 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-10T15:24:22.885 INFO:tasks.ceph:role: osd.7 2024-09-10T15:24:22.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:24:22.885 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-10T15:24:22.948 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T15:24:22.948 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T15:24:22.948 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T15:24:22.949 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T15:24:23.376 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-09-10T15:24:23.378 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-09-10T15:24:23.378 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-10T15:24:23.468 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-10T15:24:23.477 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T15:24:23.477 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:24:23.478 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:23.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:23.582+0000 7f75157027c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T15:24:23.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:23.586+0000 7f75157027c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T15:24:23.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:23.586+0000 7f75157027c0 -1 bdev(0x55af57b3f800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:23.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:23.586+0000 7f75157027c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T15:24:26.753 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T15:24:26.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:26.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:26.842+0000 7fd6daf0d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T15:24:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:26.842+0000 7fd6daf0d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T15:24:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:26.842+0000 7fd6daf0d7c0 -1 bdev(0x5591e6289800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:26.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:26.842+0000 7fd6daf0d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T15:24:29.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T15:24:30.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:30.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:30.122+0000 7f42d81b97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-10T15:24:30.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:30.122+0000 7f42d81b97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-10T15:24:30.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:30.122+0000 7f42d81b97c0 -1 bdev(0x560bfc2d5800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:30.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:30.122+0000 7f42d81b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-10T15:24:33.324 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-10T15:24:33.381 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:33.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:33.458+0000 7fa9aedcf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-10T15:24:33.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:33.458+0000 7fa9aedcf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-10T15:24:33.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:33.458+0000 7fa9aedcf7c0 -1 bdev(0x5607092df800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-10T15:24:33.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-09-10T15:24:33.458+0000 7fa9aedcf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-10T15:24:36.627 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-10T15:24:36.681 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T15:24:36.681 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:36.682 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-10T15:24:36.695 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:36.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T15:24:36.748 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:36.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T15:24:36.800 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:36.800 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T15:24:36.854 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:36.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T15:24:36.909 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:36.910 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T15:24:36.923 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:36.923 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T15:24:36.976 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:36.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T15:24:37.032 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:37.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-10T15:24:37.088 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:37.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-10T15:24:37.144 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:37.144 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T15:24:37.150 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:37.150 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-10T15:24:37.192 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T15:24:37.192 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T15:24:37.195 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T15:24:37.238 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCUZOBmk8j6IhAAwSpwzmsUCk24FUhX2XiruQ== 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCXZOBmVJAlJhAAGLFmR9oWSe3lBKeJauET3Q== 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCaZOBmeqWwNRAAq78P1OUQA0e4ujHNoqHLJQ== 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCeZOBm9TxtChAA77YuvB+LCRpiMcPjeLFtUg== 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQChZOBm7iBaHBAAsTnG3TJgf6oQc/ogT4plgw== 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCUZOBmBdOuJRAAZq2sCxTBbRTjnFdtmZX08w== 2024-09-10T15:24:37.239 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCnZOBmhaAUIxAAC0699MTQ86tgeW0wHRF9gg== 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCqZOBmSaeIMhAAEtC08092YJuiw9y4ZkfTqg== 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCuZOBmz/SfBxAAiAixArfGIIJ7L95CCQyv7g== 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCxZOBmE5WqGxAAhH9W3I2zAXb5I1kpSJ763w== 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCUZOBmyEnGKBAABPJOIcX4BhuFrpqRJNz2cg== 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-09-10T15:24:37.240 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQCUZOBmrqZmKxAAkrjZyKpdvF4SeEFXSaxhTg== 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCUZOBmk8j6IhAAwSpwzmsUCk24FUhX2XiruQ== 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCXZOBmVJAlJhAAGLFmR9oWSe3lBKeJauET3Q== 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCaZOBmeqWwNRAAq78P1OUQA0e4ujHNoqHLJQ== 2024-09-10T15:24:37.247 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCeZOBm9TxtChAA77YuvB+LCRpiMcPjeLFtUg== 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQChZOBm7iBaHBAAsTnG3TJgf6oQc/ogT4plgw== 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCUZOBmBdOuJRAAZq2sCxTBbRTjnFdtmZX08w== 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCnZOBmhaAUIxAAC0699MTQ86tgeW0wHRF9gg== 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCqZOBmSaeIMhAAEtC08092YJuiw9y4ZkfTqg== 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCuZOBmz/SfBxAAiAixArfGIIJ7L95CCQyv7g== 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2024-09-10T15:24:37.248 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCxZOBmE5WqGxAAhH9W3I2zAXb5I1kpSJ763w== 2024-09-10T15:24:37.249 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-09-10T15:24:37.249 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCUZOBmyEnGKBAABPJOIcX4BhuFrpqRJNz2cg== 2024-09-10T15:24:37.250 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2024-09-10T15:24:37.250 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCUZOBmrqZmKxAAkrjZyKpdvF4SeEFXSaxhTg== 2024-09-10T15:24:37.251 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T15:24:37.287 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T15:24:37.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.339 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.420 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.422 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.510 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.592 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.595 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.675 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T15:24:37.678 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T15:24:37.758 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.840 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:37.939 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:38.011 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:38.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T15:24:38.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T15:24:38.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T15:24:38.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T15:24:38.181 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T15:24:38.260 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T15:24:38.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T15:24:38.272 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T15:24:38.358 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T15:24:38.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T15:24:38.423 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T15:24:38.516 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T15:24:38.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T15:24:38.541 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T15:24:38.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T15:24:38.646 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:38.648 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T15:24:38.692 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T15:24:38.692 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T15:24:38.692 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T15:24:38.695 INFO:tasks.ceph.mon.a:Started 2024-09-10T15:24:38.695 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T15:24:38.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T15:24:38.697 INFO:tasks.ceph.mon.c:Started 2024-09-10T15:24:38.697 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T15:24:38.697 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T15:24:38.737 INFO:tasks.ceph.mon.b:Started 2024-09-10T15:24:38.738 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T15:24:38.738 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-10T15:24:38.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-10T15:24:38.740 INFO:tasks.ceph.mgr.y:Started 2024-09-10T15:24:38.741 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T15:24:38.741 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T15:24:38.743 INFO:tasks.ceph.mgr.x:Started 2024-09-10T15:24:38.743 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T15:24:38.744 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T15:24:44.319 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-09-10T15:24:44.338 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T15:24:44.339 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T15:24:44.339 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:44.339 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T15:24:44.350 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:44.350 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T15:24:44.392 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:44.390+0000 7f612336b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T15:24:44.404 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:44.404 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T15:24:44.457 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:24:44.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T15:24:44.517 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:44.517 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T15:24:44.531 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:44.531 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T15:24:44.583 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:44.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-10T15:24:44.635 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-09-10T15:24:44.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-10T15:24:44.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 81adb850-6bce-4c6a-b91d-d1014dab2114 0 2024-09-10T15:24:44.892 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:44.886+0000 7f612336b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T15:24:44.949 INFO:teuthology.orchestra.run.smithi159.stdout:0 2024-09-10T15:24:44.967 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 266bd277-c43f-45f2-b407-939f7fe60124 1 2024-09-10T15:24:45.072 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:45.069+0000 7f0d48a24180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-10T15:24:45.107 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:45.102+0000 7f612336b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T15:24:45.177 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-09-10T15:24:45.194 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 8e25e2db-5b96-49e8-84c8-f2c1aec51ca2 2 2024-09-10T15:24:45.387 INFO:teuthology.orchestra.run.smithi159.stdout:2 2024-09-10T15:24:45.403 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 007bc137-a3a2-40a8-8133-e899cdc6b3d8 3 2024-09-10T15:24:45.597 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:45.597+0000 7f0d48a24180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-10T15:24:45.601 INFO:teuthology.orchestra.run.smithi159.stdout:3 2024-09-10T15:24:45.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 7883a376-330f-4123-9d53-b2d16009b55f 4 2024-09-10T15:24:45.682 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:45.678+0000 7f612336b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T15:24:45.738 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:45.734+0000 7f612336b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T15:24:45.780 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:45.777+0000 7f0d48a24180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-10T15:24:45.793 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:45.790+0000 7f612336b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T15:24:45.821 INFO:teuthology.orchestra.run.smithi159.stdout:4 2024-09-10T15:24:45.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8 5 2024-09-10T15:24:45.874 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:45.870+0000 7f612336b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T15:24:45.928 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:45.926+0000 7f612336b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T15:24:46.008 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:46.006+0000 7f612336b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T15:24:46.037 INFO:teuthology.orchestra.run.smithi159.stdout:5 2024-09-10T15:24:46.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new 54a77e0e-03c3-44d4-baed-702a89305ed8 6 2024-09-10T15:24:46.064 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:46.062+0000 7f612336b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T15:24:46.221 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:46.218+0000 7f612336b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T15:24:46.266 INFO:teuthology.orchestra.run.smithi159.stdout:6 2024-09-10T15:24:46.283 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd new fd400894-7e05-4aab-8a22-5b2f345ee140 7 2024-09-10T15:24:46.285 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:46.282+0000 7f612336b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T15:24:46.331 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.329+0000 7f0d48a24180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-10T15:24:46.385 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.381+0000 7f0d48a24180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-10T15:24:46.437 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.437+0000 7f0d48a24180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-10T15:24:46.477 INFO:teuthology.orchestra.run.smithi159.stdout:7 2024-09-10T15:24:46.494 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T15:24:46.494 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T15:24:46.496 INFO:tasks.ceph.osd.0:Started 2024-09-10T15:24:46.496 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T15:24:46.497 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T15:24:46.499 INFO:tasks.ceph.osd.1:Started 2024-09-10T15:24:46.499 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T15:24:46.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T15:24:46.501 INFO:tasks.ceph.osd.2:Started 2024-09-10T15:24:46.502 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T15:24:46.502 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T15:24:46.504 INFO:tasks.ceph.osd.3:Started 2024-09-10T15:24:46.504 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T15:24:46.504 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T15:24:46.507 INFO:tasks.ceph.osd.4:Started 2024-09-10T15:24:46.507 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T15:24:46.507 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T15:24:46.509 INFO:tasks.ceph.osd.5:Started 2024-09-10T15:24:46.509 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-10T15:24:46.509 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-10T15:24:46.512 INFO:tasks.ceph.osd.6:Started 2024-09-10T15:24:46.512 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-10T15:24:46.512 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-10T15:24:46.514 INFO:tasks.ceph.osd.7:Started 2024-09-10T15:24:46.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T15:24:46.519 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.517+0000 7f0d48a24180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-10T15:24:46.593 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.589+0000 7f0d48a24180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-10T15:24:46.673 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.669+0000 7f0d48a24180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-10T15:24:46.708 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:24:46.708 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:24:46.474296+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:24:46.724 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T15:24:46.725 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T15:24:46.728 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.725+0000 7f0d48a24180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-10T15:24:46.878 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.877+0000 7f0d48a24180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-10T15:24:46.940 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:46.937+0000 7f0d48a24180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-10T15:24:46.945 INFO:tasks.ceph.mgr.x.smithi159.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T15:24:46.945 INFO:tasks.ceph.mgr.x.smithi159.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T15:24:46.945 INFO:tasks.ceph.mgr.x.smithi159.stderr: from numpy import show_config as show_numpy_config 2024-09-10T15:24:47.003 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:46.998+0000 7f612336b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T15:24:47.177 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:47.174+0000 7f612336b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T15:24:47.363 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:47.358+0000 7f612336b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T15:24:47.433 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:47.430+0000 7f612336b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T15:24:47.531 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T15:24:47.581 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:47.578+0000 7f612336b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T15:24:47.596 INFO:tasks.ceph.mgr.y.smithi099.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T15:24:47.597 INFO:tasks.ceph.mgr.y.smithi099.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T15:24:47.597 INFO:tasks.ceph.mgr.y.smithi099.stderr: from numpy import show_config as show_numpy_config 2024-09-10T15:24:47.630 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:24:47.629+0000 7f26f42617c0 -1 Falling back to public interface 2024-09-10T15:24:47.658 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:47.657+0000 7f0d48a24180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-10T15:24:47.711 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-10T15:24:47.711 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":10,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:24:46.474296+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:24:47.725 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T15:24:47.795 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:47.793+0000 7f0d48a24180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-10T15:24:47.879 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:24:47.877+0000 7f401c3437c0 -1 Falling back to public interface 2024-09-10T15:24:47.927 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:24:47.925+0000 7f3abab687c0 -1 Falling back to public interface 2024-09-10T15:24:47.948 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:47.945+0000 7f0d48a24180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-10T15:24:47.950 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:24:47.949+0000 7efc74a8c7c0 -1 Falling back to public interface 2024-09-10T15:24:48.012 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:48.009+0000 7f0d48a24180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-10T15:24:48.117 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:24:48.114+0000 7fdfaf7107c0 -1 Falling back to public interface 2024-09-10T15:24:48.146 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:48.145+0000 7f0d48a24180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-10T15:24:48.186 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:48.182+0000 7f612336b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T15:24:48.261 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:48.258+0000 7f612336b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T15:24:48.385 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:24:48.382+0000 7fc3bfe017c0 -1 Falling back to public interface 2024-09-10T15:24:48.446 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:48.442+0000 7f612336b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T15:24:48.518 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:48.514+0000 7f612336b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T15:24:48.646 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:24:48.642+0000 7f1c18f777c0 -1 Falling back to public interface 2024-09-10T15:24:48.654 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:24:48.650+0000 7fecdb3197c0 -1 Falling back to public interface 2024-09-10T15:24:48.746 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:48.745+0000 7f0d48a24180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-10T15:24:48.810 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:48.806+0000 7f612336b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T15:24:48.821 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:48.821+0000 7f0d48a24180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-10T15:24:48.871 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:48.866+0000 7f612336b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T15:24:49.011 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:49.009+0000 7f0d48a24180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-10T15:24:49.085 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:49.081+0000 7f0d48a24180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-10T15:24:49.375 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:49.373+0000 7f0d48a24180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-10T15:24:49.437 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-09-10T15:24:49.433+0000 7f0d48a24180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-10T15:24:49.912 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:49.906+0000 7f60c9fa0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T15:24:49.913 INFO:tasks.ceph.mgr.x.smithi159.stderr:2024-09-10T15:24:49.910+0000 7f60c9fa0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T15:24:52.213 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:24:52.209+0000 7efc74a8c7c0 -1 osd.3 0 log_to_monitors true 2024-09-10T15:24:52.318 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:24:52.317+0000 7f26f42617c0 -1 osd.1 0 log_to_monitors true 2024-09-10T15:24:52.458 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:24:52.457+0000 7f401c3437c0 -1 osd.0 0 log_to_monitors true 2024-09-10T15:24:52.647 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:24:52.642+0000 7fdfaf7107c0 -1 osd.5 0 log_to_monitors true 2024-09-10T15:24:52.701 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:24:52.698+0000 7fecdb3197c0 -1 osd.4 0 log_to_monitors true 2024-09-10T15:24:52.722 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:24:52.721+0000 7f3abab687c0 -1 osd.2 0 log_to_monitors true 2024-09-10T15:24:52.954 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:24:52.949+0000 7fc3bfe017c0 -1 osd.7 0 log_to_monitors true 2024-09-10T15:24:53.109 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:24:53.105+0000 7f1c18f777c0 -1 osd.6 0 log_to_monitors true 2024-09-10T15:24:54.532 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T15:24:54.881 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-10T15:24:54.881 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":12,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:24:54.140445+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:24:54.899 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-10T15:24:56.241 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:24:56.237+0000 7fecd6a9f640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T15:24:56.249 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:24:56.245+0000 7fdfabecb640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T15:24:56.258 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:24:56.253+0000 7f26f0a1c640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T15:24:56.276 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:24:56.273+0000 7feccf0e6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.282 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:24:56.281+0000 7f26e802e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.283 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:24:56.277+0000 7f1c146fd640 -1 osd.6 0 waiting for initial osdmap 2024-09-10T15:24:56.288 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:24:56.285+0000 7fdfa34dd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.308 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:24:56.305+0000 7f1c0cd44640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.310 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:24:56.305+0000 7fc3bc5bc640 -1 osd.7 0 waiting for initial osdmap 2024-09-10T15:24:56.344 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:24:56.341+0000 7f4018afe640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T15:24:56.349 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:24:56.349+0000 7efc70212640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T15:24:56.349 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:24:56.345+0000 7fc3b3bce640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.366 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:24:56.365+0000 7f4010110640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.373 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:24:56.373+0000 7efc68859640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:24:56.373 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:24:56.373+0000 7f3ab62ee640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T15:24:56.402 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:24:56.401+0000 7f3aae935640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T15:25:01.708 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T15:25:02.009 INFO:teuthology.misc.health.smithi099.stdout: 2024-09-10T15:25:02.010 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":17,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:25:01.335690+0000","last_up_change":"2024-09-10T15:24:57.289996+0000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T15:24:58.987011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6809","nonce":2528983694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6811","nonce":2528983694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6815","nonce":2528983694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6813","nonce":2528983694}]},"public_addr":"172.21.15.99:6809/2528983694","cluster_addr":"172.21.15.99:6811/2528983694","heartbeat_back_addr":"172.21.15.99:6815/2528983694","heartbeat_front_addr":"172.21.15.99:6813/2528983694","state":["exists","up"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6801","nonce":3085897297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6803","nonce":3085897297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6807","nonce":3085897297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6805","nonce":3085897297}]},"public_addr":"172.21.15.99:6801/3085897297","cluster_addr":"172.21.15.99:6803/3085897297","heartbeat_back_addr":"172.21.15.99:6807/3085897297","heartbeat_front_addr":"172.21.15.99:6805/3085897297","state":["exists","up"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6817","nonce":4016938445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6819","nonce":4016938445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6823","nonce":4016938445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6821","nonce":4016938445}]},"public_addr":"172.21.15.99:6817/4016938445","cluster_addr":"172.21.15.99:6819/4016938445","heartbeat_back_addr":"172.21.15.99:6823/4016938445","heartbeat_front_addr":"172.21.15.99:6821/4016938445","state":["exists","up"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6825","nonce":1667351160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6827","nonce":1667351160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6831","nonce":1667351160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6829","nonce":1667351160}]},"public_addr":"172.21.15.99:6825/1667351160","cluster_addr":"172.21.15.99:6827/1667351160","heartbeat_back_addr":"172.21.15.99:6831/1667351160","heartbeat_front_addr":"172.21.15.99:6829/1667351160","state":["exists","up"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6825","nonce":1728711275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6827","nonce":1728711275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6831","nonce":1728711275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6829","nonce":1728711275}]},"public_addr":"172.21.15.159:6825/1728711275","cluster_addr":"172.21.15.159:6827/1728711275","heartbeat_back_addr":"172.21.15.159:6831/1728711275","heartbeat_front_addr":"172.21.15.159:6829/1728711275","state":["exists","up"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6801","nonce":1301853491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6803","nonce":1301853491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6807","nonce":1301853491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6805","nonce":1301853491}]},"public_addr":"172.21.15.159:6801/1301853491","cluster_addr":"172.21.15.159:6803/1301853491","heartbeat_back_addr":"172.21.15.159:6807/1301853491","heartbeat_front_addr":"172.21.15.159:6805/1301853491","state":["exists","up"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6817","nonce":1076897158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6819","nonce":1076897158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6823","nonce":1076897158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6821","nonce":1076897158}]},"public_addr":"172.21.15.159:6817/1076897158","cluster_addr":"172.21.15.159:6819/1076897158","heartbeat_back_addr":"172.21.15.159:6823/1076897158","heartbeat_front_addr":"172.21.15.159:6821/1076897158","state":["exists","up"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6809","nonce":989502281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6811","nonce":989502281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6815","nonce":989502281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6813","nonce":989502281}]},"public_addr":"172.21.15.159:6809/989502281","cluster_addr":"172.21.15.159:6811/989502281","heartbeat_back_addr":"172.21.15.159:6815/989502281","heartbeat_front_addr":"172.21.15.159:6813/989502281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.432506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.341537+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.717485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.180863+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.655023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.691365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:54.099394+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.913170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:25:02.027 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-10T15:25:02.027 INFO:tasks.ceph:Creating RBD pool 2024-09-10T15:25:02.027 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T15:25:02.509 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'rbd' created 2024-09-10T15:25:02.533 DEBUG:teuthology.orchestra.run.smithi099:> rbd --cluster ceph pool init rbd 2024-09-10T15:25:05.562 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T15:25:05.563 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T15:25:05.563 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T15:25:05.563 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T15:25:05.564 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T15:25:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:05.932 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2741150770},{"type":"v1","addr":"172.21.15.159:6833","nonce":2741150770}]},"active_addr":"172.21.15.159:6833/2741150770","active_change":"2024-09-10T15:24:48.892990+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":4153906711}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":3787946324}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":442053937}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2243892339}]}]} 2024-09-10T15:25:05.936 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T15:25:05.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T15:25:05.937 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T15:25:06.223 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:06.224 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:25:05.524193+0000","last_up_change":"2024-09-10T15:24:57.289996+0000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T15:24:58.987011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T15:25:02.368798+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6809","nonce":2528983694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6811","nonce":2528983694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6815","nonce":2528983694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6813","nonce":2528983694}]},"public_addr":"172.21.15.99:6809/2528983694","cluster_addr":"172.21.15.99:6811/2528983694","heartbeat_back_addr":"172.21.15.99:6815/2528983694","heartbeat_front_addr":"172.21.15.99:6813/2528983694","state":["exists","up"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6801","nonce":3085897297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6803","nonce":3085897297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6807","nonce":3085897297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6805","nonce":3085897297}]},"public_addr":"172.21.15.99:6801/3085897297","cluster_addr":"172.21.15.99:6803/3085897297","heartbeat_back_addr":"172.21.15.99:6807/3085897297","heartbeat_front_addr":"172.21.15.99:6805/3085897297","state":["exists","up"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6817","nonce":4016938445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6819","nonce":4016938445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6823","nonce":4016938445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6821","nonce":4016938445}]},"public_addr":"172.21.15.99:6817/4016938445","cluster_addr":"172.21.15.99:6819/4016938445","heartbeat_back_addr":"172.21.15.99:6823/4016938445","heartbeat_front_addr":"172.21.15.99:6821/4016938445","state":["exists","up"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6825","nonce":1667351160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6827","nonce":1667351160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6831","nonce":1667351160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6829","nonce":1667351160}]},"public_addr":"172.21.15.99:6825/1667351160","cluster_addr":"172.21.15.99:6827/1667351160","heartbeat_back_addr":"172.21.15.99:6831/1667351160","heartbeat_front_addr":"172.21.15.99:6829/1667351160","state":["exists","up"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6825","nonce":1728711275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6827","nonce":1728711275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6831","nonce":1728711275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6829","nonce":1728711275}]},"public_addr":"172.21.15.159:6825/1728711275","cluster_addr":"172.21.15.159:6827/1728711275","heartbeat_back_addr":"172.21.15.159:6831/1728711275","heartbeat_front_addr":"172.21.15.159:6829/1728711275","state":["exists","up"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6801","nonce":1301853491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6803","nonce":1301853491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6807","nonce":1301853491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6805","nonce":1301853491}]},"public_addr":"172.21.15.159:6801/1301853491","cluster_addr":"172.21.15.159:6803/1301853491","heartbeat_back_addr":"172.21.15.159:6807/1301853491","heartbeat_front_addr":"172.21.15.159:6805/1301853491","state":["exists","up"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6817","nonce":1076897158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6819","nonce":1076897158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6823","nonce":1076897158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6821","nonce":1076897158}]},"public_addr":"172.21.15.159:6817/1076897158","cluster_addr":"172.21.15.159:6819/1076897158","heartbeat_back_addr":"172.21.15.159:6823/1076897158","heartbeat_front_addr":"172.21.15.159:6821/1076897158","state":["exists","up"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6809","nonce":989502281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6811","nonce":989502281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6815","nonce":989502281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6813","nonce":989502281}]},"public_addr":"172.21.15.159:6809/989502281","cluster_addr":"172.21.15.159:6811/989502281","heartbeat_back_addr":"172.21.15.159:6815/989502281","heartbeat_front_addr":"172.21.15.159:6813/989502281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.432506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.341537+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.717485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.180863+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.655023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.691365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:54.099394+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.913170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:25:06.241 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T15:25:06.241 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T15:25:06.524 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:06.524 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":21,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:25:05.524193+0000","last_up_change":"2024-09-10T15:24:57.289996+0000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T15:24:58.987011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T15:25:02.368798+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6809","nonce":2528983694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6811","nonce":2528983694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6815","nonce":2528983694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6813","nonce":2528983694}]},"public_addr":"172.21.15.99:6809/2528983694","cluster_addr":"172.21.15.99:6811/2528983694","heartbeat_back_addr":"172.21.15.99:6815/2528983694","heartbeat_front_addr":"172.21.15.99:6813/2528983694","state":["exists","up"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6801","nonce":3085897297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6803","nonce":3085897297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6807","nonce":3085897297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6805","nonce":3085897297}]},"public_addr":"172.21.15.99:6801/3085897297","cluster_addr":"172.21.15.99:6803/3085897297","heartbeat_back_addr":"172.21.15.99:6807/3085897297","heartbeat_front_addr":"172.21.15.99:6805/3085897297","state":["exists","up"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6817","nonce":4016938445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6819","nonce":4016938445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6823","nonce":4016938445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6821","nonce":4016938445}]},"public_addr":"172.21.15.99:6817/4016938445","cluster_addr":"172.21.15.99:6819/4016938445","heartbeat_back_addr":"172.21.15.99:6823/4016938445","heartbeat_front_addr":"172.21.15.99:6821/4016938445","state":["exists","up"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6825","nonce":1667351160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6827","nonce":1667351160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6831","nonce":1667351160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6829","nonce":1667351160}]},"public_addr":"172.21.15.99:6825/1667351160","cluster_addr":"172.21.15.99:6827/1667351160","heartbeat_back_addr":"172.21.15.99:6831/1667351160","heartbeat_front_addr":"172.21.15.99:6829/1667351160","state":["exists","up"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6825","nonce":1728711275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6827","nonce":1728711275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6831","nonce":1728711275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6829","nonce":1728711275}]},"public_addr":"172.21.15.159:6825/1728711275","cluster_addr":"172.21.15.159:6827/1728711275","heartbeat_back_addr":"172.21.15.159:6831/1728711275","heartbeat_front_addr":"172.21.15.159:6829/1728711275","state":["exists","up"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6801","nonce":1301853491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6803","nonce":1301853491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6807","nonce":1301853491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6805","nonce":1301853491}]},"public_addr":"172.21.15.159:6801/1301853491","cluster_addr":"172.21.15.159:6803/1301853491","heartbeat_back_addr":"172.21.15.159:6807/1301853491","heartbeat_front_addr":"172.21.15.159:6805/1301853491","state":["exists","up"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6817","nonce":1076897158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6819","nonce":1076897158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6823","nonce":1076897158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6821","nonce":1076897158}]},"public_addr":"172.21.15.159:6817/1076897158","cluster_addr":"172.21.15.159:6819/1076897158","heartbeat_back_addr":"172.21.15.159:6823/1076897158","heartbeat_front_addr":"172.21.15.159:6821/1076897158","state":["exists","up"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6809","nonce":989502281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6811","nonce":989502281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6815","nonce":989502281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6813","nonce":989502281}]},"public_addr":"172.21.15.159:6809/989502281","cluster_addr":"172.21.15.159:6811/989502281","heartbeat_back_addr":"172.21.15.159:6815/989502281","heartbeat_front_addr":"172.21.15.159:6813/989502281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.432506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.341537+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.717485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.180863+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.655023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.691365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:54.099394+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.913170+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:25:06.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T15:25:06.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T15:25:06.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T15:25:06.543 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T15:25:06.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T15:25:06.544 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T15:25:06.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T15:25:06.545 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T15:25:06.799 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:06.799 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T15:25:06.804 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:06.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T15:25:06.805 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:06.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T15:25:06.813 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:06.813 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T15:25:06.814 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:06.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T15:25:06.817 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:06.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T15:25:06.818 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:06.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T15:25:06.823 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T15:25:06.823 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T15:25:07.295 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-09-10T15:25:07.319 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-10T15:25:07.334 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:07.337 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-09-10T15:25:07.340 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:07.344 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-09-10T15:25:07.346 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:07.361 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:07.369 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-09-10T15:25:07.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.1 2024-09-10T15:25:07.371 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-09-10T15:25:07.378 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-10T15:25:07.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-10T15:25:07.386 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-09-10T15:25:07.396 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:07.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-09-10T15:25:08.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T15:25:08.370 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T15:25:08.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T15:25:08.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T15:25:08.378 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T15:25:08.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T15:25:08.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T15:25:08.414 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T15:25:08.827 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:08.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-09-10T15:25:08.850 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.891 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:08.902 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-09-10T15:25:08.905 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:08.911 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:08.917 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:08.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-09-10T15:25:08.920 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.933 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-09-10T15:25:08.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-10T15:25:08.936 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-09-10T15:25:08.938 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.938 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-09-10T15:25:08.939 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.943 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-09-10T15:25:08.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-09-10T15:25:08.947 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-10T15:25:08.955 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.961 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-10T15:25:08.962 DEBUG:teuthology.parallel:result is None 2024-09-10T15:25:08.962 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T15:25:08.962 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:09.277 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:09.278 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:09.294 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T15:25:08.905679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":2932736,"data_stored":1769246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.391439"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542111+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:05.542111+0000","last_peered":"2024-09-10T15:25:05.542111+0000","last_clean":"2024-09-10T15:25:05.542111+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:05.542111+0000","last_undegraded":"2024-09-10T15:25:05.542111+0000","last_fullsized":"2024-09-10T15:25:05.542111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.656427+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:05.656427+0000","last_peered":"2024-09-10T15:25:05.656427+0000","last_clean":"2024-09-10T15:25:05.656427+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:05.656427+0000","last_undegraded":"2024-09-10T15:25:05.656427+0000","last_fullsized":"2024-09-10T15:25:05.656427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542003+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:05.542003+0000","last_peered":"2024-09-10T15:25:05.542003+0000","last_clean":"2024-09-10T15:25:05.542003+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:05.542003+0000","last_undegraded":"2024-09-10T15:25:05.542003+0000","last_fullsized":"2024-09-10T15:25:05.542003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.535588+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:05.535588+0000","last_peered":"2024-09-10T15:25:05.535588+0000","last_clean":"2024-09-10T15:25:05.535588+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:05.535588+0000","last_undegraded":"2024-09-10T15:25:05.535588+0000","last_fullsized":"2024-09-10T15:25:05.535588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.544219+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:05.544219+0000","last_peered":"2024-09-10T15:25:05.544219+0000","last_clean":"2024-09-10T15:25:05.544219+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:05.544219+0000","last_undegraded":"2024-09-10T15:25:05.544219+0000","last_fullsized":"2024-09-10T15:25:05.544219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:06.156478+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:06.156478+0000","last_peered":"2024-09-10T15:25:06.156478+0000","last_clean":"2024-09-10T15:25:06.156478+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:06.156478+0000","last_undegraded":"2024-09-10T15:25:06.156478+0000","last_fullsized":"2024-09-10T15:25:06.156478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542689+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:05.542689+0000","last_peered":"2024-09-10T15:25:05.542689+0000","last_clean":"2024-09-10T15:25:05.542689+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:05.542689+0000","last_undegraded":"2024-09-10T15:25:05.542689+0000","last_fullsized":"2024-09-10T15:25:05.542689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542854+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:05.542854+0000","last_peered":"2024-09-10T15:25:05.542854+0000","last_clean":"2024-09-10T15:25:05.542854+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:05.542854+0000","last_undegraded":"2024-09-10T15:25:05.542854+0000","last_fullsized":"2024-09-10T15:25:05.542854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.535211+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:05.535211+0000","last_peered":"2024-09-10T15:25:05.535211+0000","last_clean":"2024-09-10T15:25:05.535211+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:05.535211+0000","last_undegraded":"2024-09-10T15:25:05.535211+0000","last_fullsized":"2024-09-10T15:25:05.535211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:09.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:09.564 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:09.564 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:09.581 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T15:25:08.905679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219116,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755604,"statfs":{"total":773094113280,"available":772869738496,"internally_reserved":0,"allocated":2932736,"data_stored":1769246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.391439"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542111+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:05.542111+0000","last_peered":"2024-09-10T15:25:05.542111+0000","last_clean":"2024-09-10T15:25:05.542111+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:05.542111+0000","last_undegraded":"2024-09-10T15:25:05.542111+0000","last_fullsized":"2024-09-10T15:25:05.542111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.656427+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:05.656427+0000","last_peered":"2024-09-10T15:25:05.656427+0000","last_clean":"2024-09-10T15:25:05.656427+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:05.656427+0000","last_undegraded":"2024-09-10T15:25:05.656427+0000","last_fullsized":"2024-09-10T15:25:05.656427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542003+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:05.542003+0000","last_peered":"2024-09-10T15:25:05.542003+0000","last_clean":"2024-09-10T15:25:05.542003+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:05.542003+0000","last_undegraded":"2024-09-10T15:25:05.542003+0000","last_fullsized":"2024-09-10T15:25:05.542003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.535588+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:05.535588+0000","last_peered":"2024-09-10T15:25:05.535588+0000","last_clean":"2024-09-10T15:25:05.535588+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:05.535588+0000","last_undegraded":"2024-09-10T15:25:05.535588+0000","last_fullsized":"2024-09-10T15:25:05.535588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.544219+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:05.544219+0000","last_peered":"2024-09-10T15:25:05.544219+0000","last_clean":"2024-09-10T15:25:05.544219+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:05.544219+0000","last_undegraded":"2024-09-10T15:25:05.544219+0000","last_fullsized":"2024-09-10T15:25:05.544219+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:06.156478+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:06.156478+0000","last_peered":"2024-09-10T15:25:06.156478+0000","last_clean":"2024-09-10T15:25:06.156478+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:06.156478+0000","last_undegraded":"2024-09-10T15:25:06.156478+0000","last_fullsized":"2024-09-10T15:25:06.156478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542689+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:05.542689+0000","last_peered":"2024-09-10T15:25:05.542689+0000","last_clean":"2024-09-10T15:25:05.542689+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:05.542689+0000","last_undegraded":"2024-09-10T15:25:05.542689+0000","last_fullsized":"2024-09-10T15:25:05.542689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.542854+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:05.542854+0000","last_peered":"2024-09-10T15:25:05.542854+0000","last_clean":"2024-09-10T15:25:05.542854+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:05.542854+0000","last_undegraded":"2024-09-10T15:25:05.542854+0000","last_fullsized":"2024-09-10T15:25:05.542854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'117","reported_seq":169,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-10T15:25:05.535211+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:05.535211+0000","last_peered":"2024-09-10T15:25:05.535211+0000","last_clean":"2024-09-10T15:25:05.535211+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:05.535211+0000","last_undegraded":"2024-09-10T15:25:05.535211+0000","last_fullsized":"2024-09-10T15:25:05.535211+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":663927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":73578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":663927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":217088,"data_stored":73559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:09.582 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T15:25:09.582 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T15:25:09.582 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T15:25:09.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T15:25:09.894 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:09.895 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T15:25:09.911 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T15:25:09.912 INFO:teuthology.run_tasks:Running task rgw... 2024-09-10T15:25:09.927 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-10T15:25:09.928 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-10T15:25:09.928 INFO:tasks.rgw:Creating data pools 2024-09-10T15:25:09.928 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-10T15:25:09.928 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-10T15:25:10.809 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.data' created 2024-09-10T15:25:10.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-10T15:25:11.819 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-10T15:25:11.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-10T15:25:12.812 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.index' created 2024-09-10T15:25:12.844 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-10T15:25:13.815 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-10T15:25:13.848 DEBUG:tasks.rgw:Pools created 2024-09-10T15:25:13.849 INFO:tasks.rgw:Starting rgw... 2024-09-10T15:25:13.849 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-10T15:25:13.849 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-10T15:25:13.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo echo -n http://smithi099.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-10T15:25:13.865 INFO:teuthology.orchestra.run.smithi099.stdout:http://smithi099.front.sepia.ceph.com:80 2024-09-10T15:25:13.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-10T15:25:13.920 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-10T15:25:13.920 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-10T15:25:13.962 INFO:tasks.rgw.client.0:Started 2024-09-10T15:25:13.962 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi099.front.sepia.ceph.com:80/ 2024-09-10T15:25:13.962 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-10T15:25:14.068 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T15:25:14.069 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T15:25:14.069 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-10T15:25:14.069 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T15:25:14.069 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T15:25:15.070 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-10T15:25:15.082 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T15:25:15.082 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-10T15:25:15.082 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T15:25:15.082 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T15:25:15.083 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T15:25:17.084 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-10T15:25:17.096 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T15:25:17.096 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-10T15:25:17.096 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T15:25:17.096 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T15:25:17.097 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T15:25:21.098 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-10T15:25:21.110 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T15:25:21.110 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-10T15:25:21.110 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-10T15:25:21.110 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-10T15:25:21.111 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-10T15:25:23.045 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-10T15:25:23.044+0000 7fa3abbf7a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-09-10T15:25:29.112 DEBUG:teuthology.orchestra.run.smithi099:> curl http://smithi099.front.sepia.ceph.com:80/ 2024-09-10T15:25:29.123 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-10T15:25:29.124 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-09-10T15:25:29.127 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 55309 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-10T15:25:29.128 INFO:teuthology.orchestra.run.smithi099.stdout:anonymous 2024-09-10T15:25:29.128 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-10T15:25:29.148 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-10T15:25:29.148 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-squid'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-tejas-testing-2024-09-09-1611-squid', 'sha1': '7162ca8a22368558b9ec845c47e93c7afc45e8c3'}} 2024-09-10T15:25:29.148 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-10T15:25:29.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-10T15:25:29.508 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-10T15:25:29.508 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T15:25:29.508 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:29.841 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:29.850 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:29.854 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-10T15:25:28.913936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220760,"kb_used_data":4528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753960,"statfs":{"total":773094113280,"available":772868055040,"internally_reserved":0,"allocated":4636672,"data_stored":2581316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004041"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887529+0000","last_change":"2024-09-10T15:25:11.842625+0000","last_active":"2024-09-10T15:25:22.887529+0000","last_peered":"2024-09-10T15:25:22.887529+0000","last_clean":"2024-09-10T15:25:22.887529+0000","last_became_active":"2024-09-10T15:25:11.842298+0000","last_became_peered":"2024-09-10T15:25:11.842298+0000","last_unstale":"2024-09-10T15:25:22.887529+0000","last_undegraded":"2024-09-10T15:25:22.887529+0000","last_fullsized":"2024-09-10T15:25:22.887529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877549+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:25:22.877549+0000","last_peered":"2024-09-10T15:25:22.877549+0000","last_clean":"2024-09-10T15:25:22.877549+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:25:22.877549+0000","last_undegraded":"2024-09-10T15:25:22.877549+0000","last_fullsized":"2024-09-10T15:25:22.877549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879860+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:25:22.879860+0000","last_peered":"2024-09-10T15:25:22.879860+0000","last_clean":"2024-09-10T15:25:22.879860+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:25:22.879860+0000","last_undegraded":"2024-09-10T15:25:22.879860+0000","last_fullsized":"2024-09-10T15:25:22.879860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924223+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:25:22.924223+0000","last_peered":"2024-09-10T15:25:22.924223+0000","last_clean":"2024-09-10T15:25:22.924223+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:25:22.924223+0000","last_undegraded":"2024-09-10T15:25:22.924223+0000","last_fullsized":"2024-09-10T15:25:22.924223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879045+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:25:22.879045+0000","last_peered":"2024-09-10T15:25:22.879045+0000","last_clean":"2024-09-10T15:25:22.879045+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:25:22.879045+0000","last_undegraded":"2024-09-10T15:25:22.879045+0000","last_fullsized":"2024-09-10T15:25:22.879045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924285+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:25:22.924285+0000","last_peered":"2024-09-10T15:25:22.924285+0000","last_clean":"2024-09-10T15:25:22.924285+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:25:22.924285+0000","last_undegraded":"2024-09-10T15:25:22.924285+0000","last_fullsized":"2024-09-10T15:25:22.924285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934179+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:25:22.934179+0000","last_peered":"2024-09-10T15:25:22.934179+0000","last_clean":"2024-09-10T15:25:22.934179+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:25:22.934179+0000","last_undegraded":"2024-09-10T15:25:22.934179+0000","last_fullsized":"2024-09-10T15:25:22.934179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891746+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:25:22.891746+0000","last_peered":"2024-09-10T15:25:22.891746+0000","last_clean":"2024-09-10T15:25:22.891746+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:25:22.891746+0000","last_undegraded":"2024-09-10T15:25:22.891746+0000","last_fullsized":"2024-09-10T15:25:22.891746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887117+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:25:22.887117+0000","last_peered":"2024-09-10T15:25:22.887117+0000","last_clean":"2024-09-10T15:25:22.887117+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:25:22.887117+0000","last_undegraded":"2024-09-10T15:25:22.887117+0000","last_fullsized":"2024-09-10T15:25:22.887117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886523+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:25:22.886523+0000","last_peered":"2024-09-10T15:25:22.886523+0000","last_clean":"2024-09-10T15:25:22.886523+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:25:22.886523+0000","last_undegraded":"2024-09-10T15:25:22.886523+0000","last_fullsized":"2024-09-10T15:25:22.886523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932588+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:25:22.932588+0000","last_peered":"2024-09-10T15:25:22.932588+0000","last_clean":"2024-09-10T15:25:22.932588+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:25:22.932588+0000","last_undegraded":"2024-09-10T15:25:22.932588+0000","last_fullsized":"2024-09-10T15:25:22.932588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887217+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:25:22.887217+0000","last_peered":"2024-09-10T15:25:22.887217+0000","last_clean":"2024-09-10T15:25:22.887217+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:25:22.887217+0000","last_undegraded":"2024-09-10T15:25:22.887217+0000","last_fullsized":"2024-09-10T15:25:22.887217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886707+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:25:22.886707+0000","last_peered":"2024-09-10T15:25:22.886707+0000","last_clean":"2024-09-10T15:25:22.886707+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:25:22.886707+0000","last_undegraded":"2024-09-10T15:25:22.886707+0000","last_fullsized":"2024-09-10T15:25:22.886707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933695+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:25:22.933695+0000","last_peered":"2024-09-10T15:25:22.933695+0000","last_clean":"2024-09-10T15:25:22.933695+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:25:22.933695+0000","last_undegraded":"2024-09-10T15:25:22.933695+0000","last_fullsized":"2024-09-10T15:25:22.933695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877300+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:25:22.877300+0000","last_peered":"2024-09-10T15:25:22.877300+0000","last_clean":"2024-09-10T15:25:22.877300+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:25:22.877300+0000","last_undegraded":"2024-09-10T15:25:22.877300+0000","last_fullsized":"2024-09-10T15:25:22.877300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879824+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:25:22.879824+0000","last_peered":"2024-09-10T15:25:22.879824+0000","last_clean":"2024-09-10T15:25:22.879824+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:25:22.879824+0000","last_undegraded":"2024-09-10T15:25:22.879824+0000","last_fullsized":"2024-09-10T15:25:22.879824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923800+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:25:22.923800+0000","last_peered":"2024-09-10T15:25:22.923800+0000","last_clean":"2024-09-10T15:25:22.923800+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:25:22.923800+0000","last_undegraded":"2024-09-10T15:25:22.923800+0000","last_fullsized":"2024-09-10T15:25:22.923800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.880502+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:25:22.880502+0000","last_peered":"2024-09-10T15:25:22.880502+0000","last_clean":"2024-09-10T15:25:22.880502+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:25:22.880502+0000","last_undegraded":"2024-09-10T15:25:22.880502+0000","last_fullsized":"2024-09-10T15:25:22.880502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886290+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:25:22.886290+0000","last_peered":"2024-09-10T15:25:22.886290+0000","last_clean":"2024-09-10T15:25:22.886290+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:25:22.886290+0000","last_undegraded":"2024-09-10T15:25:22.886290+0000","last_fullsized":"2024-09-10T15:25:22.886290+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887966+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:25:22.887966+0000","last_peered":"2024-09-10T15:25:22.887966+0000","last_clean":"2024-09-10T15:25:22.887966+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:25:22.887966+0000","last_undegraded":"2024-09-10T15:25:22.887966+0000","last_fullsized":"2024-09-10T15:25:22.887966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878718+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:25:22.878718+0000","last_peered":"2024-09-10T15:25:22.878718+0000","last_clean":"2024-09-10T15:25:22.878718+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:25:22.878718+0000","last_undegraded":"2024-09-10T15:25:22.878718+0000","last_fullsized":"2024-09-10T15:25:22.878718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887813+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:25:22.887813+0000","last_peered":"2024-09-10T15:25:22.887813+0000","last_clean":"2024-09-10T15:25:22.887813+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:25:22.887813+0000","last_undegraded":"2024-09-10T15:25:22.887813+0000","last_fullsized":"2024-09-10T15:25:22.887813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910711+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:25:22.910711+0000","last_peered":"2024-09-10T15:25:22.910711+0000","last_clean":"2024-09-10T15:25:22.910711+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:25:22.910711+0000","last_undegraded":"2024-09-10T15:25:22.910711+0000","last_fullsized":"2024-09-10T15:25:22.910711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887000+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:25:22.887000+0000","last_peered":"2024-09-10T15:25:22.887000+0000","last_clean":"2024-09-10T15:25:22.887000+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:25:22.887000+0000","last_undegraded":"2024-09-10T15:25:22.887000+0000","last_fullsized":"2024-09-10T15:25:22.887000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879014+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:25:22.879014+0000","last_peered":"2024-09-10T15:25:22.879014+0000","last_clean":"2024-09-10T15:25:22.879014+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:25:22.879014+0000","last_undegraded":"2024-09-10T15:25:22.879014+0000","last_fullsized":"2024-09-10T15:25:22.879014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911485+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:25:22.911485+0000","last_peered":"2024-09-10T15:25:22.911485+0000","last_clean":"2024-09-10T15:25:22.911485+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:25:22.911485+0000","last_undegraded":"2024-09-10T15:25:22.911485+0000","last_fullsized":"2024-09-10T15:25:22.911485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879788+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:25:22.879788+0000","last_peered":"2024-09-10T15:25:22.879788+0000","last_clean":"2024-09-10T15:25:22.879788+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:25:22.879788+0000","last_undegraded":"2024-09-10T15:25:22.879788+0000","last_fullsized":"2024-09-10T15:25:22.879788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910566+0000","last_change":"2024-09-10T15:25:11.843256+0000","last_active":"2024-09-10T15:25:22.910566+0000","last_peered":"2024-09-10T15:25:22.910566+0000","last_clean":"2024-09-10T15:25:22.910566+0000","last_became_active":"2024-09-10T15:25:11.842370+0000","last_became_peered":"2024-09-10T15:25:11.842370+0000","last_unstale":"2024-09-10T15:25:22.910566+0000","last_undegraded":"2024-09-10T15:25:22.910566+0000","last_fullsized":"2024-09-10T15:25:22.910566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.885755+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:25:22.885755+0000","last_peered":"2024-09-10T15:25:22.885755+0000","last_clean":"2024-09-10T15:25:22.885755+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:25:22.885755+0000","last_undegraded":"2024-09-10T15:25:22.885755+0000","last_fullsized":"2024-09-10T15:25:22.885755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910844+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:25:22.910844+0000","last_peered":"2024-09-10T15:25:22.910844+0000","last_clean":"2024-09-10T15:25:22.910844+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:25:22.910844+0000","last_undegraded":"2024-09-10T15:25:22.910844+0000","last_fullsized":"2024-09-10T15:25:22.910844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924218+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:25:22.924218+0000","last_peered":"2024-09-10T15:25:22.924218+0000","last_clean":"2024-09-10T15:25:22.924218+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:25:22.924218+0000","last_undegraded":"2024-09-10T15:25:22.924218+0000","last_fullsized":"2024-09-10T15:25:22.924218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926951+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:25:22.926951+0000","last_peered":"2024-09-10T15:25:22.926951+0000","last_clean":"2024-09-10T15:25:22.926951+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:25:22.926951+0000","last_undegraded":"2024-09-10T15:25:22.926951+0000","last_fullsized":"2024-09-10T15:25:22.926951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.265531+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:25:23.265531+0000","last_peered":"2024-09-10T15:25:23.265531+0000","last_clean":"2024-09-10T15:25:23.265531+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:25:23.265531+0000","last_undegraded":"2024-09-10T15:25:23.265531+0000","last_fullsized":"2024-09-10T15:25:23.265531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879803+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:25:22.879803+0000","last_peered":"2024-09-10T15:25:22.879803+0000","last_clean":"2024-09-10T15:25:22.879803+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:25:22.879803+0000","last_undegraded":"2024-09-10T15:25:22.879803+0000","last_fullsized":"2024-09-10T15:25:22.879803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877333+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:25:22.877333+0000","last_peered":"2024-09-10T15:25:22.877333+0000","last_clean":"2024-09-10T15:25:22.877333+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:25:22.877333+0000","last_undegraded":"2024-09-10T15:25:22.877333+0000","last_fullsized":"2024-09-10T15:25:22.877333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926400+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:25:22.926400+0000","last_peered":"2024-09-10T15:25:22.926400+0000","last_clean":"2024-09-10T15:25:22.926400+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:25:22.926400+0000","last_undegraded":"2024-09-10T15:25:22.926400+0000","last_fullsized":"2024-09-10T15:25:22.926400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910824+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:25:22.910824+0000","last_peered":"2024-09-10T15:25:22.910824+0000","last_clean":"2024-09-10T15:25:22.910824+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:25:22.910824+0000","last_undegraded":"2024-09-10T15:25:22.910824+0000","last_fullsized":"2024-09-10T15:25:22.910824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890636+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:25:22.890636+0000","last_peered":"2024-09-10T15:25:22.890636+0000","last_clean":"2024-09-10T15:25:22.890636+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:25:22.890636+0000","last_undegraded":"2024-09-10T15:25:22.890636+0000","last_fullsized":"2024-09-10T15:25:22.890636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.651161+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:25:23.651161+0000","last_peered":"2024-09-10T15:25:23.651161+0000","last_clean":"2024-09-10T15:25:23.651161+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:25:23.651161+0000","last_undegraded":"2024-09-10T15:25:23.651161+0000","last_fullsized":"2024-09-10T15:25:23.651161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879643+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:25:22.879643+0000","last_peered":"2024-09-10T15:25:22.879643+0000","last_clean":"2024-09-10T15:25:22.879643+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:25:22.879643+0000","last_undegraded":"2024-09-10T15:25:22.879643+0000","last_fullsized":"2024-09-10T15:25:22.879643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910156+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:25:22.910156+0000","last_peered":"2024-09-10T15:25:22.910156+0000","last_clean":"2024-09-10T15:25:22.910156+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:25:22.910156+0000","last_undegraded":"2024-09-10T15:25:22.910156+0000","last_fullsized":"2024-09-10T15:25:22.910156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879621+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:25:22.879621+0000","last_peered":"2024-09-10T15:25:22.879621+0000","last_clean":"2024-09-10T15:25:22.879621+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:25:22.879621+0000","last_undegraded":"2024-09-10T15:25:22.879621+0000","last_fullsized":"2024-09-10T15:25:22.879621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924556+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:25:22.924556+0000","last_peered":"2024-09-10T15:25:22.924556+0000","last_clean":"2024-09-10T15:25:22.924556+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:25:22.924556+0000","last_undegraded":"2024-09-10T15:25:22.924556+0000","last_fullsized":"2024-09-10T15:25:22.924556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892641+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:25:22.892641+0000","last_peered":"2024-09-10T15:25:22.892641+0000","last_clean":"2024-09-10T15:25:22.892641+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:25:22.892641+0000","last_undegraded":"2024-09-10T15:25:22.892641+0000","last_fullsized":"2024-09-10T15:25:22.892641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.707291+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:25:23.707291+0000","last_peered":"2024-09-10T15:25:23.707291+0000","last_clean":"2024-09-10T15:25:23.707291+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:25:23.707291+0000","last_undegraded":"2024-09-10T15:25:23.707291+0000","last_fullsized":"2024-09-10T15:25:23.707291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.162980+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:25:23.162980+0000","last_peered":"2024-09-10T15:25:23.162980+0000","last_clean":"2024-09-10T15:25:23.162980+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:25:23.162980+0000","last_undegraded":"2024-09-10T15:25:23.162980+0000","last_fullsized":"2024-09-10T15:25:23.162980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932651+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:25:22.932651+0000","last_peered":"2024-09-10T15:25:22.932651+0000","last_clean":"2024-09-10T15:25:22.932651+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:25:22.932651+0000","last_undegraded":"2024-09-10T15:25:22.932651+0000","last_fullsized":"2024-09-10T15:25:22.932651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879307+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:25:22.879307+0000","last_peered":"2024-09-10T15:25:22.879307+0000","last_clean":"2024-09-10T15:25:22.879307+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:25:22.879307+0000","last_undegraded":"2024-09-10T15:25:22.879307+0000","last_fullsized":"2024-09-10T15:25:22.879307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877868+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:25:22.877868+0000","last_peered":"2024-09-10T15:25:22.877868+0000","last_clean":"2024-09-10T15:25:22.877868+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:25:22.877868+0000","last_undegraded":"2024-09-10T15:25:22.877868+0000","last_fullsized":"2024-09-10T15:25:22.877868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926128+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:25:22.926128+0000","last_peered":"2024-09-10T15:25:22.926128+0000","last_clean":"2024-09-10T15:25:22.926128+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:25:22.926128+0000","last_undegraded":"2024-09-10T15:25:22.926128+0000","last_fullsized":"2024-09-10T15:25:22.926128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.714538+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:25:23.714538+0000","last_peered":"2024-09-10T15:25:23.714538+0000","last_clean":"2024-09-10T15:25:23.714538+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:25:23.714538+0000","last_undegraded":"2024-09-10T15:25:23.714538+0000","last_fullsized":"2024-09-10T15:25:23.714538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.167209+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:25:23.167209+0000","last_peered":"2024-09-10T15:25:23.167209+0000","last_clean":"2024-09-10T15:25:23.167209+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:25:23.167209+0000","last_undegraded":"2024-09-10T15:25:23.167209+0000","last_fullsized":"2024-09-10T15:25:23.167209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923872+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:25:22.923872+0000","last_peered":"2024-09-10T15:25:22.923872+0000","last_clean":"2024-09-10T15:25:22.923872+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:25:22.923872+0000","last_undegraded":"2024-09-10T15:25:22.923872+0000","last_fullsized":"2024-09-10T15:25:22.923872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887809+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:25:22.887809+0000","last_peered":"2024-09-10T15:25:22.887809+0000","last_clean":"2024-09-10T15:25:22.887809+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:25:22.887809+0000","last_undegraded":"2024-09-10T15:25:22.887809+0000","last_fullsized":"2024-09-10T15:25:22.887809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877720+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:25:22.877720+0000","last_peered":"2024-09-10T15:25:22.877720+0000","last_clean":"2024-09-10T15:25:22.877720+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:25:22.877720+0000","last_undegraded":"2024-09-10T15:25:22.877720+0000","last_fullsized":"2024-09-10T15:25:22.877720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.812990+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:25:23.812990+0000","last_peered":"2024-09-10T15:25:23.812990+0000","last_clean":"2024-09-10T15:25:23.812990+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:25:23.812990+0000","last_undegraded":"2024-09-10T15:25:23.812990+0000","last_fullsized":"2024-09-10T15:25:23.812990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910233+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:25:22.910233+0000","last_peered":"2024-09-10T15:25:22.910233+0000","last_clean":"2024-09-10T15:25:22.910233+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:25:22.910233+0000","last_undegraded":"2024-09-10T15:25:22.910233+0000","last_fullsized":"2024-09-10T15:25:22.910233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933862+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:25:22.933862+0000","last_peered":"2024-09-10T15:25:22.933862+0000","last_clean":"2024-09-10T15:25:22.933862+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:25:22.933862+0000","last_undegraded":"2024-09-10T15:25:22.933862+0000","last_fullsized":"2024-09-10T15:25:22.933862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877856+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:25:22.877856+0000","last_peered":"2024-09-10T15:25:22.877856+0000","last_clean":"2024-09-10T15:25:22.877856+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:25:22.877856+0000","last_undegraded":"2024-09-10T15:25:22.877856+0000","last_fullsized":"2024-09-10T15:25:22.877856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934212+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:25:22.934212+0000","last_peered":"2024-09-10T15:25:22.934212+0000","last_clean":"2024-09-10T15:25:22.934212+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:25:22.934212+0000","last_undegraded":"2024-09-10T15:25:22.934212+0000","last_fullsized":"2024-09-10T15:25:22.934212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.909354+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:25:22.909354+0000","last_peered":"2024-09-10T15:25:22.909354+0000","last_clean":"2024-09-10T15:25:22.909354+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:25:22.909354+0000","last_undegraded":"2024-09-10T15:25:22.909354+0000","last_fullsized":"2024-09-10T15:25:22.909354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.686701+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:25:23.686701+0000","last_peered":"2024-09-10T15:25:23.686701+0000","last_clean":"2024-09-10T15:25:23.686701+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:25:23.686701+0000","last_undegraded":"2024-09-10T15:25:23.686701+0000","last_fullsized":"2024-09-10T15:25:23.686701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889887+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:25:22.889887+0000","last_peered":"2024-09-10T15:25:22.889887+0000","last_clean":"2024-09-10T15:25:22.889887+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:25:22.889887+0000","last_undegraded":"2024-09-10T15:25:22.889887+0000","last_fullsized":"2024-09-10T15:25:22.889887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879450+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:25:22.879450+0000","last_peered":"2024-09-10T15:25:22.879450+0000","last_clean":"2024-09-10T15:25:22.879450+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:25:22.879450+0000","last_undegraded":"2024-09-10T15:25:22.879450+0000","last_fullsized":"2024-09-10T15:25:22.879450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932338+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:25:22.932338+0000","last_peered":"2024-09-10T15:25:22.932338+0000","last_clean":"2024-09-10T15:25:22.932338+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:25:22.932338+0000","last_undegraded":"2024-09-10T15:25:22.932338+0000","last_fullsized":"2024-09-10T15:25:22.932338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925816+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:25:22.925816+0000","last_peered":"2024-09-10T15:25:22.925816+0000","last_clean":"2024-09-10T15:25:22.925816+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:25:22.925816+0000","last_undegraded":"2024-09-10T15:25:22.925816+0000","last_fullsized":"2024-09-10T15:25:22.925816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877872+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:25:22.877872+0000","last_peered":"2024-09-10T15:25:22.877872+0000","last_clean":"2024-09-10T15:25:22.877872+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:25:22.877872+0000","last_undegraded":"2024-09-10T15:25:22.877872+0000","last_fullsized":"2024-09-10T15:25:22.877872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.602750+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:25:23.602750+0000","last_peered":"2024-09-10T15:25:23.602750+0000","last_clean":"2024-09-10T15:25:23.602750+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:25:23.602750+0000","last_undegraded":"2024-09-10T15:25:23.602750+0000","last_fullsized":"2024-09-10T15:25:23.602750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.166905+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:25:23.166905+0000","last_peered":"2024-09-10T15:25:23.166905+0000","last_clean":"2024-09-10T15:25:23.166905+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:25:23.166905+0000","last_undegraded":"2024-09-10T15:25:23.166905+0000","last_fullsized":"2024-09-10T15:25:23.166905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.912309+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:25:22.912309+0000","last_peered":"2024-09-10T15:25:22.912309+0000","last_clean":"2024-09-10T15:25:22.912309+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:25:22.912309+0000","last_undegraded":"2024-09-10T15:25:22.912309+0000","last_fullsized":"2024-09-10T15:25:22.912309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878713+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:25:22.878713+0000","last_peered":"2024-09-10T15:25:22.878713+0000","last_clean":"2024-09-10T15:25:22.878713+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:25:22.878713+0000","last_undegraded":"2024-09-10T15:25:22.878713+0000","last_fullsized":"2024-09-10T15:25:22.878713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887502+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:25:22.887502+0000","last_peered":"2024-09-10T15:25:22.887502+0000","last_clean":"2024-09-10T15:25:22.887502+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:25:22.887502+0000","last_undegraded":"2024-09-10T15:25:22.887502+0000","last_fullsized":"2024-09-10T15:25:22.887502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910078+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:25:22.910078+0000","last_peered":"2024-09-10T15:25:22.910078+0000","last_clean":"2024-09-10T15:25:22.910078+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:25:22.910078+0000","last_undegraded":"2024-09-10T15:25:22.910078+0000","last_fullsized":"2024-09-10T15:25:22.910078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.234715+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:25:23.234715+0000","last_peered":"2024-09-10T15:25:23.234715+0000","last_clean":"2024-09-10T15:25:23.234715+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:25:23.234715+0000","last_undegraded":"2024-09-10T15:25:23.234715+0000","last_fullsized":"2024-09-10T15:25:23.234715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877668+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:25:22.877668+0000","last_peered":"2024-09-10T15:25:22.877668+0000","last_clean":"2024-09-10T15:25:22.877668+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:25:22.877668+0000","last_undegraded":"2024-09-10T15:25:22.877668+0000","last_fullsized":"2024-09-10T15:25:22.877668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900956+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:25:22.900956+0000","last_peered":"2024-09-10T15:25:22.900956+0000","last_clean":"2024-09-10T15:25:22.900956+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:25:22.900956+0000","last_undegraded":"2024-09-10T15:25:22.900956+0000","last_fullsized":"2024-09-10T15:25:22.900956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887111+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:22.887111+0000","last_peered":"2024-09-10T15:25:22.887111+0000","last_clean":"2024-09-10T15:25:22.887111+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:25:22.887111+0000","last_undegraded":"2024-09-10T15:25:22.887111+0000","last_fullsized":"2024-09-10T15:25:22.887111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.899552+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:25:22.899552+0000","last_peered":"2024-09-10T15:25:22.899552+0000","last_clean":"2024-09-10T15:25:22.899552+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:25:22.899552+0000","last_undegraded":"2024-09-10T15:25:22.899552+0000","last_fullsized":"2024-09-10T15:25:22.899552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.899922+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:25:22.899922+0000","last_peered":"2024-09-10T15:25:22.899922+0000","last_clean":"2024-09-10T15:25:22.899922+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:25:22.899922+0000","last_undegraded":"2024-09-10T15:25:22.899922+0000","last_fullsized":"2024-09-10T15:25:22.899922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.749334+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:25:23.749334+0000","last_peered":"2024-09-10T15:25:23.749334+0000","last_clean":"2024-09-10T15:25:23.749334+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:25:23.749334+0000","last_undegraded":"2024-09-10T15:25:23.749334+0000","last_fullsized":"2024-09-10T15:25:23.749334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900640+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:25:22.900640+0000","last_peered":"2024-09-10T15:25:22.900640+0000","last_clean":"2024-09-10T15:25:22.900640+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:25:22.900640+0000","last_undegraded":"2024-09-10T15:25:22.900640+0000","last_fullsized":"2024-09-10T15:25:22.900640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877091+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:25:22.877091+0000","last_peered":"2024-09-10T15:25:22.877091+0000","last_clean":"2024-09-10T15:25:22.877091+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:25:22.877091+0000","last_undegraded":"2024-09-10T15:25:22.877091+0000","last_fullsized":"2024-09-10T15:25:22.877091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926746+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:25:22.926746+0000","last_peered":"2024-09-10T15:25:22.926746+0000","last_clean":"2024-09-10T15:25:22.926746+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:25:22.926746+0000","last_undegraded":"2024-09-10T15:25:22.926746+0000","last_fullsized":"2024-09-10T15:25:22.926746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925012+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:25:22.925012+0000","last_peered":"2024-09-10T15:25:22.925012+0000","last_clean":"2024-09-10T15:25:22.925012+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:25:22.925012+0000","last_undegraded":"2024-09-10T15:25:22.925012+0000","last_fullsized":"2024-09-10T15:25:22.925012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878740+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:25:22.878740+0000","last_peered":"2024-09-10T15:25:22.878740+0000","last_clean":"2024-09-10T15:25:22.878740+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:25:22.878740+0000","last_undegraded":"2024-09-10T15:25:22.878740+0000","last_fullsized":"2024-09-10T15:25:22.878740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.818997+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:25:23.818997+0000","last_peered":"2024-09-10T15:25:23.818997+0000","last_clean":"2024-09-10T15:25:23.818997+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:25:23.818997+0000","last_undegraded":"2024-09-10T15:25:23.818997+0000","last_fullsized":"2024-09-10T15:25:23.818997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.160491+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:25:23.160491+0000","last_peered":"2024-09-10T15:25:23.160491+0000","last_clean":"2024-09-10T15:25:23.160491+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:25:23.160491+0000","last_undegraded":"2024-09-10T15:25:23.160491+0000","last_fullsized":"2024-09-10T15:25:23.160491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.909765+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:25:22.909765+0000","last_peered":"2024-09-10T15:25:22.909765+0000","last_clean":"2024-09-10T15:25:22.909765+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:25:22.909765+0000","last_undegraded":"2024-09-10T15:25:22.909765+0000","last_fullsized":"2024-09-10T15:25:22.909765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933044+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:25:22.933044+0000","last_peered":"2024-09-10T15:25:22.933044+0000","last_clean":"2024-09-10T15:25:22.933044+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:25:22.933044+0000","last_undegraded":"2024-09-10T15:25:22.933044+0000","last_fullsized":"2024-09-10T15:25:22.933044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924585+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:25:22.924585+0000","last_peered":"2024-09-10T15:25:22.924585+0000","last_clean":"2024-09-10T15:25:22.924585+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:25:22.924585+0000","last_undegraded":"2024-09-10T15:25:22.924585+0000","last_fullsized":"2024-09-10T15:25:22.924585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.880224+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:25:22.880224+0000","last_peered":"2024-09-10T15:25:22.880224+0000","last_clean":"2024-09-10T15:25:22.880224+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:25:22.880224+0000","last_undegraded":"2024-09-10T15:25:22.880224+0000","last_fullsized":"2024-09-10T15:25:22.880224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.609829+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:25:23.609829+0000","last_peered":"2024-09-10T15:25:23.609829+0000","last_clean":"2024-09-10T15:25:23.609829+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:25:23.609829+0000","last_undegraded":"2024-09-10T15:25:23.609829+0000","last_fullsized":"2024-09-10T15:25:23.609829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.165272+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:25:23.165272+0000","last_peered":"2024-09-10T15:25:23.165272+0000","last_clean":"2024-09-10T15:25:23.165272+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:25:23.165272+0000","last_undegraded":"2024-09-10T15:25:23.165272+0000","last_fullsized":"2024-09-10T15:25:23.165272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932215+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:25:22.932215+0000","last_peered":"2024-09-10T15:25:22.932215+0000","last_clean":"2024-09-10T15:25:22.932215+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:25:22.932215+0000","last_undegraded":"2024-09-10T15:25:22.932215+0000","last_fullsized":"2024-09-10T15:25:22.932215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.901135+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:25:22.901135+0000","last_peered":"2024-09-10T15:25:22.901135+0000","last_clean":"2024-09-10T15:25:22.901135+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:25:22.901135+0000","last_undegraded":"2024-09-10T15:25:22.901135+0000","last_fullsized":"2024-09-10T15:25:22.901135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890842+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:25:22.890842+0000","last_peered":"2024-09-10T15:25:22.890842+0000","last_clean":"2024-09-10T15:25:22.890842+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:25:22.890842+0000","last_undegraded":"2024-09-10T15:25:22.890842+0000","last_fullsized":"2024-09-10T15:25:22.890842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925827+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:25:22.925827+0000","last_peered":"2024-09-10T15:25:22.925827+0000","last_clean":"2024-09-10T15:25:22.925827+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:25:22.925827+0000","last_undegraded":"2024-09-10T15:25:22.925827+0000","last_fullsized":"2024-09-10T15:25:22.925827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.742095+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:25:23.742095+0000","last_peered":"2024-09-10T15:25:23.742095+0000","last_clean":"2024-09-10T15:25:23.742095+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:25:23.742095+0000","last_undegraded":"2024-09-10T15:25:23.742095+0000","last_fullsized":"2024-09-10T15:25:23.742095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934110+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:25:22.934110+0000","last_peered":"2024-09-10T15:25:22.934110+0000","last_clean":"2024-09-10T15:25:22.934110+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:25:22.934110+0000","last_undegraded":"2024-09-10T15:25:22.934110+0000","last_fullsized":"2024-09-10T15:25:22.934110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.898805+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:25:22.898805+0000","last_peered":"2024-09-10T15:25:22.898805+0000","last_clean":"2024-09-10T15:25:22.898805+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:25:22.898805+0000","last_undegraded":"2024-09-10T15:25:22.898805+0000","last_fullsized":"2024-09-10T15:25:22.898805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926109+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:25:22.926109+0000","last_peered":"2024-09-10T15:25:22.926109+0000","last_clean":"2024-09-10T15:25:22.926109+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:25:22.926109+0000","last_undegraded":"2024-09-10T15:25:22.926109+0000","last_fullsized":"2024-09-10T15:25:22.926109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877993+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:22.877993+0000","last_peered":"2024-09-10T15:25:22.877993+0000","last_clean":"2024-09-10T15:25:22.877993+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:22.877993+0000","last_undegraded":"2024-09-10T15:25:22.877993+0000","last_fullsized":"2024-09-10T15:25:22.877993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924731+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:22.924731+0000","last_peered":"2024-09-10T15:25:22.924731+0000","last_clean":"2024-09-10T15:25:22.924731+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:22.924731+0000","last_undegraded":"2024-09-10T15:25:22.924731+0000","last_fullsized":"2024-09-10T15:25:22.924731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891243+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:25:22.891243+0000","last_peered":"2024-09-10T15:25:22.891243+0000","last_clean":"2024-09-10T15:25:22.891243+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:25:22.891243+0000","last_undegraded":"2024-09-10T15:25:22.891243+0000","last_fullsized":"2024-09-10T15:25:22.891243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886273+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:25:22.886273+0000","last_peered":"2024-09-10T15:25:22.886273+0000","last_clean":"2024-09-10T15:25:22.886273+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:25:22.886273+0000","last_undegraded":"2024-09-10T15:25:22.886273+0000","last_fullsized":"2024-09-10T15:25:22.886273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.536210+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:25:23.536210+0000","last_peered":"2024-09-10T15:25:23.536210+0000","last_clean":"2024-09-10T15:25:23.536210+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:25:23.536210+0000","last_undegraded":"2024-09-10T15:25:23.536210+0000","last_fullsized":"2024-09-10T15:25:23.536210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879476+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:25:22.879476+0000","last_peered":"2024-09-10T15:25:22.879476+0000","last_clean":"2024-09-10T15:25:22.879476+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:25:22.879476+0000","last_undegraded":"2024-09-10T15:25:22.879476+0000","last_fullsized":"2024-09-10T15:25:22.879476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887107+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:25:22.887107+0000","last_peered":"2024-09-10T15:25:22.887107+0000","last_clean":"2024-09-10T15:25:22.887107+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:25:22.887107+0000","last_undegraded":"2024-09-10T15:25:22.887107+0000","last_fullsized":"2024-09-10T15:25:22.887107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879724+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:25:22.879724+0000","last_peered":"2024-09-10T15:25:22.879724+0000","last_clean":"2024-09-10T15:25:22.879724+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:25:22.879724+0000","last_undegraded":"2024-09-10T15:25:22.879724+0000","last_fullsized":"2024-09-10T15:25:22.879724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924387+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:22.924387+0000","last_peered":"2024-09-10T15:25:22.924387+0000","last_clean":"2024-09-10T15:25:22.924387+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:22.924387+0000","last_undegraded":"2024-09-10T15:25:22.924387+0000","last_fullsized":"2024-09-10T15:25:22.924387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910185+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:25:22.910185+0000","last_peered":"2024-09-10T15:25:22.910185+0000","last_clean":"2024-09-10T15:25:22.910185+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:25:22.910185+0000","last_undegraded":"2024-09-10T15:25:22.910185+0000","last_fullsized":"2024-09-10T15:25:22.910185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925031+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:25:22.925031+0000","last_peered":"2024-09-10T15:25:22.925031+0000","last_clean":"2024-09-10T15:25:22.925031+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:25:22.925031+0000","last_undegraded":"2024-09-10T15:25:22.925031+0000","last_fullsized":"2024-09-10T15:25:22.925031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.731288+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:25:23.731288+0000","last_peered":"2024-09-10T15:25:23.731288+0000","last_clean":"2024-09-10T15:25:23.731288+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:25:23.731288+0000","last_undegraded":"2024-09-10T15:25:23.731288+0000","last_fullsized":"2024-09-10T15:25:23.731288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926807+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:25:22.926807+0000","last_peered":"2024-09-10T15:25:22.926807+0000","last_clean":"2024-09-10T15:25:22.926807+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:25:22.926807+0000","last_undegraded":"2024-09-10T15:25:22.926807+0000","last_fullsized":"2024-09-10T15:25:22.926807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877741+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:25:22.877741+0000","last_peered":"2024-09-10T15:25:22.877741+0000","last_clean":"2024-09-10T15:25:22.877741+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:25:22.877741+0000","last_undegraded":"2024-09-10T15:25:22.877741+0000","last_fullsized":"2024-09-10T15:25:22.877741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.912341+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:25:22.912341+0000","last_peered":"2024-09-10T15:25:22.912341+0000","last_clean":"2024-09-10T15:25:22.912341+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:25:22.912341+0000","last_undegraded":"2024-09-10T15:25:22.912341+0000","last_fullsized":"2024-09-10T15:25:22.912341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897813+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:22.897813+0000","last_peered":"2024-09-10T15:25:22.897813+0000","last_clean":"2024-09-10T15:25:22.897813+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:22.897813+0000","last_undegraded":"2024-09-10T15:25:22.897813+0000","last_fullsized":"2024-09-10T15:25:22.897813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879076+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:25:22.879076+0000","last_peered":"2024-09-10T15:25:22.879076+0000","last_clean":"2024-09-10T15:25:22.879076+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:25:22.879076+0000","last_undegraded":"2024-09-10T15:25:22.879076+0000","last_fullsized":"2024-09-10T15:25:22.879076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900615+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:25:22.900615+0000","last_peered":"2024-09-10T15:25:22.900615+0000","last_clean":"2024-09-10T15:25:22.900615+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:25:22.900615+0000","last_undegraded":"2024-09-10T15:25:22.900615+0000","last_fullsized":"2024-09-10T15:25:22.900615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.738599+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:25:23.738599+0000","last_peered":"2024-09-10T15:25:23.738599+0000","last_clean":"2024-09-10T15:25:23.738599+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:25:23.738599+0000","last_undegraded":"2024-09-10T15:25:23.738599+0000","last_fullsized":"2024-09-10T15:25:23.738599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890873+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:25:22.890873+0000","last_peered":"2024-09-10T15:25:22.890873+0000","last_clean":"2024-09-10T15:25:22.890873+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:25:22.890873+0000","last_undegraded":"2024-09-10T15:25:22.890873+0000","last_fullsized":"2024-09-10T15:25:22.890873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890091+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:25:22.890091+0000","last_peered":"2024-09-10T15:25:22.890091+0000","last_clean":"2024-09-10T15:25:22.890091+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:25:22.890091+0000","last_undegraded":"2024-09-10T15:25:22.890091+0000","last_fullsized":"2024-09-10T15:25:22.890091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910792+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:25:22.910792+0000","last_peered":"2024-09-10T15:25:22.910792+0000","last_clean":"2024-09-10T15:25:22.910792+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:25:22.910792+0000","last_undegraded":"2024-09-10T15:25:22.910792+0000","last_fullsized":"2024-09-10T15:25:22.910792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925279+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:22.925279+0000","last_peered":"2024-09-10T15:25:22.925279+0000","last_clean":"2024-09-10T15:25:22.925279+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:22.925279+0000","last_undegraded":"2024-09-10T15:25:22.925279+0000","last_fullsized":"2024-09-10T15:25:22.925279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886882+0000","last_change":"2024-09-10T15:25:11.842227+0000","last_active":"2024-09-10T15:25:22.886882+0000","last_peered":"2024-09-10T15:25:22.886882+0000","last_clean":"2024-09-10T15:25:22.886882+0000","last_became_active":"2024-09-10T15:25:11.841833+0000","last_became_peered":"2024-09-10T15:25:11.841833+0000","last_unstale":"2024-09-10T15:25:22.886882+0000","last_undegraded":"2024-09-10T15:25:22.886882+0000","last_fullsized":"2024-09-10T15:25:22.886882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900092+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:25:22.900092+0000","last_peered":"2024-09-10T15:25:22.900092+0000","last_clean":"2024-09-10T15:25:22.900092+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:25:22.900092+0000","last_undegraded":"2024-09-10T15:25:22.900092+0000","last_fullsized":"2024-09-10T15:25:22.900092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.571869+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:25:23.571869+0000","last_peered":"2024-09-10T15:25:23.571869+0000","last_clean":"2024-09-10T15:25:23.571869+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:25:23.571869+0000","last_undegraded":"2024-09-10T15:25:23.571869+0000","last_fullsized":"2024-09-10T15:25:23.571869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925770+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:25:22.925770+0000","last_peered":"2024-09-10T15:25:22.925770+0000","last_clean":"2024-09-10T15:25:22.925770+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:25:22.925770+0000","last_undegraded":"2024-09-10T15:25:22.925770+0000","last_fullsized":"2024-09-10T15:25:22.925770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877092+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:25:22.877092+0000","last_peered":"2024-09-10T15:25:22.877092+0000","last_clean":"2024-09-10T15:25:22.877092+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:25:22.877092+0000","last_undegraded":"2024-09-10T15:25:22.877092+0000","last_fullsized":"2024-09-10T15:25:22.877092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910315+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:25:22.910315+0000","last_peered":"2024-09-10T15:25:22.910315+0000","last_clean":"2024-09-10T15:25:22.910315+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:25:22.910315+0000","last_undegraded":"2024-09-10T15:25:22.910315+0000","last_fullsized":"2024-09-10T15:25:22.910315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933486+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:25:22.933486+0000","last_peered":"2024-09-10T15:25:22.933486+0000","last_clean":"2024-09-10T15:25:22.933486+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:25:22.933486+0000","last_undegraded":"2024-09-10T15:25:22.933486+0000","last_fullsized":"2024-09-10T15:25:22.933486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879609+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:22.879609+0000","last_peered":"2024-09-10T15:25:22.879609+0000","last_clean":"2024-09-10T15:25:22.879609+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:22.879609+0000","last_undegraded":"2024-09-10T15:25:22.879609+0000","last_fullsized":"2024-09-10T15:25:22.879609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891139+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:25:22.891139+0000","last_peered":"2024-09-10T15:25:22.891139+0000","last_clean":"2024-09-10T15:25:22.891139+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:25:22.891139+0000","last_undegraded":"2024-09-10T15:25:22.891139+0000","last_fullsized":"2024-09-10T15:25:22.891139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.665989+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:25:23.665989+0000","last_peered":"2024-09-10T15:25:23.665989+0000","last_clean":"2024-09-10T15:25:23.665989+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:25:23.665989+0000","last_undegraded":"2024-09-10T15:25:23.665989+0000","last_fullsized":"2024-09-10T15:25:23.665989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931849+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:25:22.931849+0000","last_peered":"2024-09-10T15:25:22.931849+0000","last_clean":"2024-09-10T15:25:22.931849+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:25:22.931849+0000","last_undegraded":"2024-09-10T15:25:22.931849+0000","last_fullsized":"2024-09-10T15:25:22.931849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879264+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:25:22.879264+0000","last_peered":"2024-09-10T15:25:22.879264+0000","last_clean":"2024-09-10T15:25:22.879264+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:25:22.879264+0000","last_undegraded":"2024-09-10T15:25:22.879264+0000","last_fullsized":"2024-09-10T15:25:22.879264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911688+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:25:22.911688+0000","last_peered":"2024-09-10T15:25:22.911688+0000","last_clean":"2024-09-10T15:25:22.911688+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:25:22.911688+0000","last_undegraded":"2024-09-10T15:25:22.911688+0000","last_fullsized":"2024-09-10T15:25:22.911688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911092+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:25:22.911092+0000","last_peered":"2024-09-10T15:25:22.911092+0000","last_clean":"2024-09-10T15:25:22.911092+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:25:22.911092+0000","last_undegraded":"2024-09-10T15:25:22.911092+0000","last_fullsized":"2024-09-10T15:25:22.911092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924855+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:22.924855+0000","last_peered":"2024-09-10T15:25:22.924855+0000","last_clean":"2024-09-10T15:25:22.924855+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:22.924855+0000","last_undegraded":"2024-09-10T15:25:22.924855+0000","last_fullsized":"2024-09-10T15:25:22.924855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886036+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:25:22.886036+0000","last_peered":"2024-09-10T15:25:22.886036+0000","last_clean":"2024-09-10T15:25:22.886036+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:25:22.886036+0000","last_undegraded":"2024-09-10T15:25:22.886036+0000","last_fullsized":"2024-09-10T15:25:22.886036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.761546+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:25:23.761546+0000","last_peered":"2024-09-10T15:25:23.761546+0000","last_clean":"2024-09-10T15:25:23.761546+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:25:23.761546+0000","last_undegraded":"2024-09-10T15:25:23.761546+0000","last_fullsized":"2024-09-10T15:25:23.761546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.165201+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:25:23.165201+0000","last_peered":"2024-09-10T15:25:23.165201+0000","last_clean":"2024-09-10T15:25:23.165201+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:25:23.165201+0000","last_undegraded":"2024-09-10T15:25:23.165201+0000","last_fullsized":"2024-09-10T15:25:23.165201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900666+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:25:22.900666+0000","last_peered":"2024-09-10T15:25:22.900666+0000","last_clean":"2024-09-10T15:25:22.900666+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:25:22.900666+0000","last_undegraded":"2024-09-10T15:25:22.900666+0000","last_fullsized":"2024-09-10T15:25:22.900666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890605+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:25:22.890605+0000","last_peered":"2024-09-10T15:25:22.890605+0000","last_clean":"2024-09-10T15:25:22.890605+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:25:22.890605+0000","last_undegraded":"2024-09-10T15:25:22.890605+0000","last_fullsized":"2024-09-10T15:25:22.890605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.893252+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:25:22.893252+0000","last_peered":"2024-09-10T15:25:22.893252+0000","last_clean":"2024-09-10T15:25:22.893252+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:25:22.893252+0000","last_undegraded":"2024-09-10T15:25:22.893252+0000","last_fullsized":"2024-09-10T15:25:22.893252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892884+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:22.892884+0000","last_peered":"2024-09-10T15:25:22.892884+0000","last_clean":"2024-09-10T15:25:22.892884+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:22.892884+0000","last_undegraded":"2024-09-10T15:25:22.892884+0000","last_fullsized":"2024-09-10T15:25:22.892884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924049+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:25:22.924049+0000","last_peered":"2024-09-10T15:25:22.924049+0000","last_clean":"2024-09-10T15:25:22.924049+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:25:22.924049+0000","last_undegraded":"2024-09-10T15:25:22.924049+0000","last_fullsized":"2024-09-10T15:25:22.924049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.721415+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:25:23.721415+0000","last_peered":"2024-09-10T15:25:23.721415+0000","last_clean":"2024-09-10T15:25:23.721415+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:25:23.721415+0000","last_undegraded":"2024-09-10T15:25:23.721415+0000","last_fullsized":"2024-09-10T15:25:23.721415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.167114+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:25:23.167114+0000","last_peered":"2024-09-10T15:25:23.167114+0000","last_clean":"2024-09-10T15:25:23.167114+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:25:23.167114+0000","last_undegraded":"2024-09-10T15:25:23.167114+0000","last_fullsized":"2024-09-10T15:25:23.167114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878591+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:25:22.878591+0000","last_peered":"2024-09-10T15:25:22.878591+0000","last_clean":"2024-09-10T15:25:22.878591+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:25:22.878591+0000","last_undegraded":"2024-09-10T15:25:22.878591+0000","last_fullsized":"2024-09-10T15:25:22.878591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932133+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:25:22.932133+0000","last_peered":"2024-09-10T15:25:22.932133+0000","last_clean":"2024-09-10T15:25:22.932133+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:25:22.932133+0000","last_undegraded":"2024-09-10T15:25:22.932133+0000","last_fullsized":"2024-09-10T15:25:22.932133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892683+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:25:22.892683+0000","last_peered":"2024-09-10T15:25:22.892683+0000","last_clean":"2024-09-10T15:25:22.892683+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:25:22.892683+0000","last_undegraded":"2024-09-10T15:25:22.892683+0000","last_fullsized":"2024-09-10T15:25:22.892683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925913+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:22.925913+0000","last_peered":"2024-09-10T15:25:22.925913+0000","last_clean":"2024-09-10T15:25:22.925913+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:22.925913+0000","last_undegraded":"2024-09-10T15:25:22.925913+0000","last_fullsized":"2024-09-10T15:25:22.925913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889598+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:25:22.889598+0000","last_peered":"2024-09-10T15:25:22.889598+0000","last_clean":"2024-09-10T15:25:22.889598+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:25:22.889598+0000","last_undegraded":"2024-09-10T15:25:22.889598+0000","last_fullsized":"2024-09-10T15:25:22.889598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.701114+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:25:23.701114+0000","last_peered":"2024-09-10T15:25:23.701114+0000","last_clean":"2024-09-10T15:25:23.701114+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:25:23.701114+0000","last_undegraded":"2024-09-10T15:25:23.701114+0000","last_fullsized":"2024-09-10T15:25:23.701114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890995+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:25:22.890995+0000","last_peered":"2024-09-10T15:25:22.890995+0000","last_clean":"2024-09-10T15:25:22.890995+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:25:22.890995+0000","last_undegraded":"2024-09-10T15:25:22.890995+0000","last_fullsized":"2024-09-10T15:25:22.890995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933330+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:25:22.933330+0000","last_peered":"2024-09-10T15:25:22.933330+0000","last_clean":"2024-09-10T15:25:22.933330+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:25:22.933330+0000","last_undegraded":"2024-09-10T15:25:22.933330+0000","last_fullsized":"2024-09-10T15:25:22.933330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892751+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:25:22.892751+0000","last_peered":"2024-09-10T15:25:22.892751+0000","last_clean":"2024-09-10T15:25:22.892751+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:25:22.892751+0000","last_undegraded":"2024-09-10T15:25:22.892751+0000","last_fullsized":"2024-09-10T15:25:22.892751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933136+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:25:22.933136+0000","last_peered":"2024-09-10T15:25:22.933136+0000","last_clean":"2024-09-10T15:25:22.933136+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:25:22.933136+0000","last_undegraded":"2024-09-10T15:25:22.933136+0000","last_fullsized":"2024-09-10T15:25:22.933136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925355+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:25:22.925355+0000","last_peered":"2024-09-10T15:25:22.925355+0000","last_clean":"2024-09-10T15:25:22.925355+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:25:22.925355+0000","last_undegraded":"2024-09-10T15:25:22.925355+0000","last_fullsized":"2024-09-10T15:25:22.925355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910400+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:25:22.910400+0000","last_peered":"2024-09-10T15:25:22.910400+0000","last_clean":"2024-09-10T15:25:22.910400+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:25:22.910400+0000","last_undegraded":"2024-09-10T15:25:22.910400+0000","last_fullsized":"2024-09-10T15:25:22.910400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.770956+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:25:23.770956+0000","last_peered":"2024-09-10T15:25:23.770956+0000","last_clean":"2024-09-10T15:25:23.770956+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:25:23.770956+0000","last_undegraded":"2024-09-10T15:25:23.770956+0000","last_fullsized":"2024-09-10T15:25:23.770956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897472+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:25:22.897472+0000","last_peered":"2024-09-10T15:25:22.897472+0000","last_clean":"2024-09-10T15:25:22.897472+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:25:22.897472+0000","last_undegraded":"2024-09-10T15:25:22.897472+0000","last_fullsized":"2024-09-10T15:25:22.897472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900522+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:25:22.900522+0000","last_peered":"2024-09-10T15:25:22.900522+0000","last_clean":"2024-09-10T15:25:22.900522+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:25:22.900522+0000","last_undegraded":"2024-09-10T15:25:22.900522+0000","last_fullsized":"2024-09-10T15:25:22.900522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890369+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:25:22.890369+0000","last_peered":"2024-09-10T15:25:22.890369+0000","last_clean":"2024-09-10T15:25:22.890369+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:25:22.890369+0000","last_undegraded":"2024-09-10T15:25:22.890369+0000","last_fullsized":"2024-09-10T15:25:22.890369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887915+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:25:22.887915+0000","last_peered":"2024-09-10T15:25:22.887915+0000","last_clean":"2024-09-10T15:25:22.887915+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:25:22.887915+0000","last_undegraded":"2024-09-10T15:25:22.887915+0000","last_fullsized":"2024-09-10T15:25:22.887915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890606+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:25:22.890606+0000","last_peered":"2024-09-10T15:25:22.890606+0000","last_clean":"2024-09-10T15:25:22.890606+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:25:22.890606+0000","last_undegraded":"2024-09-10T15:25:22.890606+0000","last_fullsized":"2024-09-10T15:25:22.890606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.240298+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:25:23.240298+0000","last_peered":"2024-09-10T15:25:23.240298+0000","last_clean":"2024-09-10T15:25:23.240298+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:25:23.240298+0000","last_undegraded":"2024-09-10T15:25:23.240298+0000","last_fullsized":"2024-09-10T15:25:23.240298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931777+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:25:22.931777+0000","last_peered":"2024-09-10T15:25:22.931777+0000","last_clean":"2024-09-10T15:25:22.931777+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:25:22.931777+0000","last_undegraded":"2024-09-10T15:25:22.931777+0000","last_fullsized":"2024-09-10T15:25:22.931777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910916+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:25:22.910916+0000","last_peered":"2024-09-10T15:25:22.910916+0000","last_clean":"2024-09-10T15:25:22.910916+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:25:22.910916+0000","last_undegraded":"2024-09-10T15:25:22.910916+0000","last_fullsized":"2024-09-10T15:25:22.910916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889910+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:25:22.889910+0000","last_peered":"2024-09-10T15:25:22.889910+0000","last_clean":"2024-09-10T15:25:22.889910+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:25:22.889910+0000","last_undegraded":"2024-09-10T15:25:22.889910+0000","last_fullsized":"2024-09-10T15:25:22.889910+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934095+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:25:22.934095+0000","last_peered":"2024-09-10T15:25:22.934095+0000","last_clean":"2024-09-10T15:25:22.934095+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:25:22.934095+0000","last_undegraded":"2024-09-10T15:25:22.934095+0000","last_fullsized":"2024-09-10T15:25:22.934095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931468+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:25:22.931468+0000","last_peered":"2024-09-10T15:25:22.931468+0000","last_clean":"2024-09-10T15:25:22.931468+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:25:22.931468+0000","last_undegraded":"2024-09-10T15:25:22.931468+0000","last_fullsized":"2024-09-10T15:25:22.931468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.679798+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:25:23.679798+0000","last_peered":"2024-09-10T15:25:23.679798+0000","last_clean":"2024-09-10T15:25:23.679798+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:25:23.679798+0000","last_undegraded":"2024-09-10T15:25:23.679798+0000","last_fullsized":"2024-09-10T15:25:23.679798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878498+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:25:22.878498+0000","last_peered":"2024-09-10T15:25:22.878498+0000","last_clean":"2024-09-10T15:25:22.878498+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:25:22.878498+0000","last_undegraded":"2024-09-10T15:25:22.878498+0000","last_fullsized":"2024-09-10T15:25:22.878498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924649+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:25:22.924649+0000","last_peered":"2024-09-10T15:25:22.924649+0000","last_clean":"2024-09-10T15:25:22.924649+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:25:22.924649+0000","last_undegraded":"2024-09-10T15:25:22.924649+0000","last_fullsized":"2024-09-10T15:25:22.924649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897685+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:25:22.897685+0000","last_peered":"2024-09-10T15:25:22.897685+0000","last_clean":"2024-09-10T15:25:22.897685+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:25:22.897685+0000","last_undegraded":"2024-09-10T15:25:22.897685+0000","last_fullsized":"2024-09-10T15:25:22.897685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879965+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:25:22.879965+0000","last_peered":"2024-09-10T15:25:22.879965+0000","last_clean":"2024-09-10T15:25:22.879965+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:25:22.879965+0000","last_undegraded":"2024-09-10T15:25:22.879965+0000","last_fullsized":"2024-09-10T15:25:22.879965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923780+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:25:22.923780+0000","last_peered":"2024-09-10T15:25:22.923780+0000","last_clean":"2024-09-10T15:25:22.923780+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:25:22.923780+0000","last_undegraded":"2024-09-10T15:25:22.923780+0000","last_fullsized":"2024-09-10T15:25:22.923780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.452288+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:25:23.452288+0000","last_peered":"2024-09-10T15:25:23.452288+0000","last_clean":"2024-09-10T15:25:23.452288+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:25:23.452288+0000","last_undegraded":"2024-09-10T15:25:23.452288+0000","last_fullsized":"2024-09-10T15:25:23.452288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.898924+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:25:22.898924+0000","last_peered":"2024-09-10T15:25:22.898924+0000","last_clean":"2024-09-10T15:25:22.898924+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:25:22.898924+0000","last_undegraded":"2024-09-10T15:25:22.898924+0000","last_fullsized":"2024-09-10T15:25:22.898924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925283+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:25:22.925283+0000","last_peered":"2024-09-10T15:25:22.925283+0000","last_clean":"2024-09-10T15:25:22.925283+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:25:22.925283+0000","last_undegraded":"2024-09-10T15:25:22.925283+0000","last_fullsized":"2024-09-10T15:25:22.925283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878123+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:25:22.878123+0000","last_peered":"2024-09-10T15:25:22.878123+0000","last_clean":"2024-09-10T15:25:22.878123+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:25:22.878123+0000","last_undegraded":"2024-09-10T15:25:22.878123+0000","last_fullsized":"2024-09-10T15:25:22.878123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.912234+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:25:22.912234+0000","last_peered":"2024-09-10T15:25:22.912234+0000","last_clean":"2024-09-10T15:25:22.912234+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:25:22.912234+0000","last_undegraded":"2024-09-10T15:25:22.912234+0000","last_fullsized":"2024-09-10T15:25:22.912234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.799473+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:25:23.799473+0000","last_peered":"2024-09-10T15:25:23.799473+0000","last_clean":"2024-09-10T15:25:23.799473+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:25:23.799473+0000","last_undegraded":"2024-09-10T15:25:23.799473+0000","last_fullsized":"2024-09-10T15:25:23.799473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933356+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:25:22.933356+0000","last_peered":"2024-09-10T15:25:22.933356+0000","last_clean":"2024-09-10T15:25:22.933356+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:25:22.933356+0000","last_undegraded":"2024-09-10T15:25:22.933356+0000","last_fullsized":"2024-09-10T15:25:22.933356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877814+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:25:22.877814+0000","last_peered":"2024-09-10T15:25:22.877814+0000","last_clean":"2024-09-10T15:25:22.877814+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:25:22.877814+0000","last_undegraded":"2024-09-10T15:25:22.877814+0000","last_fullsized":"2024-09-10T15:25:22.877814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892652+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:25:22.892652+0000","last_peered":"2024-09-10T15:25:22.892652+0000","last_clean":"2024-09-10T15:25:22.892652+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:25:22.892652+0000","last_undegraded":"2024-09-10T15:25:22.892652+0000","last_fullsized":"2024-09-10T15:25:22.892652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890630+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:25:22.890630+0000","last_peered":"2024-09-10T15:25:22.890630+0000","last_clean":"2024-09-10T15:25:22.890630+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:25:22.890630+0000","last_undegraded":"2024-09-10T15:25:22.890630+0000","last_fullsized":"2024-09-10T15:25:22.890630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933432+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:25:22.933432+0000","last_peered":"2024-09-10T15:25:22.933432+0000","last_clean":"2024-09-10T15:25:22.933432+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:25:22.933432+0000","last_undegraded":"2024-09-10T15:25:22.933432+0000","last_fullsized":"2024-09-10T15:25:22.933432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.581939+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:25:23.581939+0000","last_peered":"2024-09-10T15:25:23.581939+0000","last_clean":"2024-09-10T15:25:23.581939+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:25:23.581939+0000","last_undegraded":"2024-09-10T15:25:23.581939+0000","last_fullsized":"2024-09-10T15:25:23.581939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878154+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:25:22.878154+0000","last_peered":"2024-09-10T15:25:22.878154+0000","last_clean":"2024-09-10T15:25:22.878154+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:25:22.878154+0000","last_undegraded":"2024-09-10T15:25:22.878154+0000","last_fullsized":"2024-09-10T15:25:22.878154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925336+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:25:22.925336+0000","last_peered":"2024-09-10T15:25:22.925336+0000","last_clean":"2024-09-10T15:25:22.925336+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:25:22.925336+0000","last_undegraded":"2024-09-10T15:25:22.925336+0000","last_fullsized":"2024-09-10T15:25:22.925336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900159+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:25:22.900159+0000","last_peered":"2024-09-10T15:25:22.900159+0000","last_clean":"2024-09-10T15:25:22.900159+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:25:22.900159+0000","last_undegraded":"2024-09-10T15:25:22.900159+0000","last_fullsized":"2024-09-10T15:25:22.900159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879052+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:25:22.879052+0000","last_peered":"2024-09-10T15:25:22.879052+0000","last_clean":"2024-09-10T15:25:22.879052+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:25:22.879052+0000","last_undegraded":"2024-09-10T15:25:22.879052+0000","last_fullsized":"2024-09-10T15:25:22.879052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933772+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:25:22.933772+0000","last_peered":"2024-09-10T15:25:22.933772+0000","last_clean":"2024-09-10T15:25:22.933772+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:25:22.933772+0000","last_undegraded":"2024-09-10T15:25:22.933772+0000","last_fullsized":"2024-09-10T15:25:22.933772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.778274+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:25:23.778274+0000","last_peered":"2024-09-10T15:25:23.778274+0000","last_clean":"2024-09-10T15:25:23.778274+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:25:23.778274+0000","last_undegraded":"2024-09-10T15:25:23.778274+0000","last_fullsized":"2024-09-10T15:25:23.778274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900189+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:25:22.900189+0000","last_peered":"2024-09-10T15:25:22.900189+0000","last_clean":"2024-09-10T15:25:22.900189+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:25:22.900189+0000","last_undegraded":"2024-09-10T15:25:22.900189+0000","last_fullsized":"2024-09-10T15:25:22.900189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923799+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:25:22.923799+0000","last_peered":"2024-09-10T15:25:22.923799+0000","last_clean":"2024-09-10T15:25:22.923799+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:25:22.923799+0000","last_undegraded":"2024-09-10T15:25:22.923799+0000","last_fullsized":"2024-09-10T15:25:22.923799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891509+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:25:22.891509+0000","last_peered":"2024-09-10T15:25:22.891509+0000","last_clean":"2024-09-10T15:25:22.891509+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:25:22.891509+0000","last_undegraded":"2024-09-10T15:25:22.891509+0000","last_fullsized":"2024-09-10T15:25:22.891509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891824+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:25:22.891824+0000","last_peered":"2024-09-10T15:25:22.891824+0000","last_clean":"2024-09-10T15:25:22.891824+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:25:22.891824+0000","last_undegraded":"2024-09-10T15:25:22.891824+0000","last_fullsized":"2024-09-10T15:25:22.891824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891200+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:25:22.891200+0000","last_peered":"2024-09-10T15:25:22.891200+0000","last_clean":"2024-09-10T15:25:22.891200+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:25:22.891200+0000","last_undegraded":"2024-09-10T15:25:22.891200+0000","last_fullsized":"2024-09-10T15:25:22.891200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.755577+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:25:23.755577+0000","last_peered":"2024-09-10T15:25:23.755577+0000","last_clean":"2024-09-10T15:25:23.755577+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:25:23.755577+0000","last_undegraded":"2024-09-10T15:25:23.755577+0000","last_fullsized":"2024-09-10T15:25:23.755577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.165940+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:25:23.165940+0000","last_peered":"2024-09-10T15:25:23.165940+0000","last_clean":"2024-09-10T15:25:23.165940+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:25:23.165940+0000","last_undegraded":"2024-09-10T15:25:23.165940+0000","last_fullsized":"2024-09-10T15:25:23.165940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923566+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:25:22.923566+0000","last_peered":"2024-09-10T15:25:22.923566+0000","last_clean":"2024-09-10T15:25:22.923566+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:25:22.923566+0000","last_undegraded":"2024-09-10T15:25:22.923566+0000","last_fullsized":"2024-09-10T15:25:22.923566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933039+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:25:22.933039+0000","last_peered":"2024-09-10T15:25:22.933039+0000","last_clean":"2024-09-10T15:25:22.933039+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:25:22.933039+0000","last_undegraded":"2024-09-10T15:25:22.933039+0000","last_fullsized":"2024-09-10T15:25:22.933039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879650+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:25:22.879650+0000","last_peered":"2024-09-10T15:25:22.879650+0000","last_clean":"2024-09-10T15:25:22.879650+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:25:22.879650+0000","last_undegraded":"2024-09-10T15:25:22.879650+0000","last_fullsized":"2024-09-10T15:25:22.879650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878490+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:25:22.878490+0000","last_peered":"2024-09-10T15:25:22.878490+0000","last_clean":"2024-09-10T15:25:22.878490+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:25:22.878490+0000","last_undegraded":"2024-09-10T15:25:22.878490+0000","last_fullsized":"2024-09-10T15:25:22.878490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.792217+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:25:23.792217+0000","last_peered":"2024-09-10T15:25:23.792217+0000","last_clean":"2024-09-10T15:25:23.792217+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:25:23.792217+0000","last_undegraded":"2024-09-10T15:25:23.792217+0000","last_fullsized":"2024-09-10T15:25:23.792217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889725+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:25:22.889725+0000","last_peered":"2024-09-10T15:25:22.889725+0000","last_clean":"2024-09-10T15:25:22.889725+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:25:22.889725+0000","last_undegraded":"2024-09-10T15:25:22.889725+0000","last_fullsized":"2024-09-10T15:25:22.889725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879864+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:25:22.879864+0000","last_peered":"2024-09-10T15:25:22.879864+0000","last_clean":"2024-09-10T15:25:22.879864+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:25:22.879864+0000","last_undegraded":"2024-09-10T15:25:22.879864+0000","last_fullsized":"2024-09-10T15:25:22.879864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932059+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:25:22.932059+0000","last_peered":"2024-09-10T15:25:22.932059+0000","last_clean":"2024-09-10T15:25:22.932059+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:25:22.932059+0000","last_undegraded":"2024-09-10T15:25:22.932059+0000","last_fullsized":"2024-09-10T15:25:22.932059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926116+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:25:22.926116+0000","last_peered":"2024-09-10T15:25:22.926116+0000","last_clean":"2024-09-10T15:25:22.926116+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:25:22.926116+0000","last_undegraded":"2024-09-10T15:25:22.926116+0000","last_fullsized":"2024-09-10T15:25:22.926116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932846+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:25:22.932846+0000","last_peered":"2024-09-10T15:25:22.932846+0000","last_clean":"2024-09-10T15:25:22.932846+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:25:22.932846+0000","last_undegraded":"2024-09-10T15:25:22.932846+0000","last_fullsized":"2024-09-10T15:25:22.932846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.191933+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:25:23.191933+0000","last_peered":"2024-09-10T15:25:23.191933+0000","last_clean":"2024-09-10T15:25:23.191933+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:25:23.191933+0000","last_undegraded":"2024-09-10T15:25:23.191933+0000","last_fullsized":"2024-09-10T15:25:23.191933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924093+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:25:22.924093+0000","last_peered":"2024-09-10T15:25:22.924093+0000","last_clean":"2024-09-10T15:25:22.924093+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:25:22.924093+0000","last_undegraded":"2024-09-10T15:25:22.924093+0000","last_fullsized":"2024-09-10T15:25:22.924093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878776+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:25:22.878776+0000","last_peered":"2024-09-10T15:25:22.878776+0000","last_clean":"2024-09-10T15:25:22.878776+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:25:22.878776+0000","last_undegraded":"2024-09-10T15:25:22.878776+0000","last_fullsized":"2024-09-10T15:25:22.878776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897657+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:25:22.897657+0000","last_peered":"2024-09-10T15:25:22.897657+0000","last_clean":"2024-09-10T15:25:22.897657+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:25:22.897657+0000","last_undegraded":"2024-09-10T15:25:22.897657+0000","last_fullsized":"2024-09-10T15:25:22.897657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879966+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:25:22.879966+0000","last_peered":"2024-09-10T15:25:22.879966+0000","last_clean":"2024-09-10T15:25:22.879966+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:25:22.879966+0000","last_undegraded":"2024-09-10T15:25:22.879966+0000","last_fullsized":"2024-09-10T15:25:22.879966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877253+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:25:22.877253+0000","last_peered":"2024-09-10T15:25:22.877253+0000","last_clean":"2024-09-10T15:25:22.877253+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:25:22.877253+0000","last_undegraded":"2024-09-10T15:25:22.877253+0000","last_fullsized":"2024-09-10T15:25:22.877253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.404148+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:25:23.404148+0000","last_peered":"2024-09-10T15:25:23.404148+0000","last_clean":"2024-09-10T15:25:23.404148+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:25:23.404148+0000","last_undegraded":"2024-09-10T15:25:23.404148+0000","last_fullsized":"2024-09-10T15:25:23.404148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923853+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:25:22.923853+0000","last_peered":"2024-09-10T15:25:22.923853+0000","last_clean":"2024-09-10T15:25:22.923853+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:25:22.923853+0000","last_undegraded":"2024-09-10T15:25:22.923853+0000","last_fullsized":"2024-09-10T15:25:22.923853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925658+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:25:22.925658+0000","last_peered":"2024-09-10T15:25:22.925658+0000","last_clean":"2024-09-10T15:25:22.925658+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:25:22.925658+0000","last_undegraded":"2024-09-10T15:25:22.925658+0000","last_fullsized":"2024-09-10T15:25:22.925658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931593+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:25:22.931593+0000","last_peered":"2024-09-10T15:25:22.931593+0000","last_clean":"2024-09-10T15:25:22.931593+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:25:22.931593+0000","last_undegraded":"2024-09-10T15:25:22.931593+0000","last_fullsized":"2024-09-10T15:25:22.931593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879732+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:25:22.879732+0000","last_peered":"2024-09-10T15:25:22.879732+0000","last_clean":"2024-09-10T15:25:22.879732+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:25:22.879732+0000","last_undegraded":"2024-09-10T15:25:22.879732+0000","last_fullsized":"2024-09-10T15:25:22.879732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889526+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:25:22.889526+0000","last_peered":"2024-09-10T15:25:22.889526+0000","last_clean":"2024-09-10T15:25:22.889526+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:25:22.889526+0000","last_undegraded":"2024-09-10T15:25:22.889526+0000","last_fullsized":"2024-09-10T15:25:22.889526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.475271+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:25:23.475271+0000","last_peered":"2024-09-10T15:25:23.475271+0000","last_clean":"2024-09-10T15:25:23.475271+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:25:23.475271+0000","last_undegraded":"2024-09-10T15:25:23.475271+0000","last_fullsized":"2024-09-10T15:25:23.475271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891446+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:25:22.891446+0000","last_peered":"2024-09-10T15:25:22.891446+0000","last_clean":"2024-09-10T15:25:22.891446+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:25:22.891446+0000","last_undegraded":"2024-09-10T15:25:22.891446+0000","last_fullsized":"2024-09-10T15:25:22.891446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887714+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:25:22.887714+0000","last_peered":"2024-09-10T15:25:22.887714+0000","last_clean":"2024-09-10T15:25:22.887714+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:25:22.887714+0000","last_undegraded":"2024-09-10T15:25:22.887714+0000","last_fullsized":"2024-09-10T15:25:22.887714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.893112+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:25:22.893112+0000","last_peered":"2024-09-10T15:25:22.893112+0000","last_clean":"2024-09-10T15:25:22.893112+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:25:22.893112+0000","last_undegraded":"2024-09-10T15:25:22.893112+0000","last_fullsized":"2024-09-10T15:25:22.893112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931919+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:25:22.931919+0000","last_peered":"2024-09-10T15:25:22.931919+0000","last_clean":"2024-09-10T15:25:22.931919+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:25:22.931919+0000","last_undegraded":"2024-09-10T15:25:22.931919+0000","last_fullsized":"2024-09-10T15:25:22.931919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900790+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:25:22.900790+0000","last_peered":"2024-09-10T15:25:22.900790+0000","last_clean":"2024-09-10T15:25:22.900790+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:25:22.900790+0000","last_undegraded":"2024-09-10T15:25:22.900790+0000","last_fullsized":"2024-09-10T15:25:22.900790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897526+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:25:22.897526+0000","last_peered":"2024-09-10T15:25:22.897526+0000","last_clean":"2024-09-10T15:25:22.897526+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:25:22.897526+0000","last_undegraded":"2024-09-10T15:25:22.897526+0000","last_fullsized":"2024-09-10T15:25:22.897526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925806+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:25:22.925806+0000","last_peered":"2024-09-10T15:25:22.925806+0000","last_clean":"2024-09-10T15:25:22.925806+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:25:22.925806+0000","last_undegraded":"2024-09-10T15:25:22.925806+0000","last_fullsized":"2024-09-10T15:25:22.925806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924818+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:25:22.924818+0000","last_peered":"2024-09-10T15:25:22.924818+0000","last_clean":"2024-09-10T15:25:22.924818+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:25:22.924818+0000","last_undegraded":"2024-09-10T15:25:22.924818+0000","last_fullsized":"2024-09-10T15:25:22.924818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879433+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:25:22.879433+0000","last_peered":"2024-09-10T15:25:22.879433+0000","last_clean":"2024-09-10T15:25:22.879433+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:25:22.879433+0000","last_undegraded":"2024-09-10T15:25:22.879433+0000","last_fullsized":"2024-09-10T15:25:22.879433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879253+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:25:22.879253+0000","last_peered":"2024-09-10T15:25:22.879253+0000","last_clean":"2024-09-10T15:25:22.879253+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:25:22.879253+0000","last_undegraded":"2024-09-10T15:25:22.879253+0000","last_fullsized":"2024-09-10T15:25:22.879253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878315+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:25:22.878315+0000","last_peered":"2024-09-10T15:25:22.878315+0000","last_clean":"2024-09-10T15:25:22.878315+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:25:22.878315+0000","last_undegraded":"2024-09-10T15:25:22.878315+0000","last_fullsized":"2024-09-10T15:25:22.878315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911064+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:25:22.911064+0000","last_peered":"2024-09-10T15:25:22.911064+0000","last_clean":"2024-09-10T15:25:22.911064+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:25:22.911064+0000","last_undegraded":"2024-09-10T15:25:22.911064+0000","last_fullsized":"2024-09-10T15:25:22.911064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886325+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:25:22.886325+0000","last_peered":"2024-09-10T15:25:22.886325+0000","last_clean":"2024-09-10T15:25:22.886325+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:25:22.886325+0000","last_undegraded":"2024-09-10T15:25:22.886325+0000","last_fullsized":"2024-09-10T15:25:22.886325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911915+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:25:22.911915+0000","last_peered":"2024-09-10T15:25:22.911915+0000","last_clean":"2024-09-10T15:25:22.911915+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:25:22.911915+0000","last_undegraded":"2024-09-10T15:25:22.911915+0000","last_fullsized":"2024-09-10T15:25:22.911915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910164+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:25:22.910164+0000","last_peered":"2024-09-10T15:25:22.910164+0000","last_clean":"2024-09-10T15:25:22.910164+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:25:22.910164+0000","last_undegraded":"2024-09-10T15:25:22.910164+0000","last_fullsized":"2024-09-10T15:25:22.910164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933972+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:25:22.933972+0000","last_peered":"2024-09-10T15:25:22.933972+0000","last_clean":"2024-09-10T15:25:22.933972+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:25:22.933972+0000","last_undegraded":"2024-09-10T15:25:22.933972+0000","last_fullsized":"2024-09-10T15:25:22.933972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877759+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:25:22.877759+0000","last_peered":"2024-09-10T15:25:22.877759+0000","last_clean":"2024-09-10T15:25:22.877759+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:25:22.877759+0000","last_undegraded":"2024-09-10T15:25:22.877759+0000","last_fullsized":"2024-09-10T15:25:22.877759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879423+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:25:22.879423+0000","last_peered":"2024-09-10T15:25:22.879423+0000","last_clean":"2024-09-10T15:25:22.879423+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:25:22.879423+0000","last_undegraded":"2024-09-10T15:25:22.879423+0000","last_fullsized":"2024-09-10T15:25:22.879423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.901113+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:25:22.901113+0000","last_peered":"2024-09-10T15:25:22.901113+0000","last_clean":"2024-09-10T15:25:22.901113+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:25:22.901113+0000","last_undegraded":"2024-09-10T15:25:22.901113+0000","last_fullsized":"2024-09-10T15:25:22.901113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924147+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:25:22.924147+0000","last_peered":"2024-09-10T15:25:22.924147+0000","last_clean":"2024-09-10T15:25:22.924147+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:25:22.924147+0000","last_undegraded":"2024-09-10T15:25:22.924147+0000","last_fullsized":"2024-09-10T15:25:22.924147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887690+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:25:22.887690+0000","last_peered":"2024-09-10T15:25:22.887690+0000","last_clean":"2024-09-10T15:25:22.887690+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:25:22.887690+0000","last_undegraded":"2024-09-10T15:25:22.887690+0000","last_fullsized":"2024-09-10T15:25:22.887690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877843+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:25:22.877843+0000","last_peered":"2024-09-10T15:25:22.877843+0000","last_clean":"2024-09-10T15:25:22.877843+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:25:22.877843+0000","last_undegraded":"2024-09-10T15:25:22.877843+0000","last_fullsized":"2024-09-10T15:25:22.877843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878759+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:25:22.878759+0000","last_peered":"2024-09-10T15:25:22.878759+0000","last_clean":"2024-09-10T15:25:22.878759+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:25:22.878759+0000","last_undegraded":"2024-09-10T15:25:22.878759+0000","last_fullsized":"2024-09-10T15:25:22.878759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878784+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:25:22.878784+0000","last_peered":"2024-09-10T15:25:22.878784+0000","last_clean":"2024-09-10T15:25:22.878784+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:25:22.878784+0000","last_undegraded":"2024-09-10T15:25:22.878784+0000","last_fullsized":"2024-09-10T15:25:22.878784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879192+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:22.879192+0000","last_peered":"2024-09-10T15:25:22.879192+0000","last_clean":"2024-09-10T15:25:22.879192+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:25:22.879192+0000","last_undegraded":"2024-09-10T15:25:22.879192+0000","last_fullsized":"2024-09-10T15:25:22.879192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891706+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:25:22.891706+0000","last_peered":"2024-09-10T15:25:22.891706+0000","last_clean":"2024-09-10T15:25:22.891706+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:25:22.891706+0000","last_undegraded":"2024-09-10T15:25:22.891706+0000","last_fullsized":"2024-09-10T15:25:22.891706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878862+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:25:22.878862+0000","last_peered":"2024-09-10T15:25:22.878862+0000","last_clean":"2024-09-10T15:25:22.878862+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:25:22.878862+0000","last_undegraded":"2024-09-10T15:25:22.878862+0000","last_fullsized":"2024-09-10T15:25:22.878862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887257+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:25:22.887257+0000","last_peered":"2024-09-10T15:25:22.887257+0000","last_clean":"2024-09-10T15:25:22.887257+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:25:22.887257+0000","last_undegraded":"2024-09-10T15:25:22.887257+0000","last_fullsized":"2024-09-10T15:25:22.887257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.898271+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:25:22.898271+0000","last_peered":"2024-09-10T15:25:22.898271+0000","last_clean":"2024-09-10T15:25:22.898271+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:25:22.898271+0000","last_undegraded":"2024-09-10T15:25:22.898271+0000","last_fullsized":"2024-09-10T15:25:22.898271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926361+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:25:22.926361+0000","last_peered":"2024-09-10T15:25:22.926361+0000","last_clean":"2024-09-10T15:25:22.926361+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:25:22.926361+0000","last_undegraded":"2024-09-10T15:25:22.926361+0000","last_fullsized":"2024-09-10T15:25:22.926361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890263+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:25:22.890263+0000","last_peered":"2024-09-10T15:25:22.890263+0000","last_clean":"2024-09-10T15:25:22.890263+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:25:22.890263+0000","last_undegraded":"2024-09-10T15:25:22.890263+0000","last_fullsized":"2024-09-10T15:25:22.890263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900995+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:25:22.900995+0000","last_peered":"2024-09-10T15:25:22.900995+0000","last_clean":"2024-09-10T15:25:22.900995+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:25:22.900995+0000","last_undegraded":"2024-09-10T15:25:22.900995+0000","last_fullsized":"2024-09-10T15:25:22.900995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877735+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:25:22.877735+0000","last_peered":"2024-09-10T15:25:22.877735+0000","last_clean":"2024-09-10T15:25:22.877735+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:25:22.877735+0000","last_undegraded":"2024-09-10T15:25:22.877735+0000","last_fullsized":"2024-09-10T15:25:22.877735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925903+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:25:22.925903+0000","last_peered":"2024-09-10T15:25:22.925903+0000","last_clean":"2024-09-10T15:25:22.925903+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:25:22.925903+0000","last_undegraded":"2024-09-10T15:25:22.925903+0000","last_fullsized":"2024-09-10T15:25:22.925903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924059+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:25:22.924059+0000","last_peered":"2024-09-10T15:25:22.924059+0000","last_clean":"2024-09-10T15:25:22.924059+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:25:22.924059+0000","last_undegraded":"2024-09-10T15:25:22.924059+0000","last_fullsized":"2024-09-10T15:25:22.924059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892928+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:25:22.892928+0000","last_peered":"2024-09-10T15:25:22.892928+0000","last_clean":"2024-09-10T15:25:22.892928+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:25:22.892928+0000","last_undegraded":"2024-09-10T15:25:22.892928+0000","last_fullsized":"2024-09-10T15:25:22.892928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877491+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:25:22.877491+0000","last_peered":"2024-09-10T15:25:22.877491+0000","last_clean":"2024-09-10T15:25:22.877491+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:25:22.877491+0000","last_undegraded":"2024-09-10T15:25:22.877491+0000","last_fullsized":"2024-09-10T15:25:22.877491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.880097+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:25:22.880097+0000","last_peered":"2024-09-10T15:25:22.880097+0000","last_clean":"2024-09-10T15:25:22.880097+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:25:22.880097+0000","last_undegraded":"2024-09-10T15:25:22.880097+0000","last_fullsized":"2024-09-10T15:25:22.880097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":425984,"data_stored":174583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":175631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":765097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":175768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":174464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":174069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":766027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":175677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:29.875 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:30.243 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:30.249 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:30.267 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-10T15:25:28.913936+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220760,"kb_used_data":4528,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753960,"statfs":{"total":773094113280,"available":772868055040,"internally_reserved":0,"allocated":4636672,"data_stored":2581316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":221236788},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004041"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887529+0000","last_change":"2024-09-10T15:25:11.842625+0000","last_active":"2024-09-10T15:25:22.887529+0000","last_peered":"2024-09-10T15:25:22.887529+0000","last_clean":"2024-09-10T15:25:22.887529+0000","last_became_active":"2024-09-10T15:25:11.842298+0000","last_became_peered":"2024-09-10T15:25:11.842298+0000","last_unstale":"2024-09-10T15:25:22.887529+0000","last_undegraded":"2024-09-10T15:25:22.887529+0000","last_fullsized":"2024-09-10T15:25:22.887529+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877549+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:25:22.877549+0000","last_peered":"2024-09-10T15:25:22.877549+0000","last_clean":"2024-09-10T15:25:22.877549+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:25:22.877549+0000","last_undegraded":"2024-09-10T15:25:22.877549+0000","last_fullsized":"2024-09-10T15:25:22.877549+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879860+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:25:22.879860+0000","last_peered":"2024-09-10T15:25:22.879860+0000","last_clean":"2024-09-10T15:25:22.879860+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:25:22.879860+0000","last_undegraded":"2024-09-10T15:25:22.879860+0000","last_fullsized":"2024-09-10T15:25:22.879860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924223+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:25:22.924223+0000","last_peered":"2024-09-10T15:25:22.924223+0000","last_clean":"2024-09-10T15:25:22.924223+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:25:22.924223+0000","last_undegraded":"2024-09-10T15:25:22.924223+0000","last_fullsized":"2024-09-10T15:25:22.924223+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879045+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:25:22.879045+0000","last_peered":"2024-09-10T15:25:22.879045+0000","last_clean":"2024-09-10T15:25:22.879045+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:25:22.879045+0000","last_undegraded":"2024-09-10T15:25:22.879045+0000","last_fullsized":"2024-09-10T15:25:22.879045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924285+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:25:22.924285+0000","last_peered":"2024-09-10T15:25:22.924285+0000","last_clean":"2024-09-10T15:25:22.924285+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:25:22.924285+0000","last_undegraded":"2024-09-10T15:25:22.924285+0000","last_fullsized":"2024-09-10T15:25:22.924285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934179+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:25:22.934179+0000","last_peered":"2024-09-10T15:25:22.934179+0000","last_clean":"2024-09-10T15:25:22.934179+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:25:22.934179+0000","last_undegraded":"2024-09-10T15:25:22.934179+0000","last_fullsized":"2024-09-10T15:25:22.934179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891746+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:25:22.891746+0000","last_peered":"2024-09-10T15:25:22.891746+0000","last_clean":"2024-09-10T15:25:22.891746+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:25:22.891746+0000","last_undegraded":"2024-09-10T15:25:22.891746+0000","last_fullsized":"2024-09-10T15:25:22.891746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887117+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:25:22.887117+0000","last_peered":"2024-09-10T15:25:22.887117+0000","last_clean":"2024-09-10T15:25:22.887117+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:25:22.887117+0000","last_undegraded":"2024-09-10T15:25:22.887117+0000","last_fullsized":"2024-09-10T15:25:22.887117+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886523+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:25:22.886523+0000","last_peered":"2024-09-10T15:25:22.886523+0000","last_clean":"2024-09-10T15:25:22.886523+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:25:22.886523+0000","last_undegraded":"2024-09-10T15:25:22.886523+0000","last_fullsized":"2024-09-10T15:25:22.886523+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932588+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:25:22.932588+0000","last_peered":"2024-09-10T15:25:22.932588+0000","last_clean":"2024-09-10T15:25:22.932588+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:25:22.932588+0000","last_undegraded":"2024-09-10T15:25:22.932588+0000","last_fullsized":"2024-09-10T15:25:22.932588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887217+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:25:22.887217+0000","last_peered":"2024-09-10T15:25:22.887217+0000","last_clean":"2024-09-10T15:25:22.887217+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:25:22.887217+0000","last_undegraded":"2024-09-10T15:25:22.887217+0000","last_fullsized":"2024-09-10T15:25:22.887217+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886707+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:25:22.886707+0000","last_peered":"2024-09-10T15:25:22.886707+0000","last_clean":"2024-09-10T15:25:22.886707+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:25:22.886707+0000","last_undegraded":"2024-09-10T15:25:22.886707+0000","last_fullsized":"2024-09-10T15:25:22.886707+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933695+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:25:22.933695+0000","last_peered":"2024-09-10T15:25:22.933695+0000","last_clean":"2024-09-10T15:25:22.933695+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:25:22.933695+0000","last_undegraded":"2024-09-10T15:25:22.933695+0000","last_fullsized":"2024-09-10T15:25:22.933695+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877300+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:25:22.877300+0000","last_peered":"2024-09-10T15:25:22.877300+0000","last_clean":"2024-09-10T15:25:22.877300+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:25:22.877300+0000","last_undegraded":"2024-09-10T15:25:22.877300+0000","last_fullsized":"2024-09-10T15:25:22.877300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879824+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:25:22.879824+0000","last_peered":"2024-09-10T15:25:22.879824+0000","last_clean":"2024-09-10T15:25:22.879824+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:25:22.879824+0000","last_undegraded":"2024-09-10T15:25:22.879824+0000","last_fullsized":"2024-09-10T15:25:22.879824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923800+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:25:22.923800+0000","last_peered":"2024-09-10T15:25:22.923800+0000","last_clean":"2024-09-10T15:25:22.923800+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:25:22.923800+0000","last_undegraded":"2024-09-10T15:25:22.923800+0000","last_fullsized":"2024-09-10T15:25:22.923800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.880502+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:25:22.880502+0000","last_peered":"2024-09-10T15:25:22.880502+0000","last_clean":"2024-09-10T15:25:22.880502+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:25:22.880502+0000","last_undegraded":"2024-09-10T15:25:22.880502+0000","last_fullsized":"2024-09-10T15:25:22.880502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886290+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:25:22.886290+0000","last_peered":"2024-09-10T15:25:22.886290+0000","last_clean":"2024-09-10T15:25:22.886290+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:25:22.886290+0000","last_undegraded":"2024-09-10T15:25:22.886290+0000","last_fullsized":"2024-09-10T15:25:22.886290+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887966+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:25:22.887966+0000","last_peered":"2024-09-10T15:25:22.887966+0000","last_clean":"2024-09-10T15:25:22.887966+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:25:22.887966+0000","last_undegraded":"2024-09-10T15:25:22.887966+0000","last_fullsized":"2024-09-10T15:25:22.887966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878718+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:25:22.878718+0000","last_peered":"2024-09-10T15:25:22.878718+0000","last_clean":"2024-09-10T15:25:22.878718+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:25:22.878718+0000","last_undegraded":"2024-09-10T15:25:22.878718+0000","last_fullsized":"2024-09-10T15:25:22.878718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887813+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:25:22.887813+0000","last_peered":"2024-09-10T15:25:22.887813+0000","last_clean":"2024-09-10T15:25:22.887813+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:25:22.887813+0000","last_undegraded":"2024-09-10T15:25:22.887813+0000","last_fullsized":"2024-09-10T15:25:22.887813+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910711+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:25:22.910711+0000","last_peered":"2024-09-10T15:25:22.910711+0000","last_clean":"2024-09-10T15:25:22.910711+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:25:22.910711+0000","last_undegraded":"2024-09-10T15:25:22.910711+0000","last_fullsized":"2024-09-10T15:25:22.910711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887000+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:25:22.887000+0000","last_peered":"2024-09-10T15:25:22.887000+0000","last_clean":"2024-09-10T15:25:22.887000+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:25:22.887000+0000","last_undegraded":"2024-09-10T15:25:22.887000+0000","last_fullsized":"2024-09-10T15:25:22.887000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879014+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:25:22.879014+0000","last_peered":"2024-09-10T15:25:22.879014+0000","last_clean":"2024-09-10T15:25:22.879014+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:25:22.879014+0000","last_undegraded":"2024-09-10T15:25:22.879014+0000","last_fullsized":"2024-09-10T15:25:22.879014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911485+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:25:22.911485+0000","last_peered":"2024-09-10T15:25:22.911485+0000","last_clean":"2024-09-10T15:25:22.911485+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:25:22.911485+0000","last_undegraded":"2024-09-10T15:25:22.911485+0000","last_fullsized":"2024-09-10T15:25:22.911485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879788+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:25:22.879788+0000","last_peered":"2024-09-10T15:25:22.879788+0000","last_clean":"2024-09-10T15:25:22.879788+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:25:22.879788+0000","last_undegraded":"2024-09-10T15:25:22.879788+0000","last_fullsized":"2024-09-10T15:25:22.879788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910566+0000","last_change":"2024-09-10T15:25:11.843256+0000","last_active":"2024-09-10T15:25:22.910566+0000","last_peered":"2024-09-10T15:25:22.910566+0000","last_clean":"2024-09-10T15:25:22.910566+0000","last_became_active":"2024-09-10T15:25:11.842370+0000","last_became_peered":"2024-09-10T15:25:11.842370+0000","last_unstale":"2024-09-10T15:25:22.910566+0000","last_undegraded":"2024-09-10T15:25:22.910566+0000","last_fullsized":"2024-09-10T15:25:22.910566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.885755+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:25:22.885755+0000","last_peered":"2024-09-10T15:25:22.885755+0000","last_clean":"2024-09-10T15:25:22.885755+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:25:22.885755+0000","last_undegraded":"2024-09-10T15:25:22.885755+0000","last_fullsized":"2024-09-10T15:25:22.885755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910844+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:25:22.910844+0000","last_peered":"2024-09-10T15:25:22.910844+0000","last_clean":"2024-09-10T15:25:22.910844+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:25:22.910844+0000","last_undegraded":"2024-09-10T15:25:22.910844+0000","last_fullsized":"2024-09-10T15:25:22.910844+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924218+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:25:22.924218+0000","last_peered":"2024-09-10T15:25:22.924218+0000","last_clean":"2024-09-10T15:25:22.924218+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:25:22.924218+0000","last_undegraded":"2024-09-10T15:25:22.924218+0000","last_fullsized":"2024-09-10T15:25:22.924218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926951+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:25:22.926951+0000","last_peered":"2024-09-10T15:25:22.926951+0000","last_clean":"2024-09-10T15:25:22.926951+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:25:22.926951+0000","last_undegraded":"2024-09-10T15:25:22.926951+0000","last_fullsized":"2024-09-10T15:25:22.926951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.265531+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:25:23.265531+0000","last_peered":"2024-09-10T15:25:23.265531+0000","last_clean":"2024-09-10T15:25:23.265531+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:25:23.265531+0000","last_undegraded":"2024-09-10T15:25:23.265531+0000","last_fullsized":"2024-09-10T15:25:23.265531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879803+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:25:22.879803+0000","last_peered":"2024-09-10T15:25:22.879803+0000","last_clean":"2024-09-10T15:25:22.879803+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:25:22.879803+0000","last_undegraded":"2024-09-10T15:25:22.879803+0000","last_fullsized":"2024-09-10T15:25:22.879803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877333+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:25:22.877333+0000","last_peered":"2024-09-10T15:25:22.877333+0000","last_clean":"2024-09-10T15:25:22.877333+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:25:22.877333+0000","last_undegraded":"2024-09-10T15:25:22.877333+0000","last_fullsized":"2024-09-10T15:25:22.877333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926400+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:25:22.926400+0000","last_peered":"2024-09-10T15:25:22.926400+0000","last_clean":"2024-09-10T15:25:22.926400+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:25:22.926400+0000","last_undegraded":"2024-09-10T15:25:22.926400+0000","last_fullsized":"2024-09-10T15:25:22.926400+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910824+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:25:22.910824+0000","last_peered":"2024-09-10T15:25:22.910824+0000","last_clean":"2024-09-10T15:25:22.910824+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:25:22.910824+0000","last_undegraded":"2024-09-10T15:25:22.910824+0000","last_fullsized":"2024-09-10T15:25:22.910824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890636+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:25:22.890636+0000","last_peered":"2024-09-10T15:25:22.890636+0000","last_clean":"2024-09-10T15:25:22.890636+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:25:22.890636+0000","last_undegraded":"2024-09-10T15:25:22.890636+0000","last_fullsized":"2024-09-10T15:25:22.890636+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":29,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.651161+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:25:23.651161+0000","last_peered":"2024-09-10T15:25:23.651161+0000","last_clean":"2024-09-10T15:25:23.651161+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:25:23.651161+0000","last_undegraded":"2024-09-10T15:25:23.651161+0000","last_fullsized":"2024-09-10T15:25:23.651161+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879643+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:25:22.879643+0000","last_peered":"2024-09-10T15:25:22.879643+0000","last_clean":"2024-09-10T15:25:22.879643+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:25:22.879643+0000","last_undegraded":"2024-09-10T15:25:22.879643+0000","last_fullsized":"2024-09-10T15:25:22.879643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910156+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:25:22.910156+0000","last_peered":"2024-09-10T15:25:22.910156+0000","last_clean":"2024-09-10T15:25:22.910156+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:25:22.910156+0000","last_undegraded":"2024-09-10T15:25:22.910156+0000","last_fullsized":"2024-09-10T15:25:22.910156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879621+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:25:22.879621+0000","last_peered":"2024-09-10T15:25:22.879621+0000","last_clean":"2024-09-10T15:25:22.879621+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:25:22.879621+0000","last_undegraded":"2024-09-10T15:25:22.879621+0000","last_fullsized":"2024-09-10T15:25:22.879621+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924556+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:25:22.924556+0000","last_peered":"2024-09-10T15:25:22.924556+0000","last_clean":"2024-09-10T15:25:22.924556+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:25:22.924556+0000","last_undegraded":"2024-09-10T15:25:22.924556+0000","last_fullsized":"2024-09-10T15:25:22.924556+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892641+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:25:22.892641+0000","last_peered":"2024-09-10T15:25:22.892641+0000","last_clean":"2024-09-10T15:25:22.892641+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:25:22.892641+0000","last_undegraded":"2024-09-10T15:25:22.892641+0000","last_fullsized":"2024-09-10T15:25:22.892641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.707291+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:25:23.707291+0000","last_peered":"2024-09-10T15:25:23.707291+0000","last_clean":"2024-09-10T15:25:23.707291+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:25:23.707291+0000","last_undegraded":"2024-09-10T15:25:23.707291+0000","last_fullsized":"2024-09-10T15:25:23.707291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.162980+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:25:23.162980+0000","last_peered":"2024-09-10T15:25:23.162980+0000","last_clean":"2024-09-10T15:25:23.162980+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:25:23.162980+0000","last_undegraded":"2024-09-10T15:25:23.162980+0000","last_fullsized":"2024-09-10T15:25:23.162980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932651+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:25:22.932651+0000","last_peered":"2024-09-10T15:25:22.932651+0000","last_clean":"2024-09-10T15:25:22.932651+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:25:22.932651+0000","last_undegraded":"2024-09-10T15:25:22.932651+0000","last_fullsized":"2024-09-10T15:25:22.932651+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879307+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:25:22.879307+0000","last_peered":"2024-09-10T15:25:22.879307+0000","last_clean":"2024-09-10T15:25:22.879307+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:25:22.879307+0000","last_undegraded":"2024-09-10T15:25:22.879307+0000","last_fullsized":"2024-09-10T15:25:22.879307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877868+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:25:22.877868+0000","last_peered":"2024-09-10T15:25:22.877868+0000","last_clean":"2024-09-10T15:25:22.877868+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:25:22.877868+0000","last_undegraded":"2024-09-10T15:25:22.877868+0000","last_fullsized":"2024-09-10T15:25:22.877868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926128+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:25:22.926128+0000","last_peered":"2024-09-10T15:25:22.926128+0000","last_clean":"2024-09-10T15:25:22.926128+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:25:22.926128+0000","last_undegraded":"2024-09-10T15:25:22.926128+0000","last_fullsized":"2024-09-10T15:25:22.926128+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.714538+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:25:23.714538+0000","last_peered":"2024-09-10T15:25:23.714538+0000","last_clean":"2024-09-10T15:25:23.714538+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:25:23.714538+0000","last_undegraded":"2024-09-10T15:25:23.714538+0000","last_fullsized":"2024-09-10T15:25:23.714538+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.167209+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:25:23.167209+0000","last_peered":"2024-09-10T15:25:23.167209+0000","last_clean":"2024-09-10T15:25:23.167209+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:25:23.167209+0000","last_undegraded":"2024-09-10T15:25:23.167209+0000","last_fullsized":"2024-09-10T15:25:23.167209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923872+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:25:22.923872+0000","last_peered":"2024-09-10T15:25:22.923872+0000","last_clean":"2024-09-10T15:25:22.923872+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:25:22.923872+0000","last_undegraded":"2024-09-10T15:25:22.923872+0000","last_fullsized":"2024-09-10T15:25:22.923872+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887809+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:25:22.887809+0000","last_peered":"2024-09-10T15:25:22.887809+0000","last_clean":"2024-09-10T15:25:22.887809+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:25:22.887809+0000","last_undegraded":"2024-09-10T15:25:22.887809+0000","last_fullsized":"2024-09-10T15:25:22.887809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877720+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:25:22.877720+0000","last_peered":"2024-09-10T15:25:22.877720+0000","last_clean":"2024-09-10T15:25:22.877720+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:25:22.877720+0000","last_undegraded":"2024-09-10T15:25:22.877720+0000","last_fullsized":"2024-09-10T15:25:22.877720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":51,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.812990+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:25:23.812990+0000","last_peered":"2024-09-10T15:25:23.812990+0000","last_clean":"2024-09-10T15:25:23.812990+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:25:23.812990+0000","last_undegraded":"2024-09-10T15:25:23.812990+0000","last_fullsized":"2024-09-10T15:25:23.812990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910233+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:25:22.910233+0000","last_peered":"2024-09-10T15:25:22.910233+0000","last_clean":"2024-09-10T15:25:22.910233+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:25:22.910233+0000","last_undegraded":"2024-09-10T15:25:22.910233+0000","last_fullsized":"2024-09-10T15:25:22.910233+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933862+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:25:22.933862+0000","last_peered":"2024-09-10T15:25:22.933862+0000","last_clean":"2024-09-10T15:25:22.933862+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:25:22.933862+0000","last_undegraded":"2024-09-10T15:25:22.933862+0000","last_fullsized":"2024-09-10T15:25:22.933862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877856+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:25:22.877856+0000","last_peered":"2024-09-10T15:25:22.877856+0000","last_clean":"2024-09-10T15:25:22.877856+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:25:22.877856+0000","last_undegraded":"2024-09-10T15:25:22.877856+0000","last_fullsized":"2024-09-10T15:25:22.877856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934212+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:25:22.934212+0000","last_peered":"2024-09-10T15:25:22.934212+0000","last_clean":"2024-09-10T15:25:22.934212+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:25:22.934212+0000","last_undegraded":"2024-09-10T15:25:22.934212+0000","last_fullsized":"2024-09-10T15:25:22.934212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.909354+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:25:22.909354+0000","last_peered":"2024-09-10T15:25:22.909354+0000","last_clean":"2024-09-10T15:25:22.909354+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:25:22.909354+0000","last_undegraded":"2024-09-10T15:25:22.909354+0000","last_fullsized":"2024-09-10T15:25:22.909354+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.686701+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:25:23.686701+0000","last_peered":"2024-09-10T15:25:23.686701+0000","last_clean":"2024-09-10T15:25:23.686701+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:25:23.686701+0000","last_undegraded":"2024-09-10T15:25:23.686701+0000","last_fullsized":"2024-09-10T15:25:23.686701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889887+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:25:22.889887+0000","last_peered":"2024-09-10T15:25:22.889887+0000","last_clean":"2024-09-10T15:25:22.889887+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:25:22.889887+0000","last_undegraded":"2024-09-10T15:25:22.889887+0000","last_fullsized":"2024-09-10T15:25:22.889887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879450+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:25:22.879450+0000","last_peered":"2024-09-10T15:25:22.879450+0000","last_clean":"2024-09-10T15:25:22.879450+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:25:22.879450+0000","last_undegraded":"2024-09-10T15:25:22.879450+0000","last_fullsized":"2024-09-10T15:25:22.879450+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932338+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:25:22.932338+0000","last_peered":"2024-09-10T15:25:22.932338+0000","last_clean":"2024-09-10T15:25:22.932338+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:25:22.932338+0000","last_undegraded":"2024-09-10T15:25:22.932338+0000","last_fullsized":"2024-09-10T15:25:22.932338+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925816+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:25:22.925816+0000","last_peered":"2024-09-10T15:25:22.925816+0000","last_clean":"2024-09-10T15:25:22.925816+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:25:22.925816+0000","last_undegraded":"2024-09-10T15:25:22.925816+0000","last_fullsized":"2024-09-10T15:25:22.925816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877872+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:25:22.877872+0000","last_peered":"2024-09-10T15:25:22.877872+0000","last_clean":"2024-09-10T15:25:22.877872+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:25:22.877872+0000","last_undegraded":"2024-09-10T15:25:22.877872+0000","last_fullsized":"2024-09-10T15:25:22.877872+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.602750+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:25:23.602750+0000","last_peered":"2024-09-10T15:25:23.602750+0000","last_clean":"2024-09-10T15:25:23.602750+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:25:23.602750+0000","last_undegraded":"2024-09-10T15:25:23.602750+0000","last_fullsized":"2024-09-10T15:25:23.602750+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.166905+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:25:23.166905+0000","last_peered":"2024-09-10T15:25:23.166905+0000","last_clean":"2024-09-10T15:25:23.166905+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:25:23.166905+0000","last_undegraded":"2024-09-10T15:25:23.166905+0000","last_fullsized":"2024-09-10T15:25:23.166905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.912309+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:25:22.912309+0000","last_peered":"2024-09-10T15:25:22.912309+0000","last_clean":"2024-09-10T15:25:22.912309+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:25:22.912309+0000","last_undegraded":"2024-09-10T15:25:22.912309+0000","last_fullsized":"2024-09-10T15:25:22.912309+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878713+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:25:22.878713+0000","last_peered":"2024-09-10T15:25:22.878713+0000","last_clean":"2024-09-10T15:25:22.878713+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:25:22.878713+0000","last_undegraded":"2024-09-10T15:25:22.878713+0000","last_fullsized":"2024-09-10T15:25:22.878713+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887502+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:25:22.887502+0000","last_peered":"2024-09-10T15:25:22.887502+0000","last_clean":"2024-09-10T15:25:22.887502+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:25:22.887502+0000","last_undegraded":"2024-09-10T15:25:22.887502+0000","last_fullsized":"2024-09-10T15:25:22.887502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910078+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:25:22.910078+0000","last_peered":"2024-09-10T15:25:22.910078+0000","last_clean":"2024-09-10T15:25:22.910078+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:25:22.910078+0000","last_undegraded":"2024-09-10T15:25:22.910078+0000","last_fullsized":"2024-09-10T15:25:22.910078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.234715+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:25:23.234715+0000","last_peered":"2024-09-10T15:25:23.234715+0000","last_clean":"2024-09-10T15:25:23.234715+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:25:23.234715+0000","last_undegraded":"2024-09-10T15:25:23.234715+0000","last_fullsized":"2024-09-10T15:25:23.234715+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877668+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:25:22.877668+0000","last_peered":"2024-09-10T15:25:22.877668+0000","last_clean":"2024-09-10T15:25:22.877668+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:25:22.877668+0000","last_undegraded":"2024-09-10T15:25:22.877668+0000","last_fullsized":"2024-09-10T15:25:22.877668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900956+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:25:22.900956+0000","last_peered":"2024-09-10T15:25:22.900956+0000","last_clean":"2024-09-10T15:25:22.900956+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:25:22.900956+0000","last_undegraded":"2024-09-10T15:25:22.900956+0000","last_fullsized":"2024-09-10T15:25:22.900956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887111+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:22.887111+0000","last_peered":"2024-09-10T15:25:22.887111+0000","last_clean":"2024-09-10T15:25:22.887111+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:25:22.887111+0000","last_undegraded":"2024-09-10T15:25:22.887111+0000","last_fullsized":"2024-09-10T15:25:22.887111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.899552+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:25:22.899552+0000","last_peered":"2024-09-10T15:25:22.899552+0000","last_clean":"2024-09-10T15:25:22.899552+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:25:22.899552+0000","last_undegraded":"2024-09-10T15:25:22.899552+0000","last_fullsized":"2024-09-10T15:25:22.899552+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.899922+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:25:22.899922+0000","last_peered":"2024-09-10T15:25:22.899922+0000","last_clean":"2024-09-10T15:25:22.899922+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:25:22.899922+0000","last_undegraded":"2024-09-10T15:25:22.899922+0000","last_fullsized":"2024-09-10T15:25:22.899922+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.749334+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:25:23.749334+0000","last_peered":"2024-09-10T15:25:23.749334+0000","last_clean":"2024-09-10T15:25:23.749334+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:25:23.749334+0000","last_undegraded":"2024-09-10T15:25:23.749334+0000","last_fullsized":"2024-09-10T15:25:23.749334+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900640+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:25:22.900640+0000","last_peered":"2024-09-10T15:25:22.900640+0000","last_clean":"2024-09-10T15:25:22.900640+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:25:22.900640+0000","last_undegraded":"2024-09-10T15:25:22.900640+0000","last_fullsized":"2024-09-10T15:25:22.900640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877091+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:25:22.877091+0000","last_peered":"2024-09-10T15:25:22.877091+0000","last_clean":"2024-09-10T15:25:22.877091+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:25:22.877091+0000","last_undegraded":"2024-09-10T15:25:22.877091+0000","last_fullsized":"2024-09-10T15:25:22.877091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926746+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:25:22.926746+0000","last_peered":"2024-09-10T15:25:22.926746+0000","last_clean":"2024-09-10T15:25:22.926746+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:25:22.926746+0000","last_undegraded":"2024-09-10T15:25:22.926746+0000","last_fullsized":"2024-09-10T15:25:22.926746+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925012+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:25:22.925012+0000","last_peered":"2024-09-10T15:25:22.925012+0000","last_clean":"2024-09-10T15:25:22.925012+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:25:22.925012+0000","last_undegraded":"2024-09-10T15:25:22.925012+0000","last_fullsized":"2024-09-10T15:25:22.925012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878740+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:25:22.878740+0000","last_peered":"2024-09-10T15:25:22.878740+0000","last_clean":"2024-09-10T15:25:22.878740+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:25:22.878740+0000","last_undegraded":"2024-09-10T15:25:22.878740+0000","last_fullsized":"2024-09-10T15:25:22.878740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.818997+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:25:23.818997+0000","last_peered":"2024-09-10T15:25:23.818997+0000","last_clean":"2024-09-10T15:25:23.818997+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:25:23.818997+0000","last_undegraded":"2024-09-10T15:25:23.818997+0000","last_fullsized":"2024-09-10T15:25:23.818997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.160491+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:25:23.160491+0000","last_peered":"2024-09-10T15:25:23.160491+0000","last_clean":"2024-09-10T15:25:23.160491+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:25:23.160491+0000","last_undegraded":"2024-09-10T15:25:23.160491+0000","last_fullsized":"2024-09-10T15:25:23.160491+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.909765+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:25:22.909765+0000","last_peered":"2024-09-10T15:25:22.909765+0000","last_clean":"2024-09-10T15:25:22.909765+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:25:22.909765+0000","last_undegraded":"2024-09-10T15:25:22.909765+0000","last_fullsized":"2024-09-10T15:25:22.909765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933044+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:25:22.933044+0000","last_peered":"2024-09-10T15:25:22.933044+0000","last_clean":"2024-09-10T15:25:22.933044+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:25:22.933044+0000","last_undegraded":"2024-09-10T15:25:22.933044+0000","last_fullsized":"2024-09-10T15:25:22.933044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924585+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:25:22.924585+0000","last_peered":"2024-09-10T15:25:22.924585+0000","last_clean":"2024-09-10T15:25:22.924585+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:25:22.924585+0000","last_undegraded":"2024-09-10T15:25:22.924585+0000","last_fullsized":"2024-09-10T15:25:22.924585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.880224+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:25:22.880224+0000","last_peered":"2024-09-10T15:25:22.880224+0000","last_clean":"2024-09-10T15:25:22.880224+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:25:22.880224+0000","last_undegraded":"2024-09-10T15:25:22.880224+0000","last_fullsized":"2024-09-10T15:25:22.880224+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.609829+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:25:23.609829+0000","last_peered":"2024-09-10T15:25:23.609829+0000","last_clean":"2024-09-10T15:25:23.609829+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:25:23.609829+0000","last_undegraded":"2024-09-10T15:25:23.609829+0000","last_fullsized":"2024-09-10T15:25:23.609829+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.165272+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:25:23.165272+0000","last_peered":"2024-09-10T15:25:23.165272+0000","last_clean":"2024-09-10T15:25:23.165272+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:25:23.165272+0000","last_undegraded":"2024-09-10T15:25:23.165272+0000","last_fullsized":"2024-09-10T15:25:23.165272+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932215+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:25:22.932215+0000","last_peered":"2024-09-10T15:25:22.932215+0000","last_clean":"2024-09-10T15:25:22.932215+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:25:22.932215+0000","last_undegraded":"2024-09-10T15:25:22.932215+0000","last_fullsized":"2024-09-10T15:25:22.932215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.901135+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:25:22.901135+0000","last_peered":"2024-09-10T15:25:22.901135+0000","last_clean":"2024-09-10T15:25:22.901135+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:25:22.901135+0000","last_undegraded":"2024-09-10T15:25:22.901135+0000","last_fullsized":"2024-09-10T15:25:22.901135+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890842+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:25:22.890842+0000","last_peered":"2024-09-10T15:25:22.890842+0000","last_clean":"2024-09-10T15:25:22.890842+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:25:22.890842+0000","last_undegraded":"2024-09-10T15:25:22.890842+0000","last_fullsized":"2024-09-10T15:25:22.890842+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925827+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:25:22.925827+0000","last_peered":"2024-09-10T15:25:22.925827+0000","last_clean":"2024-09-10T15:25:22.925827+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:25:22.925827+0000","last_undegraded":"2024-09-10T15:25:22.925827+0000","last_fullsized":"2024-09-10T15:25:22.925827+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.742095+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:25:23.742095+0000","last_peered":"2024-09-10T15:25:23.742095+0000","last_clean":"2024-09-10T15:25:23.742095+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:25:23.742095+0000","last_undegraded":"2024-09-10T15:25:23.742095+0000","last_fullsized":"2024-09-10T15:25:23.742095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934110+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:25:22.934110+0000","last_peered":"2024-09-10T15:25:22.934110+0000","last_clean":"2024-09-10T15:25:22.934110+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:25:22.934110+0000","last_undegraded":"2024-09-10T15:25:22.934110+0000","last_fullsized":"2024-09-10T15:25:22.934110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.898805+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:25:22.898805+0000","last_peered":"2024-09-10T15:25:22.898805+0000","last_clean":"2024-09-10T15:25:22.898805+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:25:22.898805+0000","last_undegraded":"2024-09-10T15:25:22.898805+0000","last_fullsized":"2024-09-10T15:25:22.898805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926109+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:25:22.926109+0000","last_peered":"2024-09-10T15:25:22.926109+0000","last_clean":"2024-09-10T15:25:22.926109+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:25:22.926109+0000","last_undegraded":"2024-09-10T15:25:22.926109+0000","last_fullsized":"2024-09-10T15:25:22.926109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":197,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877993+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:22.877993+0000","last_peered":"2024-09-10T15:25:22.877993+0000","last_clean":"2024-09-10T15:25:22.877993+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:22.877993+0000","last_undegraded":"2024-09-10T15:25:22.877993+0000","last_fullsized":"2024-09-10T15:25:22.877993+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":48,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924731+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:22.924731+0000","last_peered":"2024-09-10T15:25:22.924731+0000","last_clean":"2024-09-10T15:25:22.924731+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:22.924731+0000","last_undegraded":"2024-09-10T15:25:22.924731+0000","last_fullsized":"2024-09-10T15:25:22.924731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891243+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:25:22.891243+0000","last_peered":"2024-09-10T15:25:22.891243+0000","last_clean":"2024-09-10T15:25:22.891243+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:25:22.891243+0000","last_undegraded":"2024-09-10T15:25:22.891243+0000","last_fullsized":"2024-09-10T15:25:22.891243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886273+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:25:22.886273+0000","last_peered":"2024-09-10T15:25:22.886273+0000","last_clean":"2024-09-10T15:25:22.886273+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:25:22.886273+0000","last_undegraded":"2024-09-10T15:25:22.886273+0000","last_fullsized":"2024-09-10T15:25:22.886273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.536210+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:25:23.536210+0000","last_peered":"2024-09-10T15:25:23.536210+0000","last_clean":"2024-09-10T15:25:23.536210+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:25:23.536210+0000","last_undegraded":"2024-09-10T15:25:23.536210+0000","last_fullsized":"2024-09-10T15:25:23.536210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879476+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:25:22.879476+0000","last_peered":"2024-09-10T15:25:22.879476+0000","last_clean":"2024-09-10T15:25:22.879476+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:25:22.879476+0000","last_undegraded":"2024-09-10T15:25:22.879476+0000","last_fullsized":"2024-09-10T15:25:22.879476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887107+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:25:22.887107+0000","last_peered":"2024-09-10T15:25:22.887107+0000","last_clean":"2024-09-10T15:25:22.887107+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:25:22.887107+0000","last_undegraded":"2024-09-10T15:25:22.887107+0000","last_fullsized":"2024-09-10T15:25:22.887107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879724+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:25:22.879724+0000","last_peered":"2024-09-10T15:25:22.879724+0000","last_clean":"2024-09-10T15:25:22.879724+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:25:22.879724+0000","last_undegraded":"2024-09-10T15:25:22.879724+0000","last_fullsized":"2024-09-10T15:25:22.879724+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924387+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:22.924387+0000","last_peered":"2024-09-10T15:25:22.924387+0000","last_clean":"2024-09-10T15:25:22.924387+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:22.924387+0000","last_undegraded":"2024-09-10T15:25:22.924387+0000","last_fullsized":"2024-09-10T15:25:22.924387+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910185+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:25:22.910185+0000","last_peered":"2024-09-10T15:25:22.910185+0000","last_clean":"2024-09-10T15:25:22.910185+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:25:22.910185+0000","last_undegraded":"2024-09-10T15:25:22.910185+0000","last_fullsized":"2024-09-10T15:25:22.910185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925031+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:25:22.925031+0000","last_peered":"2024-09-10T15:25:22.925031+0000","last_clean":"2024-09-10T15:25:22.925031+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:25:22.925031+0000","last_undegraded":"2024-09-10T15:25:22.925031+0000","last_fullsized":"2024-09-10T15:25:22.925031+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":63,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.731288+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:25:23.731288+0000","last_peered":"2024-09-10T15:25:23.731288+0000","last_clean":"2024-09-10T15:25:23.731288+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:25:23.731288+0000","last_undegraded":"2024-09-10T15:25:23.731288+0000","last_fullsized":"2024-09-10T15:25:23.731288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926807+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:25:22.926807+0000","last_peered":"2024-09-10T15:25:22.926807+0000","last_clean":"2024-09-10T15:25:22.926807+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:25:22.926807+0000","last_undegraded":"2024-09-10T15:25:22.926807+0000","last_fullsized":"2024-09-10T15:25:22.926807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877741+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:25:22.877741+0000","last_peered":"2024-09-10T15:25:22.877741+0000","last_clean":"2024-09-10T15:25:22.877741+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:25:22.877741+0000","last_undegraded":"2024-09-10T15:25:22.877741+0000","last_fullsized":"2024-09-10T15:25:22.877741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.912341+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:25:22.912341+0000","last_peered":"2024-09-10T15:25:22.912341+0000","last_clean":"2024-09-10T15:25:22.912341+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:25:22.912341+0000","last_undegraded":"2024-09-10T15:25:22.912341+0000","last_fullsized":"2024-09-10T15:25:22.912341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897813+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:22.897813+0000","last_peered":"2024-09-10T15:25:22.897813+0000","last_clean":"2024-09-10T15:25:22.897813+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:22.897813+0000","last_undegraded":"2024-09-10T15:25:22.897813+0000","last_fullsized":"2024-09-10T15:25:22.897813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879076+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:25:22.879076+0000","last_peered":"2024-09-10T15:25:22.879076+0000","last_clean":"2024-09-10T15:25:22.879076+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:25:22.879076+0000","last_undegraded":"2024-09-10T15:25:22.879076+0000","last_fullsized":"2024-09-10T15:25:22.879076+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900615+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:25:22.900615+0000","last_peered":"2024-09-10T15:25:22.900615+0000","last_clean":"2024-09-10T15:25:22.900615+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:25:22.900615+0000","last_undegraded":"2024-09-10T15:25:22.900615+0000","last_fullsized":"2024-09-10T15:25:22.900615+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.738599+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:25:23.738599+0000","last_peered":"2024-09-10T15:25:23.738599+0000","last_clean":"2024-09-10T15:25:23.738599+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:25:23.738599+0000","last_undegraded":"2024-09-10T15:25:23.738599+0000","last_fullsized":"2024-09-10T15:25:23.738599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890873+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:25:22.890873+0000","last_peered":"2024-09-10T15:25:22.890873+0000","last_clean":"2024-09-10T15:25:22.890873+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:25:22.890873+0000","last_undegraded":"2024-09-10T15:25:22.890873+0000","last_fullsized":"2024-09-10T15:25:22.890873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890091+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:25:22.890091+0000","last_peered":"2024-09-10T15:25:22.890091+0000","last_clean":"2024-09-10T15:25:22.890091+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:25:22.890091+0000","last_undegraded":"2024-09-10T15:25:22.890091+0000","last_fullsized":"2024-09-10T15:25:22.890091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910792+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:25:22.910792+0000","last_peered":"2024-09-10T15:25:22.910792+0000","last_clean":"2024-09-10T15:25:22.910792+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:25:22.910792+0000","last_undegraded":"2024-09-10T15:25:22.910792+0000","last_fullsized":"2024-09-10T15:25:22.910792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":49,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925279+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:22.925279+0000","last_peered":"2024-09-10T15:25:22.925279+0000","last_clean":"2024-09-10T15:25:22.925279+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:22.925279+0000","last_undegraded":"2024-09-10T15:25:22.925279+0000","last_fullsized":"2024-09-10T15:25:22.925279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886882+0000","last_change":"2024-09-10T15:25:11.842227+0000","last_active":"2024-09-10T15:25:22.886882+0000","last_peered":"2024-09-10T15:25:22.886882+0000","last_clean":"2024-09-10T15:25:22.886882+0000","last_became_active":"2024-09-10T15:25:11.841833+0000","last_became_peered":"2024-09-10T15:25:11.841833+0000","last_unstale":"2024-09-10T15:25:22.886882+0000","last_undegraded":"2024-09-10T15:25:22.886882+0000","last_fullsized":"2024-09-10T15:25:22.886882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900092+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:25:22.900092+0000","last_peered":"2024-09-10T15:25:22.900092+0000","last_clean":"2024-09-10T15:25:22.900092+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:25:22.900092+0000","last_undegraded":"2024-09-10T15:25:22.900092+0000","last_fullsized":"2024-09-10T15:25:22.900092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":38,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.571869+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:25:23.571869+0000","last_peered":"2024-09-10T15:25:23.571869+0000","last_clean":"2024-09-10T15:25:23.571869+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:25:23.571869+0000","last_undegraded":"2024-09-10T15:25:23.571869+0000","last_fullsized":"2024-09-10T15:25:23.571869+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925770+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:25:22.925770+0000","last_peered":"2024-09-10T15:25:22.925770+0000","last_clean":"2024-09-10T15:25:22.925770+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:25:22.925770+0000","last_undegraded":"2024-09-10T15:25:22.925770+0000","last_fullsized":"2024-09-10T15:25:22.925770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877092+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:25:22.877092+0000","last_peered":"2024-09-10T15:25:22.877092+0000","last_clean":"2024-09-10T15:25:22.877092+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:25:22.877092+0000","last_undegraded":"2024-09-10T15:25:22.877092+0000","last_fullsized":"2024-09-10T15:25:22.877092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910315+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:25:22.910315+0000","last_peered":"2024-09-10T15:25:22.910315+0000","last_clean":"2024-09-10T15:25:22.910315+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:25:22.910315+0000","last_undegraded":"2024-09-10T15:25:22.910315+0000","last_fullsized":"2024-09-10T15:25:22.910315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933486+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:25:22.933486+0000","last_peered":"2024-09-10T15:25:22.933486+0000","last_clean":"2024-09-10T15:25:22.933486+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:25:22.933486+0000","last_undegraded":"2024-09-10T15:25:22.933486+0000","last_fullsized":"2024-09-10T15:25:22.933486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879609+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:22.879609+0000","last_peered":"2024-09-10T15:25:22.879609+0000","last_clean":"2024-09-10T15:25:22.879609+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:22.879609+0000","last_undegraded":"2024-09-10T15:25:22.879609+0000","last_fullsized":"2024-09-10T15:25:22.879609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891139+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:25:22.891139+0000","last_peered":"2024-09-10T15:25:22.891139+0000","last_clean":"2024-09-10T15:25:22.891139+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:25:22.891139+0000","last_undegraded":"2024-09-10T15:25:22.891139+0000","last_fullsized":"2024-09-10T15:25:22.891139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":52,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.665989+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:25:23.665989+0000","last_peered":"2024-09-10T15:25:23.665989+0000","last_clean":"2024-09-10T15:25:23.665989+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:25:23.665989+0000","last_undegraded":"2024-09-10T15:25:23.665989+0000","last_fullsized":"2024-09-10T15:25:23.665989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931849+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:25:22.931849+0000","last_peered":"2024-09-10T15:25:22.931849+0000","last_clean":"2024-09-10T15:25:22.931849+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:25:22.931849+0000","last_undegraded":"2024-09-10T15:25:22.931849+0000","last_fullsized":"2024-09-10T15:25:22.931849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879264+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:25:22.879264+0000","last_peered":"2024-09-10T15:25:22.879264+0000","last_clean":"2024-09-10T15:25:22.879264+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:25:22.879264+0000","last_undegraded":"2024-09-10T15:25:22.879264+0000","last_fullsized":"2024-09-10T15:25:22.879264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911688+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:25:22.911688+0000","last_peered":"2024-09-10T15:25:22.911688+0000","last_clean":"2024-09-10T15:25:22.911688+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:25:22.911688+0000","last_undegraded":"2024-09-10T15:25:22.911688+0000","last_fullsized":"2024-09-10T15:25:22.911688+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911092+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:25:22.911092+0000","last_peered":"2024-09-10T15:25:22.911092+0000","last_clean":"2024-09-10T15:25:22.911092+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:25:22.911092+0000","last_undegraded":"2024-09-10T15:25:22.911092+0000","last_fullsized":"2024-09-10T15:25:22.911092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924855+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:22.924855+0000","last_peered":"2024-09-10T15:25:22.924855+0000","last_clean":"2024-09-10T15:25:22.924855+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:22.924855+0000","last_undegraded":"2024-09-10T15:25:22.924855+0000","last_fullsized":"2024-09-10T15:25:22.924855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886036+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:25:22.886036+0000","last_peered":"2024-09-10T15:25:22.886036+0000","last_clean":"2024-09-10T15:25:22.886036+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:25:22.886036+0000","last_undegraded":"2024-09-10T15:25:22.886036+0000","last_fullsized":"2024-09-10T15:25:22.886036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":41,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.761546+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:25:23.761546+0000","last_peered":"2024-09-10T15:25:23.761546+0000","last_clean":"2024-09-10T15:25:23.761546+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:25:23.761546+0000","last_undegraded":"2024-09-10T15:25:23.761546+0000","last_fullsized":"2024-09-10T15:25:23.761546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.165201+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:25:23.165201+0000","last_peered":"2024-09-10T15:25:23.165201+0000","last_clean":"2024-09-10T15:25:23.165201+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:25:23.165201+0000","last_undegraded":"2024-09-10T15:25:23.165201+0000","last_fullsized":"2024-09-10T15:25:23.165201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900666+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:25:22.900666+0000","last_peered":"2024-09-10T15:25:22.900666+0000","last_clean":"2024-09-10T15:25:22.900666+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:25:22.900666+0000","last_undegraded":"2024-09-10T15:25:22.900666+0000","last_fullsized":"2024-09-10T15:25:22.900666+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890605+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:25:22.890605+0000","last_peered":"2024-09-10T15:25:22.890605+0000","last_clean":"2024-09-10T15:25:22.890605+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:25:22.890605+0000","last_undegraded":"2024-09-10T15:25:22.890605+0000","last_fullsized":"2024-09-10T15:25:22.890605+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.893252+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:25:22.893252+0000","last_peered":"2024-09-10T15:25:22.893252+0000","last_clean":"2024-09-10T15:25:22.893252+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:25:22.893252+0000","last_undegraded":"2024-09-10T15:25:22.893252+0000","last_fullsized":"2024-09-10T15:25:22.893252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892884+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:22.892884+0000","last_peered":"2024-09-10T15:25:22.892884+0000","last_clean":"2024-09-10T15:25:22.892884+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:22.892884+0000","last_undegraded":"2024-09-10T15:25:22.892884+0000","last_fullsized":"2024-09-10T15:25:22.892884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924049+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:25:22.924049+0000","last_peered":"2024-09-10T15:25:22.924049+0000","last_clean":"2024-09-10T15:25:22.924049+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:25:22.924049+0000","last_undegraded":"2024-09-10T15:25:22.924049+0000","last_fullsized":"2024-09-10T15:25:22.924049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.721415+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:25:23.721415+0000","last_peered":"2024-09-10T15:25:23.721415+0000","last_clean":"2024-09-10T15:25:23.721415+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:25:23.721415+0000","last_undegraded":"2024-09-10T15:25:23.721415+0000","last_fullsized":"2024-09-10T15:25:23.721415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.167114+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:25:23.167114+0000","last_peered":"2024-09-10T15:25:23.167114+0000","last_clean":"2024-09-10T15:25:23.167114+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:25:23.167114+0000","last_undegraded":"2024-09-10T15:25:23.167114+0000","last_fullsized":"2024-09-10T15:25:23.167114+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878591+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:25:22.878591+0000","last_peered":"2024-09-10T15:25:22.878591+0000","last_clean":"2024-09-10T15:25:22.878591+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:25:22.878591+0000","last_undegraded":"2024-09-10T15:25:22.878591+0000","last_fullsized":"2024-09-10T15:25:22.878591+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932133+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:25:22.932133+0000","last_peered":"2024-09-10T15:25:22.932133+0000","last_clean":"2024-09-10T15:25:22.932133+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:25:22.932133+0000","last_undegraded":"2024-09-10T15:25:22.932133+0000","last_fullsized":"2024-09-10T15:25:22.932133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892683+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:25:22.892683+0000","last_peered":"2024-09-10T15:25:22.892683+0000","last_clean":"2024-09-10T15:25:22.892683+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:25:22.892683+0000","last_undegraded":"2024-09-10T15:25:22.892683+0000","last_fullsized":"2024-09-10T15:25:22.892683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":47,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925913+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:22.925913+0000","last_peered":"2024-09-10T15:25:22.925913+0000","last_clean":"2024-09-10T15:25:22.925913+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:22.925913+0000","last_undegraded":"2024-09-10T15:25:22.925913+0000","last_fullsized":"2024-09-10T15:25:22.925913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889598+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:25:22.889598+0000","last_peered":"2024-09-10T15:25:22.889598+0000","last_clean":"2024-09-10T15:25:22.889598+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:25:22.889598+0000","last_undegraded":"2024-09-10T15:25:22.889598+0000","last_fullsized":"2024-09-10T15:25:22.889598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":56,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.701114+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:25:23.701114+0000","last_peered":"2024-09-10T15:25:23.701114+0000","last_clean":"2024-09-10T15:25:23.701114+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:25:23.701114+0000","last_undegraded":"2024-09-10T15:25:23.701114+0000","last_fullsized":"2024-09-10T15:25:23.701114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890995+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:25:22.890995+0000","last_peered":"2024-09-10T15:25:22.890995+0000","last_clean":"2024-09-10T15:25:22.890995+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:25:22.890995+0000","last_undegraded":"2024-09-10T15:25:22.890995+0000","last_fullsized":"2024-09-10T15:25:22.890995+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933330+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:25:22.933330+0000","last_peered":"2024-09-10T15:25:22.933330+0000","last_clean":"2024-09-10T15:25:22.933330+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:25:22.933330+0000","last_undegraded":"2024-09-10T15:25:22.933330+0000","last_fullsized":"2024-09-10T15:25:22.933330+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892751+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:25:22.892751+0000","last_peered":"2024-09-10T15:25:22.892751+0000","last_clean":"2024-09-10T15:25:22.892751+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:25:22.892751+0000","last_undegraded":"2024-09-10T15:25:22.892751+0000","last_fullsized":"2024-09-10T15:25:22.892751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933136+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:25:22.933136+0000","last_peered":"2024-09-10T15:25:22.933136+0000","last_clean":"2024-09-10T15:25:22.933136+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:25:22.933136+0000","last_undegraded":"2024-09-10T15:25:22.933136+0000","last_fullsized":"2024-09-10T15:25:22.933136+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925355+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:25:22.925355+0000","last_peered":"2024-09-10T15:25:22.925355+0000","last_clean":"2024-09-10T15:25:22.925355+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:25:22.925355+0000","last_undegraded":"2024-09-10T15:25:22.925355+0000","last_fullsized":"2024-09-10T15:25:22.925355+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910400+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:25:22.910400+0000","last_peered":"2024-09-10T15:25:22.910400+0000","last_clean":"2024-09-10T15:25:22.910400+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:25:22.910400+0000","last_undegraded":"2024-09-10T15:25:22.910400+0000","last_fullsized":"2024-09-10T15:25:22.910400+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.770956+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:25:23.770956+0000","last_peered":"2024-09-10T15:25:23.770956+0000","last_clean":"2024-09-10T15:25:23.770956+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:25:23.770956+0000","last_undegraded":"2024-09-10T15:25:23.770956+0000","last_fullsized":"2024-09-10T15:25:23.770956+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897472+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:25:22.897472+0000","last_peered":"2024-09-10T15:25:22.897472+0000","last_clean":"2024-09-10T15:25:22.897472+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:25:22.897472+0000","last_undegraded":"2024-09-10T15:25:22.897472+0000","last_fullsized":"2024-09-10T15:25:22.897472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900522+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:25:22.900522+0000","last_peered":"2024-09-10T15:25:22.900522+0000","last_clean":"2024-09-10T15:25:22.900522+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:25:22.900522+0000","last_undegraded":"2024-09-10T15:25:22.900522+0000","last_fullsized":"2024-09-10T15:25:22.900522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890369+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:25:22.890369+0000","last_peered":"2024-09-10T15:25:22.890369+0000","last_clean":"2024-09-10T15:25:22.890369+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:25:22.890369+0000","last_undegraded":"2024-09-10T15:25:22.890369+0000","last_fullsized":"2024-09-10T15:25:22.890369+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887915+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:25:22.887915+0000","last_peered":"2024-09-10T15:25:22.887915+0000","last_clean":"2024-09-10T15:25:22.887915+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:25:22.887915+0000","last_undegraded":"2024-09-10T15:25:22.887915+0000","last_fullsized":"2024-09-10T15:25:22.887915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890606+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:25:22.890606+0000","last_peered":"2024-09-10T15:25:22.890606+0000","last_clean":"2024-09-10T15:25:22.890606+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:25:22.890606+0000","last_undegraded":"2024-09-10T15:25:22.890606+0000","last_fullsized":"2024-09-10T15:25:22.890606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.240298+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:25:23.240298+0000","last_peered":"2024-09-10T15:25:23.240298+0000","last_clean":"2024-09-10T15:25:23.240298+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:25:23.240298+0000","last_undegraded":"2024-09-10T15:25:23.240298+0000","last_fullsized":"2024-09-10T15:25:23.240298+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931777+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:25:22.931777+0000","last_peered":"2024-09-10T15:25:22.931777+0000","last_clean":"2024-09-10T15:25:22.931777+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:25:22.931777+0000","last_undegraded":"2024-09-10T15:25:22.931777+0000","last_fullsized":"2024-09-10T15:25:22.931777+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910916+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:25:22.910916+0000","last_peered":"2024-09-10T15:25:22.910916+0000","last_clean":"2024-09-10T15:25:22.910916+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:25:22.910916+0000","last_undegraded":"2024-09-10T15:25:22.910916+0000","last_fullsized":"2024-09-10T15:25:22.910916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889910+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:25:22.889910+0000","last_peered":"2024-09-10T15:25:22.889910+0000","last_clean":"2024-09-10T15:25:22.889910+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:25:22.889910+0000","last_undegraded":"2024-09-10T15:25:22.889910+0000","last_fullsized":"2024-09-10T15:25:22.889910+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.934095+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:25:22.934095+0000","last_peered":"2024-09-10T15:25:22.934095+0000","last_clean":"2024-09-10T15:25:22.934095+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:25:22.934095+0000","last_undegraded":"2024-09-10T15:25:22.934095+0000","last_fullsized":"2024-09-10T15:25:22.934095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931468+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:25:22.931468+0000","last_peered":"2024-09-10T15:25:22.931468+0000","last_clean":"2024-09-10T15:25:22.931468+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:25:22.931468+0000","last_undegraded":"2024-09-10T15:25:22.931468+0000","last_fullsized":"2024-09-10T15:25:22.931468+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.679798+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:25:23.679798+0000","last_peered":"2024-09-10T15:25:23.679798+0000","last_clean":"2024-09-10T15:25:23.679798+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:25:23.679798+0000","last_undegraded":"2024-09-10T15:25:23.679798+0000","last_fullsized":"2024-09-10T15:25:23.679798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878498+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:25:22.878498+0000","last_peered":"2024-09-10T15:25:22.878498+0000","last_clean":"2024-09-10T15:25:22.878498+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:25:22.878498+0000","last_undegraded":"2024-09-10T15:25:22.878498+0000","last_fullsized":"2024-09-10T15:25:22.878498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924649+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:25:22.924649+0000","last_peered":"2024-09-10T15:25:22.924649+0000","last_clean":"2024-09-10T15:25:22.924649+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:25:22.924649+0000","last_undegraded":"2024-09-10T15:25:22.924649+0000","last_fullsized":"2024-09-10T15:25:22.924649+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897685+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:25:22.897685+0000","last_peered":"2024-09-10T15:25:22.897685+0000","last_clean":"2024-09-10T15:25:22.897685+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:25:22.897685+0000","last_undegraded":"2024-09-10T15:25:22.897685+0000","last_fullsized":"2024-09-10T15:25:22.897685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879965+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:25:22.879965+0000","last_peered":"2024-09-10T15:25:22.879965+0000","last_clean":"2024-09-10T15:25:22.879965+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:25:22.879965+0000","last_undegraded":"2024-09-10T15:25:22.879965+0000","last_fullsized":"2024-09-10T15:25:22.879965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923780+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:25:22.923780+0000","last_peered":"2024-09-10T15:25:22.923780+0000","last_clean":"2024-09-10T15:25:22.923780+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:25:22.923780+0000","last_undegraded":"2024-09-10T15:25:22.923780+0000","last_fullsized":"2024-09-10T15:25:22.923780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.452288+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:25:23.452288+0000","last_peered":"2024-09-10T15:25:23.452288+0000","last_clean":"2024-09-10T15:25:23.452288+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:25:23.452288+0000","last_undegraded":"2024-09-10T15:25:23.452288+0000","last_fullsized":"2024-09-10T15:25:23.452288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.898924+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:25:22.898924+0000","last_peered":"2024-09-10T15:25:22.898924+0000","last_clean":"2024-09-10T15:25:22.898924+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:25:22.898924+0000","last_undegraded":"2024-09-10T15:25:22.898924+0000","last_fullsized":"2024-09-10T15:25:22.898924+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925283+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:25:22.925283+0000","last_peered":"2024-09-10T15:25:22.925283+0000","last_clean":"2024-09-10T15:25:22.925283+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:25:22.925283+0000","last_undegraded":"2024-09-10T15:25:22.925283+0000","last_fullsized":"2024-09-10T15:25:22.925283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878123+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:25:22.878123+0000","last_peered":"2024-09-10T15:25:22.878123+0000","last_clean":"2024-09-10T15:25:22.878123+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:25:22.878123+0000","last_undegraded":"2024-09-10T15:25:22.878123+0000","last_fullsized":"2024-09-10T15:25:22.878123+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.912234+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:25:22.912234+0000","last_peered":"2024-09-10T15:25:22.912234+0000","last_clean":"2024-09-10T15:25:22.912234+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:25:22.912234+0000","last_undegraded":"2024-09-10T15:25:22.912234+0000","last_fullsized":"2024-09-10T15:25:22.912234+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.799473+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:25:23.799473+0000","last_peered":"2024-09-10T15:25:23.799473+0000","last_clean":"2024-09-10T15:25:23.799473+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:25:23.799473+0000","last_undegraded":"2024-09-10T15:25:23.799473+0000","last_fullsized":"2024-09-10T15:25:23.799473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933356+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:25:22.933356+0000","last_peered":"2024-09-10T15:25:22.933356+0000","last_clean":"2024-09-10T15:25:22.933356+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:25:22.933356+0000","last_undegraded":"2024-09-10T15:25:22.933356+0000","last_fullsized":"2024-09-10T15:25:22.933356+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877814+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:25:22.877814+0000","last_peered":"2024-09-10T15:25:22.877814+0000","last_clean":"2024-09-10T15:25:22.877814+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:25:22.877814+0000","last_undegraded":"2024-09-10T15:25:22.877814+0000","last_fullsized":"2024-09-10T15:25:22.877814+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892652+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:25:22.892652+0000","last_peered":"2024-09-10T15:25:22.892652+0000","last_clean":"2024-09-10T15:25:22.892652+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:25:22.892652+0000","last_undegraded":"2024-09-10T15:25:22.892652+0000","last_fullsized":"2024-09-10T15:25:22.892652+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890630+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:25:22.890630+0000","last_peered":"2024-09-10T15:25:22.890630+0000","last_clean":"2024-09-10T15:25:22.890630+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:25:22.890630+0000","last_undegraded":"2024-09-10T15:25:22.890630+0000","last_fullsized":"2024-09-10T15:25:22.890630+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933432+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:25:22.933432+0000","last_peered":"2024-09-10T15:25:22.933432+0000","last_clean":"2024-09-10T15:25:22.933432+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:25:22.933432+0000","last_undegraded":"2024-09-10T15:25:22.933432+0000","last_fullsized":"2024-09-10T15:25:22.933432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.581939+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:25:23.581939+0000","last_peered":"2024-09-10T15:25:23.581939+0000","last_clean":"2024-09-10T15:25:23.581939+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:25:23.581939+0000","last_undegraded":"2024-09-10T15:25:23.581939+0000","last_fullsized":"2024-09-10T15:25:23.581939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878154+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:25:22.878154+0000","last_peered":"2024-09-10T15:25:22.878154+0000","last_clean":"2024-09-10T15:25:22.878154+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:25:22.878154+0000","last_undegraded":"2024-09-10T15:25:22.878154+0000","last_fullsized":"2024-09-10T15:25:22.878154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925336+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:25:22.925336+0000","last_peered":"2024-09-10T15:25:22.925336+0000","last_clean":"2024-09-10T15:25:22.925336+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:25:22.925336+0000","last_undegraded":"2024-09-10T15:25:22.925336+0000","last_fullsized":"2024-09-10T15:25:22.925336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900159+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:25:22.900159+0000","last_peered":"2024-09-10T15:25:22.900159+0000","last_clean":"2024-09-10T15:25:22.900159+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:25:22.900159+0000","last_undegraded":"2024-09-10T15:25:22.900159+0000","last_fullsized":"2024-09-10T15:25:22.900159+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879052+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:25:22.879052+0000","last_peered":"2024-09-10T15:25:22.879052+0000","last_clean":"2024-09-10T15:25:22.879052+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:25:22.879052+0000","last_undegraded":"2024-09-10T15:25:22.879052+0000","last_fullsized":"2024-09-10T15:25:22.879052+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933772+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:25:22.933772+0000","last_peered":"2024-09-10T15:25:22.933772+0000","last_clean":"2024-09-10T15:25:22.933772+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:25:22.933772+0000","last_undegraded":"2024-09-10T15:25:22.933772+0000","last_fullsized":"2024-09-10T15:25:22.933772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.778274+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:25:23.778274+0000","last_peered":"2024-09-10T15:25:23.778274+0000","last_clean":"2024-09-10T15:25:23.778274+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:25:23.778274+0000","last_undegraded":"2024-09-10T15:25:23.778274+0000","last_fullsized":"2024-09-10T15:25:23.778274+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900189+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:25:22.900189+0000","last_peered":"2024-09-10T15:25:22.900189+0000","last_clean":"2024-09-10T15:25:22.900189+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:25:22.900189+0000","last_undegraded":"2024-09-10T15:25:22.900189+0000","last_fullsized":"2024-09-10T15:25:22.900189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923799+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:25:22.923799+0000","last_peered":"2024-09-10T15:25:22.923799+0000","last_clean":"2024-09-10T15:25:22.923799+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:25:22.923799+0000","last_undegraded":"2024-09-10T15:25:22.923799+0000","last_fullsized":"2024-09-10T15:25:22.923799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891509+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:25:22.891509+0000","last_peered":"2024-09-10T15:25:22.891509+0000","last_clean":"2024-09-10T15:25:22.891509+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:25:22.891509+0000","last_undegraded":"2024-09-10T15:25:22.891509+0000","last_fullsized":"2024-09-10T15:25:22.891509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891824+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:25:22.891824+0000","last_peered":"2024-09-10T15:25:22.891824+0000","last_clean":"2024-09-10T15:25:22.891824+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:25:22.891824+0000","last_undegraded":"2024-09-10T15:25:22.891824+0000","last_fullsized":"2024-09-10T15:25:22.891824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891200+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:25:22.891200+0000","last_peered":"2024-09-10T15:25:22.891200+0000","last_clean":"2024-09-10T15:25:22.891200+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:25:22.891200+0000","last_undegraded":"2024-09-10T15:25:22.891200+0000","last_fullsized":"2024-09-10T15:25:22.891200+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.755577+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:25:23.755577+0000","last_peered":"2024-09-10T15:25:23.755577+0000","last_clean":"2024-09-10T15:25:23.755577+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:25:23.755577+0000","last_undegraded":"2024-09-10T15:25:23.755577+0000","last_fullsized":"2024-09-10T15:25:23.755577+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.165940+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:25:23.165940+0000","last_peered":"2024-09-10T15:25:23.165940+0000","last_clean":"2024-09-10T15:25:23.165940+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:25:23.165940+0000","last_undegraded":"2024-09-10T15:25:23.165940+0000","last_fullsized":"2024-09-10T15:25:23.165940+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923566+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:25:22.923566+0000","last_peered":"2024-09-10T15:25:22.923566+0000","last_clean":"2024-09-10T15:25:22.923566+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:25:22.923566+0000","last_undegraded":"2024-09-10T15:25:22.923566+0000","last_fullsized":"2024-09-10T15:25:22.923566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933039+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:25:22.933039+0000","last_peered":"2024-09-10T15:25:22.933039+0000","last_clean":"2024-09-10T15:25:22.933039+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:25:22.933039+0000","last_undegraded":"2024-09-10T15:25:22.933039+0000","last_fullsized":"2024-09-10T15:25:22.933039+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879650+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:25:22.879650+0000","last_peered":"2024-09-10T15:25:22.879650+0000","last_clean":"2024-09-10T15:25:22.879650+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:25:22.879650+0000","last_undegraded":"2024-09-10T15:25:22.879650+0000","last_fullsized":"2024-09-10T15:25:22.879650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878490+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:25:22.878490+0000","last_peered":"2024-09-10T15:25:22.878490+0000","last_clean":"2024-09-10T15:25:22.878490+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:25:22.878490+0000","last_undegraded":"2024-09-10T15:25:22.878490+0000","last_fullsized":"2024-09-10T15:25:22.878490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":45,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.792217+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:25:23.792217+0000","last_peered":"2024-09-10T15:25:23.792217+0000","last_clean":"2024-09-10T15:25:23.792217+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:25:23.792217+0000","last_undegraded":"2024-09-10T15:25:23.792217+0000","last_fullsized":"2024-09-10T15:25:23.792217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889725+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:25:22.889725+0000","last_peered":"2024-09-10T15:25:22.889725+0000","last_clean":"2024-09-10T15:25:22.889725+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:25:22.889725+0000","last_undegraded":"2024-09-10T15:25:22.889725+0000","last_fullsized":"2024-09-10T15:25:22.889725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879864+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:25:22.879864+0000","last_peered":"2024-09-10T15:25:22.879864+0000","last_clean":"2024-09-10T15:25:22.879864+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:25:22.879864+0000","last_undegraded":"2024-09-10T15:25:22.879864+0000","last_fullsized":"2024-09-10T15:25:22.879864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932059+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:25:22.932059+0000","last_peered":"2024-09-10T15:25:22.932059+0000","last_clean":"2024-09-10T15:25:22.932059+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:25:22.932059+0000","last_undegraded":"2024-09-10T15:25:22.932059+0000","last_fullsized":"2024-09-10T15:25:22.932059+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926116+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:25:22.926116+0000","last_peered":"2024-09-10T15:25:22.926116+0000","last_clean":"2024-09-10T15:25:22.926116+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:25:22.926116+0000","last_undegraded":"2024-09-10T15:25:22.926116+0000","last_fullsized":"2024-09-10T15:25:22.926116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.932846+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:25:22.932846+0000","last_peered":"2024-09-10T15:25:22.932846+0000","last_clean":"2024-09-10T15:25:22.932846+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:25:22.932846+0000","last_undegraded":"2024-09-10T15:25:22.932846+0000","last_fullsized":"2024-09-10T15:25:22.932846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.191933+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:25:23.191933+0000","last_peered":"2024-09-10T15:25:23.191933+0000","last_clean":"2024-09-10T15:25:23.191933+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:25:23.191933+0000","last_undegraded":"2024-09-10T15:25:23.191933+0000","last_fullsized":"2024-09-10T15:25:23.191933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924093+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:25:22.924093+0000","last_peered":"2024-09-10T15:25:22.924093+0000","last_clean":"2024-09-10T15:25:22.924093+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:25:22.924093+0000","last_undegraded":"2024-09-10T15:25:22.924093+0000","last_fullsized":"2024-09-10T15:25:22.924093+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878776+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:25:22.878776+0000","last_peered":"2024-09-10T15:25:22.878776+0000","last_clean":"2024-09-10T15:25:22.878776+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:25:22.878776+0000","last_undegraded":"2024-09-10T15:25:22.878776+0000","last_fullsized":"2024-09-10T15:25:22.878776+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897657+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:25:22.897657+0000","last_peered":"2024-09-10T15:25:22.897657+0000","last_clean":"2024-09-10T15:25:22.897657+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:25:22.897657+0000","last_undegraded":"2024-09-10T15:25:22.897657+0000","last_fullsized":"2024-09-10T15:25:22.897657+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879966+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:25:22.879966+0000","last_peered":"2024-09-10T15:25:22.879966+0000","last_clean":"2024-09-10T15:25:22.879966+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:25:22.879966+0000","last_undegraded":"2024-09-10T15:25:22.879966+0000","last_fullsized":"2024-09-10T15:25:22.879966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":26,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877253+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:25:22.877253+0000","last_peered":"2024-09-10T15:25:22.877253+0000","last_clean":"2024-09-10T15:25:22.877253+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:25:22.877253+0000","last_undegraded":"2024-09-10T15:25:22.877253+0000","last_fullsized":"2024-09-10T15:25:22.877253+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":30,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.404148+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:25:23.404148+0000","last_peered":"2024-09-10T15:25:23.404148+0000","last_clean":"2024-09-10T15:25:23.404148+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:25:23.404148+0000","last_undegraded":"2024-09-10T15:25:23.404148+0000","last_fullsized":"2024-09-10T15:25:23.404148+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.923853+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:25:22.923853+0000","last_peered":"2024-09-10T15:25:22.923853+0000","last_clean":"2024-09-10T15:25:22.923853+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:25:22.923853+0000","last_undegraded":"2024-09-10T15:25:22.923853+0000","last_fullsized":"2024-09-10T15:25:22.923853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925658+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:25:22.925658+0000","last_peered":"2024-09-10T15:25:22.925658+0000","last_clean":"2024-09-10T15:25:22.925658+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:25:22.925658+0000","last_undegraded":"2024-09-10T15:25:22.925658+0000","last_fullsized":"2024-09-10T15:25:22.925658+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931593+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:25:22.931593+0000","last_peered":"2024-09-10T15:25:22.931593+0000","last_clean":"2024-09-10T15:25:22.931593+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:25:22.931593+0000","last_undegraded":"2024-09-10T15:25:22.931593+0000","last_fullsized":"2024-09-10T15:25:22.931593+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879732+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:25:22.879732+0000","last_peered":"2024-09-10T15:25:22.879732+0000","last_clean":"2024-09-10T15:25:22.879732+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:25:22.879732+0000","last_undegraded":"2024-09-10T15:25:22.879732+0000","last_fullsized":"2024-09-10T15:25:22.879732+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":25,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.889526+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:25:22.889526+0000","last_peered":"2024-09-10T15:25:22.889526+0000","last_clean":"2024-09-10T15:25:22.889526+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:25:22.889526+0000","last_undegraded":"2024-09-10T15:25:22.889526+0000","last_fullsized":"2024-09-10T15:25:22.889526+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":36,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:23.475271+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:25:23.475271+0000","last_peered":"2024-09-10T15:25:23.475271+0000","last_clean":"2024-09-10T15:25:23.475271+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:25:23.475271+0000","last_undegraded":"2024-09-10T15:25:23.475271+0000","last_fullsized":"2024-09-10T15:25:23.475271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891446+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:25:22.891446+0000","last_peered":"2024-09-10T15:25:22.891446+0000","last_clean":"2024-09-10T15:25:22.891446+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:25:22.891446+0000","last_undegraded":"2024-09-10T15:25:22.891446+0000","last_fullsized":"2024-09-10T15:25:22.891446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887714+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:25:22.887714+0000","last_peered":"2024-09-10T15:25:22.887714+0000","last_clean":"2024-09-10T15:25:22.887714+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:25:22.887714+0000","last_undegraded":"2024-09-10T15:25:22.887714+0000","last_fullsized":"2024-09-10T15:25:22.887714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.893112+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:25:22.893112+0000","last_peered":"2024-09-10T15:25:22.893112+0000","last_clean":"2024-09-10T15:25:22.893112+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:25:22.893112+0000","last_undegraded":"2024-09-10T15:25:22.893112+0000","last_fullsized":"2024-09-10T15:25:22.893112+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.931919+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:25:22.931919+0000","last_peered":"2024-09-10T15:25:22.931919+0000","last_clean":"2024-09-10T15:25:22.931919+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:25:22.931919+0000","last_undegraded":"2024-09-10T15:25:22.931919+0000","last_fullsized":"2024-09-10T15:25:22.931919+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900790+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:25:22.900790+0000","last_peered":"2024-09-10T15:25:22.900790+0000","last_clean":"2024-09-10T15:25:22.900790+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:25:22.900790+0000","last_undegraded":"2024-09-10T15:25:22.900790+0000","last_fullsized":"2024-09-10T15:25:22.900790+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.897526+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:25:22.897526+0000","last_peered":"2024-09-10T15:25:22.897526+0000","last_clean":"2024-09-10T15:25:22.897526+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:25:22.897526+0000","last_undegraded":"2024-09-10T15:25:22.897526+0000","last_fullsized":"2024-09-10T15:25:22.897526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925806+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:25:22.925806+0000","last_peered":"2024-09-10T15:25:22.925806+0000","last_clean":"2024-09-10T15:25:22.925806+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:25:22.925806+0000","last_undegraded":"2024-09-10T15:25:22.925806+0000","last_fullsized":"2024-09-10T15:25:22.925806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924818+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:25:22.924818+0000","last_peered":"2024-09-10T15:25:22.924818+0000","last_clean":"2024-09-10T15:25:22.924818+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:25:22.924818+0000","last_undegraded":"2024-09-10T15:25:22.924818+0000","last_fullsized":"2024-09-10T15:25:22.924818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879433+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:25:22.879433+0000","last_peered":"2024-09-10T15:25:22.879433+0000","last_clean":"2024-09-10T15:25:22.879433+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:25:22.879433+0000","last_undegraded":"2024-09-10T15:25:22.879433+0000","last_fullsized":"2024-09-10T15:25:22.879433+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879253+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:25:22.879253+0000","last_peered":"2024-09-10T15:25:22.879253+0000","last_clean":"2024-09-10T15:25:22.879253+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:25:22.879253+0000","last_undegraded":"2024-09-10T15:25:22.879253+0000","last_fullsized":"2024-09-10T15:25:22.879253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878315+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:25:22.878315+0000","last_peered":"2024-09-10T15:25:22.878315+0000","last_clean":"2024-09-10T15:25:22.878315+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:25:22.878315+0000","last_undegraded":"2024-09-10T15:25:22.878315+0000","last_fullsized":"2024-09-10T15:25:22.878315+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911064+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:25:22.911064+0000","last_peered":"2024-09-10T15:25:22.911064+0000","last_clean":"2024-09-10T15:25:22.911064+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:25:22.911064+0000","last_undegraded":"2024-09-10T15:25:22.911064+0000","last_fullsized":"2024-09-10T15:25:22.911064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.886325+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:25:22.886325+0000","last_peered":"2024-09-10T15:25:22.886325+0000","last_clean":"2024-09-10T15:25:22.886325+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:25:22.886325+0000","last_undegraded":"2024-09-10T15:25:22.886325+0000","last_fullsized":"2024-09-10T15:25:22.886325+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.911915+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:25:22.911915+0000","last_peered":"2024-09-10T15:25:22.911915+0000","last_clean":"2024-09-10T15:25:22.911915+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:25:22.911915+0000","last_undegraded":"2024-09-10T15:25:22.911915+0000","last_fullsized":"2024-09-10T15:25:22.911915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.910164+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:25:22.910164+0000","last_peered":"2024-09-10T15:25:22.910164+0000","last_clean":"2024-09-10T15:25:22.910164+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:25:22.910164+0000","last_undegraded":"2024-09-10T15:25:22.910164+0000","last_fullsized":"2024-09-10T15:25:22.910164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.933972+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:25:22.933972+0000","last_peered":"2024-09-10T15:25:22.933972+0000","last_clean":"2024-09-10T15:25:22.933972+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:25:22.933972+0000","last_undegraded":"2024-09-10T15:25:22.933972+0000","last_fullsized":"2024-09-10T15:25:22.933972+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877759+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:25:22.877759+0000","last_peered":"2024-09-10T15:25:22.877759+0000","last_clean":"2024-09-10T15:25:22.877759+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:25:22.877759+0000","last_undegraded":"2024-09-10T15:25:22.877759+0000","last_fullsized":"2024-09-10T15:25:22.877759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879423+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:25:22.879423+0000","last_peered":"2024-09-10T15:25:22.879423+0000","last_clean":"2024-09-10T15:25:22.879423+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:25:22.879423+0000","last_undegraded":"2024-09-10T15:25:22.879423+0000","last_fullsized":"2024-09-10T15:25:22.879423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.901113+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:25:22.901113+0000","last_peered":"2024-09-10T15:25:22.901113+0000","last_clean":"2024-09-10T15:25:22.901113+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:25:22.901113+0000","last_undegraded":"2024-09-10T15:25:22.901113+0000","last_fullsized":"2024-09-10T15:25:22.901113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924147+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:25:22.924147+0000","last_peered":"2024-09-10T15:25:22.924147+0000","last_clean":"2024-09-10T15:25:22.924147+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:25:22.924147+0000","last_undegraded":"2024-09-10T15:25:22.924147+0000","last_fullsized":"2024-09-10T15:25:22.924147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887690+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:25:22.887690+0000","last_peered":"2024-09-10T15:25:22.887690+0000","last_clean":"2024-09-10T15:25:22.887690+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:25:22.887690+0000","last_undegraded":"2024-09-10T15:25:22.887690+0000","last_fullsized":"2024-09-10T15:25:22.887690+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877843+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:25:22.877843+0000","last_peered":"2024-09-10T15:25:22.877843+0000","last_clean":"2024-09-10T15:25:22.877843+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:25:22.877843+0000","last_undegraded":"2024-09-10T15:25:22.877843+0000","last_fullsized":"2024-09-10T15:25:22.877843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878759+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:25:22.878759+0000","last_peered":"2024-09-10T15:25:22.878759+0000","last_clean":"2024-09-10T15:25:22.878759+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:25:22.878759+0000","last_undegraded":"2024-09-10T15:25:22.878759+0000","last_fullsized":"2024-09-10T15:25:22.878759+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878784+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:25:22.878784+0000","last_peered":"2024-09-10T15:25:22.878784+0000","last_clean":"2024-09-10T15:25:22.878784+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:25:22.878784+0000","last_undegraded":"2024-09-10T15:25:22.878784+0000","last_fullsized":"2024-09-10T15:25:22.878784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.879192+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:22.879192+0000","last_peered":"2024-09-10T15:25:22.879192+0000","last_clean":"2024-09-10T15:25:22.879192+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:25:22.879192+0000","last_undegraded":"2024-09-10T15:25:22.879192+0000","last_fullsized":"2024-09-10T15:25:22.879192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.891706+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:25:22.891706+0000","last_peered":"2024-09-10T15:25:22.891706+0000","last_clean":"2024-09-10T15:25:22.891706+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:25:22.891706+0000","last_undegraded":"2024-09-10T15:25:22.891706+0000","last_fullsized":"2024-09-10T15:25:22.891706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.878862+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:25:22.878862+0000","last_peered":"2024-09-10T15:25:22.878862+0000","last_clean":"2024-09-10T15:25:22.878862+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:25:22.878862+0000","last_undegraded":"2024-09-10T15:25:22.878862+0000","last_fullsized":"2024-09-10T15:25:22.878862+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.887257+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:25:22.887257+0000","last_peered":"2024-09-10T15:25:22.887257+0000","last_clean":"2024-09-10T15:25:22.887257+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:25:22.887257+0000","last_undegraded":"2024-09-10T15:25:22.887257+0000","last_fullsized":"2024-09-10T15:25:22.887257+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.898271+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:25:22.898271+0000","last_peered":"2024-09-10T15:25:22.898271+0000","last_clean":"2024-09-10T15:25:22.898271+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:25:22.898271+0000","last_undegraded":"2024-09-10T15:25:22.898271+0000","last_fullsized":"2024-09-10T15:25:22.898271+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.926361+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:25:22.926361+0000","last_peered":"2024-09-10T15:25:22.926361+0000","last_clean":"2024-09-10T15:25:22.926361+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:25:22.926361+0000","last_undegraded":"2024-09-10T15:25:22.926361+0000","last_fullsized":"2024-09-10T15:25:22.926361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.890263+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:25:22.890263+0000","last_peered":"2024-09-10T15:25:22.890263+0000","last_clean":"2024-09-10T15:25:22.890263+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:25:22.890263+0000","last_undegraded":"2024-09-10T15:25:22.890263+0000","last_fullsized":"2024-09-10T15:25:22.890263+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.900995+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:25:22.900995+0000","last_peered":"2024-09-10T15:25:22.900995+0000","last_clean":"2024-09-10T15:25:22.900995+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:25:22.900995+0000","last_undegraded":"2024-09-10T15:25:22.900995+0000","last_fullsized":"2024-09-10T15:25:22.900995+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877735+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:25:22.877735+0000","last_peered":"2024-09-10T15:25:22.877735+0000","last_clean":"2024-09-10T15:25:22.877735+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:25:22.877735+0000","last_undegraded":"2024-09-10T15:25:22.877735+0000","last_fullsized":"2024-09-10T15:25:22.877735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.925903+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:25:22.925903+0000","last_peered":"2024-09-10T15:25:22.925903+0000","last_clean":"2024-09-10T15:25:22.925903+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:25:22.925903+0000","last_undegraded":"2024-09-10T15:25:22.925903+0000","last_fullsized":"2024-09-10T15:25:22.925903+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.924059+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:25:22.924059+0000","last_peered":"2024-09-10T15:25:22.924059+0000","last_clean":"2024-09-10T15:25:22.924059+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:25:22.924059+0000","last_undegraded":"2024-09-10T15:25:22.924059+0000","last_fullsized":"2024-09-10T15:25:22.924059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.892928+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:25:22.892928+0000","last_peered":"2024-09-10T15:25:22.892928+0000","last_clean":"2024-09-10T15:25:22.892928+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:25:22.892928+0000","last_undegraded":"2024-09-10T15:25:22.892928+0000","last_fullsized":"2024-09-10T15:25:22.892928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.877491+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:25:22.877491+0000","last_peered":"2024-09-10T15:25:22.877491+0000","last_clean":"2024-09-10T15:25:22.877491+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:25:22.877491+0000","last_undegraded":"2024-09-10T15:25:22.877491+0000","last_fullsized":"2024-09-10T15:25:22.877491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-10T15:25:22.880097+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:25:22.880097+0000","last_peered":"2024-09-10T15:25:22.880097+0000","last_clean":"2024-09-10T15:25:22.880097+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:25:22.880097+0000","last_undegraded":"2024-09-10T15:25:22.880097+0000","last_fullsized":"2024-09-10T15:25:22.880097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":425984,"data_stored":174583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":430080,"data_stored":175631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1019904,"data_stored":765097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":434176,"data_stored":175768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":421888,"data_stored":174464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":401408,"data_stored":174069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1048576,"data_stored":766027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":175677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:30.277 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T15:25:30.277 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 35 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:fsid 4e8f2598-e62a-4186-9762-b22671b00e14 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-09-10T15:24:44.086812+0000 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:modified 2024-09-10T15:25:22.870023+0000 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:crush_version 4 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:full_ratio 0.95 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:backfillfull_ratio 0.9 2024-09-10T15:25:30.604 INFO:teuthology.orchestra.run.smithi099.stdout:nearfull_ratio 0.85 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:require_min_compat_client luminous 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:min_compat_client jewel 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:require_osd_release squid 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:stretch_mode_enabled false 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 4.98 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 25 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 27 flags hashpspool stripe_width 0 application rgw read_balance_score 1.13 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 29 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 31 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-10T15:25:30.605 INFO:teuthology.orchestra.run.smithi099.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 33 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 35 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:max_osd 8 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6808/2528983694,v1:172.21.15.99:6809/2528983694] [v2:172.21.15.99:6810/2528983694,v1:172.21.15.99:6811/2528983694] exists,up 81adb850-6bce-4c6a-b91d-d1014dab2114 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/3085897297,v1:172.21.15.99:6801/3085897297] [v2:172.21.15.99:6802/3085897297,v1:172.21.15.99:6803/3085897297] exists,up 266bd277-c43f-45f2-b407-939f7fe60124 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6816/4016938445,v1:172.21.15.99:6817/4016938445] [v2:172.21.15.99:6818/4016938445,v1:172.21.15.99:6819/4016938445] exists,up 8e25e2db-5b96-49e8-84c8-f2c1aec51ca2 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6824/1667351160,v1:172.21.15.99:6825/1667351160] [v2:172.21.15.99:6826/1667351160,v1:172.21.15.99:6827/1667351160] exists,up 007bc137-a3a2-40a8-8133-e899cdc6b3d8 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6824/1728711275,v1:172.21.15.159:6825/1728711275] [v2:172.21.15.159:6826/1728711275,v1:172.21.15.159:6827/1728711275] exists,up 7883a376-330f-4123-9d53-b2d16009b55f 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6800/1301853491,v1:172.21.15.159:6801/1301853491] [v2:172.21.15.159:6802/1301853491,v1:172.21.15.159:6803/1301853491] exists,up f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6816/1076897158,v1:172.21.15.159:6817/1076897158] [v2:172.21.15.159:6818/1076897158,v1:172.21.15.159:6819/1076897158] exists,up 54a77e0e-03c3-44d4-baed-702a89305ed8 2024-09-10T15:25:30.606 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6808/989502281,v1:172.21.15.159:6809/989502281] [v2:172.21.15.159:6810/989502281,v1:172.21.15.159:6811/989502281] exists,up fd400894-7e05-4aab-8a22-5b2f345ee140 2024-09-10T15:25:30.622 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6808/2528983694,v1:172.21.15.99:6809/2528983694] [v2:172.21.15.99:6810/2528983694,v1:172.21.15.99:6811/2528983694] exists,up 81adb850-6bce-4c6a-b91d-d1014dab2114', 'osd.1 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6800/3085897297,v1:172.21.15.99:6801/3085897297] [v2:172.21.15.99:6802/3085897297,v1:172.21.15.99:6803/3085897297] exists,up 266bd277-c43f-45f2-b407-939f7fe60124', 'osd.2 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6816/4016938445,v1:172.21.15.99:6817/4016938445] [v2:172.21.15.99:6818/4016938445,v1:172.21.15.99:6819/4016938445] exists,up 8e25e2db-5b96-49e8-84c8-f2c1aec51ca2', 'osd.3 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.99:6824/1667351160,v1:172.21.15.99:6825/1667351160] [v2:172.21.15.99:6826/1667351160,v1:172.21.15.99:6827/1667351160] exists,up 007bc137-a3a2-40a8-8133-e899cdc6b3d8', 'osd.4 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6824/1728711275,v1:172.21.15.159:6825/1728711275] [v2:172.21.15.159:6826/1728711275,v1:172.21.15.159:6827/1728711275] exists,up 7883a376-330f-4123-9d53-b2d16009b55f', 'osd.5 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6800/1301853491,v1:172.21.15.159:6801/1301853491] [v2:172.21.15.159:6802/1301853491,v1:172.21.15.159:6803/1301853491] exists,up f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8', 'osd.6 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6816/1076897158,v1:172.21.15.159:6817/1076897158] [v2:172.21.15.159:6818/1076897158,v1:172.21.15.159:6819/1076897158] exists,up 54a77e0e-03c3-44d4-baed-702a89305ed8', 'osd.7 up in weight 1 up_from 13 up_thru 33 down_at 0 last_clean_interval [0,0) [v2:172.21.15.159:6808/989502281,v1:172.21.15.159:6809/989502281] [v2:172.21.15.159:6810/989502281,v1:172.21.15.159:6811/989502281] exists,up fd400894-7e05-4aab-8a22-5b2f345ee140'] 2024-09-10T15:25:30.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-10T15:25:30.737 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:30.737 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "mon.a", 2024-09-10T15:25:30.737 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster": "ceph", 2024-09-10T15:25:30.737 INFO:teuthology.orchestra.run.smithi099.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "admin_socket_mode": "", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_client_required": "cephx, none", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_cluster_required": "cephx", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_debug": "true", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_service_required": "cephx", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "auth_supported": "cephx", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_aio": "true", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-10T15:25:30.738 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_aio_poll_ms": "250", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_aio_reap_max": "16", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_async_discard": "false", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_block_size": "4096", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_debug_aio": "false", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_debug_inflight_ios": "false", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_enable_discard": "false", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_flock_retry": "3", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_inject_crash": "0", 2024-09-10T15:25:30.739 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_ioring": "false", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_ioring_hipri": "false", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bdev_type": "", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_alloc_size": "1048576", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_allocator": "hybrid", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_buffered_io": "true", 2024-09-10T15:25:30.740 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_check_for_zeros": "false", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_compact_log_sync": "false", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_max_log_runway": "4194304", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_max_prefetch": "1048576", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_min_flush_size": "524288", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_min_log_runway": "1048576", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_replay_recovery": "false", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-10T15:25:30.741 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluefs_sync_write": "false", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_allocation_from_file": "true", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_allocator": "hybrid", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bdev_label_multi": "true", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-10T15:25:30.742 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_create": "true", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_db_create": "false", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_db_path": "", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_db_size": "0", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_path": "", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_preallocate_file": "false", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_size": "107374182400", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_wal_create": "false", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_wal_path": "", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_block_wal_size": "100663296", 2024-09-10T15:25:30.743 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bluefs": "true", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_autotune": "true", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-10T15:25:30.744 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_size": "0", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cache_type": "2q", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_clone_cow": "true", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-10T15:25:30.745 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_mode": "none", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_csum_type": "crc32c", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_freelist": "false", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-10T15:25:30.746 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_small_allocations": "0", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_default_buffered_read": "true", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_default_buffered_write": "false", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-10T15:25:30.747 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fail_eio": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_on_mount": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-10T15:25:30.748 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_on_umount": "false", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_ignore_data_csum": "false", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-10T15:25:30.749 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_log_op_age": "5.000000", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_max_alloc_size": "0", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_max_blob_size": "0", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_max_deferred_txc": "32", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_min_alloc_size": "0", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_nid_prealloc": "1024", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-10T15:25:30.750 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_retry_disk_reads": "3", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_rocksdb_cf": "true", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_spdk_mem": "512", 2024-09-10T15:25:30.751 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_tracing": "false", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-10T15:25:30.752 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "bluestore_zero_block_detection": "false", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-10T15:25:30.753 INFO:teuthology.orchestra.run.smithi099.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_cluster_require_signatures": "false", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_cluster_require_version": "2", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_require_signatures": "false", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_require_version": "2", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_service_require_signatures": "false", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_service_require_version": "2", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "cephx_sign_messages": "true", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "chdir": "", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_acl_type": "", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_asio_thread_count": "2", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_cache_mid": "0.750000", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_cache_size": "16384", 2024-09-10T15:25:30.754 INFO:teuthology.orchestra.run.smithi099.stdout: "client_caps_release_delay": "5", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_check_pool_perm": "true", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_debug_force_sync_read": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_debug_getattr_caps": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_debug_inject_features": "", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_debug_inject_tick_delay": "0", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_die_on_failed_remount": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_dirsize_rbytes": "true", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_force_lazyio": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_fs": "", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_inject_release_failure": "false", 2024-09-10T15:25:30.755 INFO:teuthology.orchestra.run.smithi099.stdout: "client_max_inline_size": "4096", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_mds_namespace": "", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_metadata": "", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_mount_gid": "-1", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_mount_timeout": "300", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_mount_uid": "-1", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_mountpoint": "/", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_notify_timeout": "10", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_oc": "true", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_oc_max_dirty": "104857600", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_oc_max_objects": "1000", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_oc_size": "209715200", 2024-09-10T15:25:30.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_oc_target_dirty": "8388608", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_permissions": "true", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_quota": "true", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_quota_df": "true", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_readahead_max_bytes": "0", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_readahead_max_periods": "4", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_readahead_min": "131072", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_reconnect_stale": "false", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_shutdown_timeout": "30", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_snapdir": ".snap", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_tick_interval": "1", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_trace": "", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_try_dentry_invalidate": "false", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_use_faked_inos": "false", 2024-09-10T15:25:30.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_use_random_mds": "false", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_graylog": "false", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_graylog_port": "12201", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_monitors": "default=true", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_syslog": "false", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "clog_to_syslog_level": "info", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "-", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_network": "", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_network_interface": "", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "compressor_zlib_isal": "false", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "compressor_zlib_level": "5", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "compressor_zlib_winsize": "-15", 2024-09-10T15:25:30.758 INFO:teuthology.orchestra.run.smithi099.stdout: "compressor_zstd_level": "1", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_alien_op_num_threads": "6", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_osd_stat_interval": "0", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_seastar_cpu_cores": "", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crimson_seastar_num_threads": "0", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_location": "", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_location_hook": "", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_location_hook_timeout": "10", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "daemonize": "false", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "daos_pool": "tank", 2024-09-10T15:25:30.759 INFO:teuthology.orchestra.run.smithi099.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_alienstore": "0/5", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_allow_any_pool_priority": "false", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_asok": "1/5", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_asok_assert_abort": "false", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_asserts_on_shutdown": "true", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_auth": "20/20", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_bdev": "1/3", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_bluefs": "1/5", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_bluestore": "1/5", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_buffer": "0/1", 2024-09-10T15:25:30.760 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_ceph_exporter": "1/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_cephfs_mirror": "0/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_cephsqlite": "0/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_client": "0/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_compressor": "1/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_context": "0/1", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_crimson_interrupt": "0/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_crush": "1/1", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_crypto": "1/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_cyanstore": "0/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_deliberately_leak_memory": "false", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_disable_randomized_ping": "false", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_dpdk": "1/5", 2024-09-10T15:25:30.761 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_eventtrace": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_filer": "0/1", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_filestore": "1/3", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_finisher": "1/1", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_fuse": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_heartbeat_testing_span": "0", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_heartbeatmap": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_javaclient": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_journal": "1/3", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_journaler": "0/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_kstore": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_lockdep": "0/1", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mclock": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds_balancer": "1/5", 2024-09-10T15:25:30.762 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds_locker": "1/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds_log": "1/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds_log_expire": "1/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds_migrator": "1/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mds_quiesce": "3/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_memstore": "1/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mgr": "2/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mgrc": "1/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_mon": "20/20", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_monc": "0/10", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_ms": "1/1", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_none": "0/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_objclass": "0/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_objectcacher": "0/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_objecter": "0/1", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_optracker": "0/5", 2024-09-10T15:25:30.763 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_osd": "1/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_paxos": "20/20", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_perfcounter": "1/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_prioritycache": "1/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rados": "0/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rbd": "0/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rbd_mirror": "0/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rbd_pwl": "0/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rbd_replay": "0/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_refs": "0/0", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_reserver": "1/1", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw": "1/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw_access": "1/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw_datacache": "1/5", 2024-09-10T15:25:30.764 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw_dbstore": "1/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw_flight": "1/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rgw_sync": "1/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_rocksdb": "4/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_backref": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_cache": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_cleaner": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_device": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_epm": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_journal": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_lba": "0/5", 2024-09-10T15:25:30.765 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_odata": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_omap": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_onode": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_t": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_seastore_tm": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_striper": "0/1", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_test": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_throttle": "1/1", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_timer": "0/1", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_tp": "0/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "debug_trace": "1/5", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "device_failure_prediction_mode": "none", 2024-09-10T15:25:30.766 INFO:teuthology.orchestra.run.smithi099.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "err_to_graylog": "false", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "err_to_journald": "false", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "err_to_stderr": "true", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "err_to_syslog": "false", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event_tracing": "false", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "exporter_addr": "0.0.0.0", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "exporter_http_port": "9926", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "exporter_prio_limit": "5", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "exporter_sort_metrics": "true", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "exporter_stats_period": "5", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "fake_statfs_for_testing": "0", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "fatal_signal_handlers": "true", 2024-09-10T15:25:30.767 INFO:teuthology.orchestra.run.smithi099.stdout: "filer_max_purge_ops": "10", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filer_max_truncate_ops": "128", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_apply_finisher_threads": "1", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_blackhole": "false", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_btrfs_clone_range": "true", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_btrfs_snap": "true", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_caller_concurrency": "10", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_collect_device_partition_information": "true", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_commit_timeout": "600.000000", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_debug_inject_read_err": "false", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_debug_omap_check": "false", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_debug_verify_split": "false", 2024-09-10T15:25:30.768 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_dump_file": "", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fadvise": "true", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fail_eio": "true", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fd_cache_shards": "16", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fd_cache_size": "128", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fiemap": "false", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fiemap_threshold": "4096", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_inject_stall": "0", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_journal_parallel": "false", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_journal_trailing": "false", 2024-09-10T15:25:30.769 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_journal_writeahead": "false", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_kill_at": "0", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattrs": "0", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_xattr_value_size": "0", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-10T15:25:30.770 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_merge_threshold": "-10", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_odsync_write": "false", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_omap_backend": "rocksdb", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_omap_backend_path": "", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_op_thread_timeout": "60", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_op_threads": "2", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_punch_hole": "false", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-10T15:25:30.771 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_queue_max_ops": "50", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_seek_data_hole": "false", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_sloppy_crc": "false", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_splice": "false", 2024-09-10T15:25:30.772 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_split_multiple": "2", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_split_rand_factor": "20", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_update_to": "1000", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_enable": "true", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-10T15:25:30.773 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_xfs_extsize": "false", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "filestore_zfs_snap": "false", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fio_dir": "/tmp/fio", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "4e8f2598-e62a-4186-9762-b22671b00e14", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_allow_other": "true", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_atomic_o_trunc": "true", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_big_writes": "true", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_debug": "false", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_default_permissions": "false", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_disable_pagecache": "false", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_max_write": "0", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_multithreaded": "true", 2024-09-10T15:25:30.774 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_require_active_mds": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_set_user_groups": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_splice_move": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_splice_read": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_splice_write": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "fuse_use_invalidate_cb": "true", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "gss_target_name": "ceph", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_file": "", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_inject_failure": "0", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_interval": "5", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "host": "smithi099", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-10T15:25:30.775 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "inject_early_sigterm": "false", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "jaeger_agent_port": "6799", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "jaeger_tracing_enable": "false", 2024-09-10T15:25:30.776 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_aio": "true", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_align_min_size": "65536", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_block_align": "true", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_block_size": "4096", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_dio": "true", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_discard": "false", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_force_aio": "false", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_ignore_corruption": "false", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_max_write_bytes": "10485760", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_max_write_entries": "100", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_replay_from": "0", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-10T15:25:30.777 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_write_header_frequency": "0", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "journal_zero_on_create": "false", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "journaler_prefetch_periods": "10", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "journaler_prezero_periods": "5", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "journaler_write_head_interval": "15", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "key": "", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "keyfile": "", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_backend": "rocksdb", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_default_stripe_size": "65536", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_fsck_on_mount": "false", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_max_bytes": "67108864", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_max_ops": "512", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_nid_prealloc": "1024", 2024-09-10T15:25:30.778 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_onode_map_size": "1024", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_sync_submit_transaction": "false", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "kstore_sync_transaction": "false", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "librados_thread_count": "2", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "lockdep": "false", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "lockdep_force_backtrace": "false", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_coarse_timestamps": "true", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_flush_on_exit": "false", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_graylog_host": "127.0.0.1", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_graylog_port": "12201", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_max_new": "1000", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_max_recent": "10000", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_stderr_prefix": "", 2024-09-10T15:25:30.779 INFO:teuthology.orchestra.run.smithi099.stdout: "log_stop_at_utilization": "0.970000", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_file": "true", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_graylog": "false", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_journald": "false", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_stderr": "false", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "log_to_syslog": "false", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "max_rotating_auth_attempts": "10", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_action_on_write_error": "1", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_alternate_name_max": "8192", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_asio_thread_count": "2", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_export_pin": "true", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_fragment_dirs": "true", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-10T15:25:30.780 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_fragment_interval": "5", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_interval": "10", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_max": "-1", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_max_until": "-1", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_merge_size": "50", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_midchunk": "0.300000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_min_start": "0.200000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_minchunk": "0.001000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_mode": "0", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_need_max": "1.200000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_need_min": "0.800000", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_overload_epochs": "2", 2024-09-10T15:25:30.781 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_split_bits": "3", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_split_size": "10000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_target_decay": "10.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_beacon_grace": "15.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_beacon_interval": "4.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_mid": "0.700000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-10T15:25:30.782 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_quiesce_delay": "0", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_release_free_interval": "10", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_reservation": "0.050000", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_trim_interval": "1", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cache_trim_threshold": "262144", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_client_prealloc_inos": "1000", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-10T15:25:30.783 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_connect_bootstrapping": "false", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_damage_table_max_entries": "10000", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_debug_auth_pins": "false", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_debug_frag": "false", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_debug_scatterstat": "false", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_debug_subtrees": "false", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_decay_halflife": "5.000000", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_default_dir_hash": "2", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_defer_session_stale": "true", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_deny_all_reconnect": "false", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dir_keys_per_op": "16384", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dir_max_commit_size": "10", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dir_max_entries": "0", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dir_prefetch": "true", 2024-09-10T15:25:30.784 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dump_cache_on_map": "false", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_early_reply": "true", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_enable_op_tracker": "true", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_enforce_unique_name": "true", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_export_ephemeral_random": "true", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-10T15:25:30.785 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_health_summarize_threshold": "10", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_inject_health_dummy": "false", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_inject_migrator_session_race": "false", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-10T15:25:30.786 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_join_fs": "", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_journal_format": "1", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_create_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_export_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_import_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_journal_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_journal_expire_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_journal_replay_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_link_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_mdstable_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_openc_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_rename_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_kill_shutdown_at": "0", 2024-09-10T15:25:30.787 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_event_large_threshold": "524288", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_events_per_segment": "1024", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_max_events": "-1", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_max_segments": "128", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_pause": "false", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_segment_size": "0", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_trim_threshold": "128", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_log_warn_factor": "2.000000", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_caps_per_client": "1048576", 2024-09-10T15:25:30.788 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_completed_flushes": "100000", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_completed_requests": "100000", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_export_size": "20971520", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_file_recover": "32", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_purge_files": "64", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_purge_ops": "8192", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_max_snaps_per_dir": "100", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_metrics_update_interval": "2", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_min_caps_per_client": "100", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_min_caps_working_set": "10000", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-10T15:25:30.789 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_numa_node": "-1", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_op_complaint_time": "30.000000", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_op_history_duration": "600", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_op_history_size": "20", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_op_history_slow_op_size": "20", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_op_log_threshold": "5", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_ping_grace": "15", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_ping_interval": "5", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_recall_max_caps": "30000", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-10T15:25:30.790 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_recall_warning_threshold": "262144", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_replay_interval": "1.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_root_ino_gid": "0", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_root_ino_uid": "0", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-10T15:25:30.791 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_shutdown_check": "0", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_skip_ino": "0", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_snap_max_uid": "4294967294", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_snap_min_uid": "0", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_snap_rstat": "false", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_standby_replay_damaged": "false", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_symlink_recovery": "true", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_thrash_exports": "0", 2024-09-10T15:25:30.792 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_thrash_fragments": "0", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_tick_interval": "5.000000", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_valgrind_exit": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_verify_backtrace": "1", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_verify_scatter": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mds_wipe_sessions": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mempool_debug": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "memstore_device_bytes": "1073741824", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "memstore_page_set": "false", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "memstore_page_size": "65536", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_client_bytes": "134217728", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_client_messages": "512", 2024-09-10T15:25:30.793 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_disabled_modules": "", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_enable_op_tracker": "true", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_max_pg_num_change": "128", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_mds_bytes": "134217728", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_mds_messages": "128", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_mon_bytes": "134217728", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_mon_messages": "128", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-10T15:25:30.794 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_op_history_duration": "600", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_op_history_size": "20", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_op_log_threshold": "5", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_osd_bytes": "536870912", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_osd_messages": "8192", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_pool": "true", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_standby_modules": "true", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_stats_period": "5", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_stats_threshold": "5", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_tick_period": "2", 2024-09-10T15:25:30.795 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_allow_pool_delete": "true", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_allow_pool_size_one": "true", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_auth_validate_all_caps": "true", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_bytes": "104857600", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_directed_command_retry": "2", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_hunt_parallel": "3", 2024-09-10T15:25:30.796 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_log_interval": "1.000000", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_ping_interval": "10.000000", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_client_target_rank": "-1", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_file_level": "debug", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_file": "true", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_journald": "false", 2024-09-10T15:25:30.797 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_compact_on_bootstrap": "false", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_compact_on_start": "false", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_compact_on_trim": "true", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_cpu_threads": "4", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_crush_min_required_version": "hammer", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_daemon_bytes": "419430400", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-10T15:25:30.798 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_data_avail_crit": "5", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_data_avail_warn": "5", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_data_size_warn": "16106127360", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_dump_json": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_dump_transactions": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_extra_checks": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_no_require_reef": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_no_require_squid": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-10T15:25:30.799 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_down_mkfs_grace": "120", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_down_uptime_grace": "60", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_election_default_strategy": "1", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_election_timeout": "5.000000", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_elector_ping_divisor": "2", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_enable_op_tracker": "true", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_fake_pool_delete": "false", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_force_quorum_join": "false", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-10T15:25:30.800 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_globalid_prealloc": "10000", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_health_detail_to_clog": "false", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_health_log_update_period": "5", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_health_max_detail": "50", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_health_to_clog": "true", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_health_to_clog_interval": "600", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_host": "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.159", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_host_override": "", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_initial_members": "", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-10T15:25:30.801 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_lease": "5.000000", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_log_full_interval": "50", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_log_max": "10000", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_log_max_summary": "50", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_log_epochs": "500", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_osd": "10000", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_pg_per_osd": "10000", 2024-09-10T15:25:30.802 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_pool_pg_num": "65536", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mds_force_trim_to": "0", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mds_skip_sanity": "false", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_memory_autotune": "true", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_memory_target": "2147483648", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mgr_beacon_grace": "30", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mgr_digest_period": "5", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mgr_inactive_grace": "60", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_min_osdmap_epochs": "500", 2024-09-10T15:25:30.803 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_op_complaint_time": "30", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_op_history_duration": "600", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_op_history_size": "20", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_op_history_slow_op_size": "20", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_op_log_threshold": "5", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_auto_mark_in": "false", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_cache_size": "500", 2024-09-10T15:25:30.804 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_down_out_interval": "600", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_force_trim_to": "0", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-10T15:25:30.805 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_min_down_reporters": "2", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_report_timeout": "900", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-10T15:25:30.806 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pg_stuck_threshold": "60", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-10T15:25:30.807 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_probe_timeout": "2.000000", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_reweight_max_change": "0.050000", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_reweight_max_osds": "4", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_scrub_interval": "86400", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_scrub_max_keys": "100", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_scrub_timeout": "300", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_session_timeout": "300", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_smart_report_timeout": "5", 2024-09-10T15:25:30.808 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_stat_smooth_intervals": "6", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_stretch_pool_min_size": "2", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_stretch_pool_size": "4", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_sync_debug": "false", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_sync_provider_kill_at": "0", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_sync_requester_kill_at": "0", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_sync_timeout": "60.000000", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_target_pg_per_osd": "100", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_tick_interval": "5", 2024-09-10T15:25:30.809 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_timecheck_interval": "300.000000", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_use_min_delay_socket": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_older_version_delay": "604800", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_misplaced": "false", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_older_version": "true", 2024-09-10T15:25:30.810 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "monmap": "", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-10T15:25:30.811 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "motr_tracing_enabled": "false", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_op_threads": "3", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_cm": "false", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_device_name": "", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_dscp": "96", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_local_gid": "", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_port_num": "1", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-10T15:25:30.812 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_sl": "3", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_support_srq": "true", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_rdma_type": "ib", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_async_reap_threshold": "5", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_before_connect": "false", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_ipv4": "true", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_ipv6": "false", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_msgr1": "true", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_msgr2": "true", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_port_max": "7568", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_port_min": "6800", 2024-09-10T15:25:30.813 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_retry_count": "3", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_bind_retry_delay": "5", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_blackhole_client": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_blackhole_mds": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_blackhole_mgr": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_blackhole_mon": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_blackhole_osd": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_client_mode": "crc secure", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_cluster_mode": "crc secure", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_cluster_type": "", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_compress_secure": "false", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_connection_idle_timeout": "900", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_connection_ready_timeout": "10", 2024-09-10T15:25:30.814 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_crc_data": "true", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_crc_header": "true", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_die_on_bad_msg": "false", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_die_on_bug": "true", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_die_on_old_message": "true", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_die_on_skipped_message": "false", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_coremask": "0xF", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_enable_tso": "true", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-10T15:25:30.815 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_hugepages": "", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_lro": "true", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_memory_channel": "4", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_pmd": "", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_port_id": "0", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_dump_on_send": "false", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_initial_backoff": "0.200000", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_inject_delay_max": "1.000000", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-10T15:25:30.816 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_inject_delay_type": "", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_inject_network_congestion": "0", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_inject_socket_failures": "0", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_learn_addr_from_peer": "true", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_max_accept_failures": "4", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_max_backoff": "15.000000", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_mon_client_mode": "secure crc", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_mon_service_mode": "secure crc", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_osd_compress_min_size": "1024", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_osd_compress_mode": "none", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_pq_min_cost": "65536", 2024-09-10T15:25:30.817 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_public_type": "", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_service_mode": "crc secure", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_tcp_listen_backlog": "512", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_tcp_nodelay": "true", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_tcp_rcvbuf": "0", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "ms_type": "async+posix", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "no_config_file": "false", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_completion_locks_per_session": "32", 2024-09-10T15:25:30.818 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_inflight_ops": "1024", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_tick_interval": "5.000000", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objecter_timeout": "10.000000", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objectstore_blackhole": "false", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "openssl_engine_opts": "", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_delay_time": "5.000000", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_hist_halflife": "1000", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_max_low_ops": "2", 2024-09-10T15:25:30.819 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_max_ops": "4", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_agent_slop": "0.020000", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_asio_thread_count": "2", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_async_recovery_min_cost": "100", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_backfill_scan_max": "512", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_backfill_scan_min": "64", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_backoff_on_degraded": "false", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_backoff_on_peering": "false", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_backoff_on_unfound": "true", 2024-09-10T15:25:30.820 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_beacon_report_interval": "300", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bench_duration": "30", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bench_max_block_size": "67108864", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_blkin_trace_all": "false", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-10T15:25:30.821 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-10T15:25:30.824 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-10T15:25:30.824 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_check_for_log_corruption": "false", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_class_update_on_start": "true", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_client_message_cap": "256", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_client_message_size_cap": "524288000", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_client_op_priority": "63", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_client_watch_timeout": "30", 2024-09-10T15:25:30.825 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_command_max_records": "256", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_compact_on_start": "false", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_crush_update_on_start": "true", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_crush_update_weight_set": "true", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-10T15:25:30.826 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_feed_pullee": "-1", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_misdirected_ops": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_no_acting_change": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_no_purge_strays": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_op_order": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-10T15:25:30.827 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_shutdown": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_trim_objects": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_verify_snaps": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_keys": "1024", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-10T15:25:30.828 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_stride": "524288", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_default_notify_timeout": "30", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_delete_sleep": "0.000000", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_discard_disconnected_ops": "true", 2024-09-10T15:25:30.829 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_enable_op_tracker": "true", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_fast_info": "true", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_fast_shutdown": "true", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_function_tracing": "false", 2024-09-10T15:25:30.830 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_grace": "20", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_interval": "6", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_min_peers": "10", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_min_size": "2000", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_stale": "600", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_hit_set_max_size": "100000", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_hit_set_min_size": "1000", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-10T15:25:30.831 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_journal_size": "5120", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_kill_backfill_at": "0", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_map_cache_size": "50", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_map_dedup": "true", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_map_message_max": "40", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_map_share_max_epochs": "40", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_attr_name_len": "100", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_attr_size": "0", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_backfills": "1", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_markdown_count": "5", 2024-09-10T15:25:30.832 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_markdown_period": "600", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_object_name_len": "2048", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_object_namespace_len": "256", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_object_size": "134217728", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_pg_blocked_by": "16", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_pg_log_entries": "10000", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_pgls": "1024", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_push_cost": "8388608", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_push_objects": "10", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_scrubs": "3", 2024-09-10T15:25:30.833 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_trimming_pgs": "2", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_write_op_reply_len": "64", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_max_write_size": "90", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_profile": "balanced", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-10T15:25:30.834 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_base": "805306368", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_cache_min": "134217728", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-10T15:25:30.835 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_target": "4294967296", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_target_autotune": "false", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_min_pg_log_entries": "250", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_min_recovery_priority": "0", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mon_report_interval": "5", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_num_cache_shards": "32", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_num_op_tracker_shard": "32", 2024-09-10T15:25:30.836 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_numa_auto_affinity": "true", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_numa_node": "-1", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_numa_prefer_iface": "true", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_objecter_finishers": "1", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_objectstore": "bluestore", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_objectstore_fuse": "false", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_objectstore_tracing": "false", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_complaint_time": "30.000000", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_history_duration": "600", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_history_size": "20", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_history_slow_op_size": "20", 2024-09-10T15:25:30.837 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_log_threshold": "5", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_num_shards": "0", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_num_shards_hdd": "5", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_num_shards_ssd": "8", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_pq_min_cost": "65536", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_queue_cut_off": "high", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_op_thread_timeout": "15", 2024-09-10T15:25:30.838 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_open_classes_on_start": "true", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_os_flags": "0", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_peering_op_priority": "255", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_delete_cost": "1048576", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_delete_priority": "5", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_log_trim_max": "10000", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_log_trim_min": "100", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-10T15:25:30.839 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_crimson": "false", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-10T15:25:30.840 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_flags": "0", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_min_size": "0", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_pg_num": "32", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_pgp_num": "0", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_read_ratio": "70", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_size": "2", 2024-09-10T15:25:30.841 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_default_type": "replicated", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_push_per_object_cost": "1000", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recover_clone_overlap": "true", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_cost": "20971520", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_max_active": "0", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-10T15:25:30.842 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_max_single_start": "1", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_op_priority": "3", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_priority": "5", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_sleep": "0.000000", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_repair_during_recovery": "false", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_requested_scrub_priority": "120", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-10T15:25:30.843 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_auto_repair": "false", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_begin_hour": "0", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_begin_week_day": "0", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_chunk_max": "25", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_chunk_min": "5", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_cost": "52428800", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_during_recovery": "false", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_end_hour": "0", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_end_week_day": "0", 2024-09-10T15:25:30.844 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_event_cost": "4096", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_invalid_stats": "true", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_max_preemptions": "5", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_priority": "5", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_scrub_sleep": "0.000000", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_skip_data_digest": "false", 2024-09-10T15:25:30.845 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_smart_report_timeout": "5", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_snap_trim_cost": "1048576", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_snap_trim_priority": "5", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_target_transaction_size": "30", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-10T15:25:30.846 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_tracing": "false", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_use_stale_snap": "false", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "osdc_blkin_trace_all": "false", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_kill_at": "0", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_max_join_drift": "10", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_min": "500", 2024-09-10T15:25:30.847 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_min_wait": "0.050000", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_propose_interval": "1.000000", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_service_trim_max": "500", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_service_trim_min": "250", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_stash_full_interval": "25", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_trim_max": "500", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "paxos_trim_min": "250", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "perf": "true", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "-", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrv": "", 2024-09-10T15:25:30.848 INFO:teuthology.orchestra.run.smithi099.stdout: "public_bind_addr": "-", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "public_network": "", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "public_network_interface": "", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "qat_compressor_busy_polling": "false", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "qat_compressor_enabled": "false", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "qat_compressor_session_max_number": "256", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rados_mon_op_timeout": "0", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rados_osd_op_timeout": "0", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rados_tracing": "false", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_atime_update_interval": "60", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_balance_parent_reads": "false", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_balance_snap_reads": "false", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_blkin_trace_all": "false", 2024-09-10T15:25:30.849 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache": "true", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_policy": "writearound", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_size": "33554432", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_clone_copy_on_read": "false", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_compression_hint": "none", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_concurrent_management_ops": "10", 2024-09-10T15:25:30.850 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_clone_format": "auto", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_data_pool": "", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_features": "61", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_format": "2", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_map_options": "", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_order": "22", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_pool": "rbd", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_stripe_count": "0", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_default_stripe_unit": "0", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-10T15:25:30.851 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_enable_alloc_hint": "true", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_io_scheduler": "simple", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_order": "24", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_pool": "", 2024-09-10T15:25:30.852 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_journal_splay_width": "4", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_localize_parent_reads": "false", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_localize_snap_reads": "false", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-10T15:25:30.853 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-10T15:25:30.854 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_mtime_update_interval": "60", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_non_blocking_aio": "true", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_op_thread_timeout": "60", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_op_threads": "1", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_parent_cache_enabled": "false", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_plugins": "", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_bps_burst": "0", 2024-09-10T15:25:30.855 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_bps_limit": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_exclude_ops": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_iops_burst": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_iops_limit": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-10T15:25:30.856 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_read_from_replica_policy": "default", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_skip_partial_discard": "true", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_tracing": "false", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_validate_names": "true", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd_validate_pool": "true", 2024-09-10T15:25:30.857 INFO:teuthology.orchestra.run.smithi099.stdout: "restapi_base_url": "", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "restapi_log_level": "", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_acl_grants_max_num": "100", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_admin_entry": "admin", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_backend_store": "rados", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_barbican_url": "", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_beast_enable_async": "true", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_counters_cache": "false", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-10T15:25:30.858 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_cache_enabled": "true", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_cache_expiry_interval": "900", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_cache_lru_size": "25000", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_config_store": "rados", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_content_length_compat": "false", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_copy_obj_progress": "true", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_cors_rules_max_num": "100", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_cross_domain_policy": "", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-10T15:25:30.859 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_addr": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_password": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_kmip_username": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_require_ssl": "true", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-10T15:25:30.860 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_addr": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_auth": "token", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_namespace": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_prefix": "", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-10T15:25:30.861 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_token_file": "", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_curl_buffersize": "524288", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_curl_low_speed_time": "300", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-10T15:25:30.862 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_d4n_port": "6379", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_log_changes_size": "1000", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_log_num_shards": "128", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_log_window": "30", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-10T15:25:30.863 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-10T15:25:30.864 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dns_name": "", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dns_s3website_name": "", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_dynamic_resharding": "true", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-10T15:25:30.865 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_gc_threads": "true", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_lc_threads": "true", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_ops_log": "false", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_quota_threads": "true", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_static_website": "false", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enable_usage_log": "false", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_enforce_swift_acls": "true", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_exit_timeout_secs": "120", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_expose_bucket": "false", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_extended_http_attrs": "", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_filter": "none", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_frontends": "beast port=7480", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_max_deferred": "50", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-10T15:25:30.866 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_max_objs": "32", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_gc_processor_period": "3600", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_init_timeout": "300", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-10T15:25:30.867 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_kafka_connection_idle": "300", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_domain": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_password": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_password_path": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_project": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_tenant": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_token": "", 2024-09-10T15:25:30.868 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_token_path": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_admin_user": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_api_version": "2", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_barbican_domain": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_barbican_password": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_barbican_project": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_barbican_user": "", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-10T15:25:30.869 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_url": "", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_debug_interval": "-1", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_lock_max_time": "90", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_max_objs": "32", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_max_rules": "1000", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_max_worker": "3", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lc_thread_delay": "0", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ldap_dnattr": "uid", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ldap_searchfilter": "", 2024-09-10T15:25:30.870 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ldap_uri": "", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_log_http_headers": "", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_log_object_name_utc": "false", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_attr_name_len": "0", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_attr_size": "0", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_chunk_size": "4194304", 2024-09-10T15:25:30.871 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_listing_results": "1000", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_notify_retries": "10", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_put_param_size": "1048576", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_put_size": "5368709120", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_max_slo_entries": "1000", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_md_log_max_shards": "64", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-10T15:25:30.872 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_mp_lock_max_time": "600", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_max_gc": "300", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-10T15:25:30.873 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_num_async_rados_threads": "32", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_num_control_oids": "8", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_numa_node": "-1", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_objexp_chunk_size": "100", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_objexp_gc_interval": "600", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_op_thread_timeout": "600", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_op_tracing": "false", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_opa_token": "", 2024-09-10T15:25:30.874 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_opa_url": "", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_opa_verify_ssl": "true", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ops_log_rados": "false", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_ops_log_socket_path": "", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_period_push_interval": "2.000000", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-10T15:25:30.875 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_posix_cache_lanes": "3", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_posix_cache_partitions": "3", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_print_continue": "true", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_rados_tracing": "false", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_realm": "", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_realm_id": "", 2024-09-10T15:25:30.876 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_region": "", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_request_uri": "", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_reshard_batch_size": "64", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_reshard_max_aio": "128", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_reshard_num_logs": "16", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_reshard_thread_interval": "600", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_resolve_cname": "false", 2024-09-10T15:25:30.877 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_run_sync_thread": "true", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_scheduler_type": "throttler", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_script_uri": "", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_service_provider_name": "", 2024-09-10T15:25:30.878 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_client_id": "", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_client_secret": "", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_entry": "sts", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_key": "sts", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_min_session_duration": "900", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sts_token_introspection_url": "", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_account_in_url": "false", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_auth_entry": "auth", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_auth_url": "", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_custom_header": "", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_need_stats": "true", 2024-09-10T15:25:30.879 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_tenant_name": "", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_token_expiration": "86400", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_url": "", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_url_prefix": "swift", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_lease_period": "120", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-10T15:25:30.880 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_thread_pool_size": "512", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_comment": "", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_createby": "", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_encoding": "", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_flag": "false", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_origin": "", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-10T15:25:30.881 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_torrent_tracker": "", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_trust_forwarded_https": "false", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_usage_max_shards": "32", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_usage_max_user_shards": "1", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_use_opa_authz": "false", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_counters_cache": "false", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_max_buckets": "1000", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_policies_max_num": "100", 2024-09-10T15:25:30.882 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_user_unique_email": "true", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_verify_ssl": "true", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_zone": "", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_zone_id": "", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_zonegroup": "", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_zonegroup_id": "", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgwlc_auto_session_clear": "true", 2024-09-10T15:25:30.883 INFO:teuthology.orchestra.run.smithi099.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_block_size": "4096", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cache_size": "536870912", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-10T15:25:30.884 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_index_type": "binary_search", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_partition_filters": "false", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_perf": "false", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "run_dir": "/var/run/ceph", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_block_create": "true", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_cache_lru_size": "67108864", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_default_max_object_size": "16777216", 2024-09-10T15:25:30.885 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_device_size": "53687091200", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_full_integrity_check": "false", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_journal_batch_capacity": "16", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_main_device_type": "SSD", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-10T15:25:30.886 INFO:teuthology.orchestra.run.smithi099.stdout: "seastore_segment_size": "67108864", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "set_keepcaps": "false", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "setgroup": "", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "setuser": "", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "setuser_match_path": "", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "thp": "false", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "threadpool_default_timeout": "60", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout: "throttler_perf_counter": "true" 2024-09-10T15:25:30.887 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:30.889 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-10T15:25:31.032 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a: {} 2024-09-10T15:25:31.032 INFO:teuthology.orchestra.run.smithi099.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T15:25:31.045 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b: {} 2024-09-10T15:25:31.045 INFO:teuthology.orchestra.run.smithi099.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T15:25:31.054 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c: {} 2024-09-10T15:25:31.054 INFO:teuthology.orchestra.run.smithi099.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T15:25:31.070 DEBUG:teuthology.orchestra.run.smithi099:> type ceph-objectstore-tool 2024-09-10T15:25:31.074 INFO:teuthology.orchestra.run.smithi099.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-10T15:25:31.074 DEBUG:teuthology.orchestra.run.smithi159:> type ceph-objectstore-tool 2024-09-10T15:25:31.080 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-10T15:25:31.080 INFO:teuthology.run_tasks:Running task workunit... 2024-09-10T15:25:31.093 INFO:tasks.workunit:Pulling workunits from ref 7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:25:31.094 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-10T15:25:31.094 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-10T15:25:31.094 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-10T15:25:31.094 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T15:25:31.095 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T15:25:31.095 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-10T15:25:31.096 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-10T15:25:31.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:31.096 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-10T15:25:31.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:31.097 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-10T15:25:31.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:25:31.117 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:31.116+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:31.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:25:31.122 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-10T15:25:31.122 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T15:25:31.173 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-10T15:25:31.174 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-10T15:25:31.197 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:31.197+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:31.221 INFO:tasks.workunit:timeout=3h 2024-09-10T15:25:31.221 INFO:tasks.workunit:cleanup=True 2024-09-10T15:25:31.221 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7162ca8a22368558b9ec845c47e93c7afc45e8c3 2024-09-10T15:25:31.242 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:31.242 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:31.246 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-10T15:25:31.259 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:31.259 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:31.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:31.287 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:31.287 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:31.318 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:31.319 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:31.319 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:31.316+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:31.341 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:31.341 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:31.362 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:31.362 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:31.382 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:31.382 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:31.399 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:31.399 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:31.399 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:31.397+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:31.403 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:31.403 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:31.413 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:31.424 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:31.424 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:31.499 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:31.496+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:31.541 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:31.542 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:31.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:31.601 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:31.601+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:31.701 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:31.701+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:31.707 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:31.707 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:31.720 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:31.802 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:31.801+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:31.828 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:31.829 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:31.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:31.903 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:31.900+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:31.956 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:31.956 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:31.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:31.994 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:25:31.995 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T15:25:32.004 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:32.005+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:32.023 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T15:25:32.104 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:32.105+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:32.116 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.116 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:32.205 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:32.205+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:32.239 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.239 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.251 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:32.306 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:32.305+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:32.357 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.357 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:32.413 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:32.412+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:32.474 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.474 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:32.529 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:32.528+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:32.609 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:32.608+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:32.647 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.647 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.661 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:32.749 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:32.748+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:32.810 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:32.808+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:32.822 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.822 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.835 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:32.911 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:32.913+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:32.968 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:32.968 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:32.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:33.001 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T15:25:33.024 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:33.025+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:33.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T15:25:33.113 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:33.112+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:33.147 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:33.148 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:33.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:25:33.213 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:33.213+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:33.279 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:33.279 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:33.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:25:33.314 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:33.312+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:33.415 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:33.413+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:33.447 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:25:33.458 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:33.458 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:33.472 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:25:33.516 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:33.512+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:33.591 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:33.591 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:33.607 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:33.607 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:33.617 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:33.617+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:33.622 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:33.623 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:33.638 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:33.638 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:33.638 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:33.639 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:33.652 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:25:33.659 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:33.659 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:33.677 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:33.677 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:33.694 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:33.694 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:33.712 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:33.712 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:33.740 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:33.741+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:33.818 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:33.817+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:105 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'67, mlcod=16'64)", 2024-09-10T15:25:33.824 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.840254659999999, 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075661770000000003, 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982439+0000", 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6799999999999999e-07 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982456+0000", 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7634000000000001e-05 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982483+0000", 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982528+0000", 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5179999999999998e-05 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983277+0000", 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074871099999999999 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983354+0000", 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7305999999999995e-05 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989912+0000", 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065581659999999998 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990004+0000", 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2268999999999994e-05 2024-09-10T15:25:33.828 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.839414243999997, 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086529399999999996, 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983280+0000", 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6470000000000001e-06 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983337+0000", 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6511999999999997e-05 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983356+0000", 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9633e-05 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983368+0000", 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.19e-05 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984356+0000", 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00098816300000000002 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984417+0000", 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0829000000000003e-05 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991834+0000", 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0074170369999999996 2024-09-10T15:25:33.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991931+0000", 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7219000000000005e-05 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.83863676, 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0080112450000000002, 2024-09-10T15:25:33.833 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984058+0000", 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984070+0000", 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2193e-05 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984096+0000", 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5913000000000001e-05 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984110+0000", 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.398e-05 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985455+0000", 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013447229999999999 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985508+0000", 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3560000000000002e-05 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991939+0000", 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006430776 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992067+0000", 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012820299999999999 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'64)", 2024-09-10T15:25:33.837 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.838556228000002, 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010192494999999999, 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1399999999999997e-07 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984145+0000", 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4400000000000005e-06 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984301+0000", 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000155632 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984317+0000", 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6203000000000001e-05 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986485+0000", 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00216782 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986537+0000", 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1616999999999997e-05 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994232+0000", 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0076954359999999999 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994329+0000", 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6832999999999999e-05 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.841 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'64)", 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.838323223000003, 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010043306, 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984371+0000", 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8700000000000004e-07 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984436+0000", 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5683000000000001e-05 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984461+0000", 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5202999999999999e-05 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984475+0000", 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987258+0000", 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027837579999999999 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987310+0000", 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1164e-05 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994338+0000", 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070280209999999997 2024-09-10T15:25:33.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994413+0000", 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5259999999999994e-05 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'64)", 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.837971582000002, 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097639709999999998, 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.846 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984723+0000", 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3540000000000001e-06 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984733+0000", 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0815999999999999e-05 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984756+0000", 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.266e-05 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984771+0000", 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4902999999999999e-05 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988534+0000", 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037629180000000001 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988567+0000", 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3596000000000002e-05 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994420+0000", 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058521880000000004 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994485+0000", 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5536000000000004e-05 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'64)", 2024-09-10T15:25:33.850 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.837566398, 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094333969999999996, 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985128+0000", 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5629999999999999e-06 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985140+0000", 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985166+0000", 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6006000000000001e-05 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985183+0000", 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7337e-05 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989168+0000", 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039847260000000001 2024-09-10T15:25:33.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989228+0000", 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0439000000000002e-05 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994491+0000", 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005262783 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994560+0000", 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8782999999999995e-05 2024-09-10T15:25:33.854 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'64)", 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.837099445, 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090445999999999999, 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985595+0000", 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.406e-06 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985706+0000", 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111543 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985722+0000", 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.615e-05 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985733+0000", 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0383e-05 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990104+0000", 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043707889999999999 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990136+0000", 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2780000000000001e-05 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994565+0000", 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044290930000000003 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994638+0000", 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2455999999999999e-05 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'64)", 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.836618012000002, 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094591999999999992, 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.859 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986076+0000", 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0300000000000001e-06 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986082+0000", 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6529999999999997e-06 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986106+0000", 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4070000000000002e-05 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986115+0000", 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991015+0000", 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048994119999999997 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991072+0000", 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7719000000000001e-05 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995438+0000", 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043650629999999998 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995534+0000", 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6372999999999994e-05 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.863 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:114 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'76, mlcod=16'64)", 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.836231028999997, 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091621759999999993, 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:25:33.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.04e-06 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986472+0000", 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.594e-06 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986492+0000", 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9715999999999999e-05 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986505+0000", 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3097e-05 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992171+0000", 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005665916 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992224+0000", 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000001e-05 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995545+0000", 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033213000000000001 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995624+0000", 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8763000000000005e-05 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'64)", 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.835845765000002, 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0088521850000000003, 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.868 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986848+0000", 2024-09-10T15:25:33.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.393e-06 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987023+0000", 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174539 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987052+0000", 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8856999999999998e-05 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987076+0000", 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4505999999999999e-05 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993021+0000", 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059451599999999997 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993074+0000", 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2772999999999998e-05 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995630+0000", 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002556268 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995699+0000", 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8689000000000006e-05 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'65)", 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:25:33.872 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.835265812999999, 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090862770000000002, 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:25:33.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987428+0000", 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3400000000000001e-06 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987440+0000", 2024-09-10T15:25:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.135e-05 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987455+0000", 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5424e-05 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987465+0000", 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6360000000000006e-06 2024-09-10T15:25:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994716+0000", 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072511140000000003 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994765+0000", 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9576000000000001e-05 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996416+0000", 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016509210000000001 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996513+0000", 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6916000000000005e-05 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'65)", 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.834913411999999, 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011100295, 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987780+0000", 2024-09-10T15:25:33.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.026e-06 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987788+0000", 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5270000000000001e-06 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987802+0000", 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.377e-05 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987809+0000", 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7570000000000004e-06 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995780+0000", 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079709749999999999 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995815+0000", 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4183000000000001e-05 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998786+0000", 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029716640000000002 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998880+0000", 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3393000000000005e-05 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:120 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'82, mlcod=16'78)", 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.821615770999998, 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0060483389999999998, 2024-09-10T15:25:33.883 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001079+0000", 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001139+0000", 2024-09-10T15:25:33.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0016000000000003e-05 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001163+0000", 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4097e-05 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001176+0000", 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.27e-05 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001838+0000", 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066228499999999998 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001869+0000", 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0892000000000002e-05 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007045+0000", 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051759029999999999 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007125+0000", 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0532999999999996e-05 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.888 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:121 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'83, mlcod=16'78)", 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.821302091, 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057800289999999999, 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001392+0000", 2024-09-10T15:25:33.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1000000000000001e-06 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001462+0000", 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0612999999999996e-05 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001477+0000", 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4956999999999999e-05 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001486+0000", 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9230000000000008e-06 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.002501+0000", 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001014479 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.002536+0000", 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4876000000000003e-05 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007131+0000", 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045956210000000003 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007171+0000", 2024-09-10T15:25:33.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9459999999999998e-05 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:153 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'107, mlcod=16'105)", 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.625019730999998, 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055242870000000001, 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.894 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197675+0000", 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197700+0000", 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4216e-05 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197738+0000", 2024-09-10T15:25:33.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197764+0000", 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5159000000000001e-05 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197912+0000", 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014814900000000001 2024-09-10T15:25:33.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197952+0000", 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0516999999999998e-05 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203117+0000", 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051643169999999999 2024-09-10T15:25:33.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203197+0000", 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0698999999999994e-05 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:154 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'108, mlcod=16'105)", 2024-09-10T15:25:33.899 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.624638861000001, 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051879329999999996, 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198055+0000", 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5e-06 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198084+0000", 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8203000000000001e-05 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198104+0000", 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0466999999999999e-05 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198115+0000", 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0682999999999999e-05 2024-09-10T15:25:33.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198712+0000", 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059749200000000003 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198748+0000", 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5933000000000003e-05 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203203+0000", 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044549419999999999 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203242+0000", 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8713e-05 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:159 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'113, mlcod=16'105)", 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.622376189000001, 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048658099999999999, 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200318+0000", 2024-09-10T15:25:33.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.187e-06 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200332+0000", 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3787e-05 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200351+0000", 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9026e-05 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200364+0000", 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3346999999999999e-05 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203389+0000", 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030251660000000001 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203443+0000", 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3633e-05 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.205132+0000", 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016897139999999999 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.205182+0000", 2024-09-10T15:25:33.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9950000000000001e-05 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:237 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.814500489, 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0053950949999999999, 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.910 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 237 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008194+0000", 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8330000000000001e-06 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008205+0000", 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1037e-05 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008265+0000", 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.9573e-05 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008280+0000", 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.558e-05 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008393+0000", 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113029 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008625+0000", 2024-09-10T15:25:33.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231244 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009122+0000", 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049786700000000004 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010600+0000", 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001477555 2024-09-10T15:25:33.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013417+0000", 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028166010000000002 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013527+0000", 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110266 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013587+0000", 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0510000000000002e-05 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:33.917 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.250255724000001, 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052963760000000002, 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 852 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.918 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572439+0000", 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.334e-06 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572451+0000", 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1703e-05 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572484+0000", 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2852999999999999e-05 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572503+0000", 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9300000000000002e-05 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572641+0000", 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013763499999999999 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572873+0000", 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023205900000000001 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.573340+0000", 2024-09-10T15:25:33.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046693599999999999 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.574625+0000", 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012853999999999999 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577474+0000", 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028487080000000001 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577620+0000", 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014651200000000001 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:33.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577733+0000", 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112936 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:33.925 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:33.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:25:33.927 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:33.924+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:34.010 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T15:25:34.025 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:25:34.027 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:34.025+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:34.034 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-10T15:25:34.098 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:34.098 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:25:34.098 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:34.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:25:34.156 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:34.157+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:34.228 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:34.229+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:34.277 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:25:34.277 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:25:34.277 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:34.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:25:34.336 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:34.337+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:34.431 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:34.428+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:34.469 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.469 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.626891930999999, 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:25:34.474 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.571750248000001, 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032891270000000002, 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.475 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894908+0000", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3099999999999997e-07 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894927+0000", 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9320000000000001e-05 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894953+0000", 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6305e-05 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894974+0000", 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0315000000000001e-05 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895666+0000", 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069212899999999999 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895705+0000", 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511000000000002e-05 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898094+0000", 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023885450000000002 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898196+0000", 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102271 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.557813576000001, 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067331149999999996, 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.479 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 212 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908847+0000", 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908860+0000", 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908886+0000", 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6553000000000001e-05 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908902+0000", 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5437000000000001e-05 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909091+0000", 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018897799999999999 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909108+0000", 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7603000000000001e-05 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.911974+0000", 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002865098 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912318+0000", 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034433499999999998 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912981+0000", 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066294100000000001 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.914409+0000", 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014279259999999999 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915383+0000", 2024-09-10T15:25:34.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00097384900000000005 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915475+0000", 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2439e-05 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915577+0000", 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101876 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.494135547000001, 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031354550000000001, 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 227 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.486 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.487 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972524+0000", 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6299999999999998e-06 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972537+0000", 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2279999999999999e-05 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972569+0000", 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2199000000000001e-05 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972584+0000", 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4793999999999999e-05 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972705+0000", 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012087900000000001 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972927+0000", 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022207499999999999 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.973341+0000", 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041414000000000002 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.974687+0000", 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001345913 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975402+0000", 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071543400000000004 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975544+0000", 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141896 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975657+0000", 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011321500000000001 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.491 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.487188593999999, 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031521919999999998, 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 229 2024-09-10T15:25:34.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979471+0000", 2024-09-10T15:25:34.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979485+0000", 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979517+0000", 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979531+0000", 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4769999999999999e-05 2024-09-10T15:25:34.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979672+0000", 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014040600000000001 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979916+0000", 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000244305 2024-09-10T15:25:34.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.980332+0000", 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041584599999999999 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.981945+0000", 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001612701 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982476+0000", 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053147299999999997 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982557+0000", 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0835999999999997e-05 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982621+0000", 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3938999999999999e-05 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.497 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.473240168, 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035617890000000001, 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 233 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.498 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993420+0000", 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:25:34.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993431+0000", 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.151e-05 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993463+0000", 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1662999999999998e-05 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993477+0000", 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.47e-05 2024-09-10T15:25:34.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993627+0000", 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014946499999999999 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993999+0000", 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037189100000000001 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:34.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.994779+0000", 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077995400000000002 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996617+0000", 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001838519 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996817+0000", 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000199655 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996908+0000", 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1232999999999999e-05 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996979+0000", 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0878999999999997e-05 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:380 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.411029258999999, 2024-09-10T15:25:34.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046206290000000002, 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 380 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055631+0000", 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2540000000000001e-06 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055643+0000", 2024-09-10T15:25:34.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1875999999999999e-05 2024-09-10T15:25:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055674+0000", 2024-09-10T15:25:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0623000000000001e-05 2024-09-10T15:25:34.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055689+0000", 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5339999999999999e-05 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055853+0000", 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000163523 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056161+0000", 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030789700000000001 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056575+0000", 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041402000000000002 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058087+0000", 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0015127649999999999 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060135+0000", 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020474849999999999 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060199+0000", 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4264999999999995e-05 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060249+0000", 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9580999999999998e-05 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.511 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:398 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.405468437, 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005050527, 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 398 2024-09-10T15:25:34.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061191+0000", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5880000000000001e-06 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061199+0000", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7269999999999996e-06 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061219+0000", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9743000000000001e-05 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061230+0000", 2024-09-10T15:25:34.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1124999999999999e-05 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061335+0000", 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104786 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061525+0000", 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000190361 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062771+0000", 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001245538 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064149+0000", 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013781380000000001 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066121+0000", 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001971914 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066188+0000", 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6895000000000002e-05 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066239+0000", 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1712000000000002e-05 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.517 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.287946748, 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048961990000000004, 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 607 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178712+0000", 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.443e-06 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178720+0000", 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1049999999999995e-06 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178740+0000", 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9558000000000001e-05 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178751+0000", 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0886e-05 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178837+0000", 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5889000000000004e-05 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178957+0000", 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120044 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.179175+0000", 2024-09-10T15:25:34.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021854200000000001 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.180055+0000", 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088007899999999997 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183495+0000", 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034399489999999999 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183560+0000", 2024-09-10T15:25:34.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4669e-05 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183607+0000", 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7034999999999999e-05 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:614 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.282521751999999, 2024-09-10T15:25:34.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003153304, 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 614 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:25:34.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184137+0000", 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184143+0000", 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8540000000000002e-06 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184155+0000", 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2622e-05 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184163+0000", 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0299999999999994e-06 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184251+0000", 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7998999999999996e-05 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184348+0000", 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6212000000000007e-05 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184654+0000", 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030643899999999998 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.186177+0000", 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001522661 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187008+0000", 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00083182099999999995 2024-09-10T15:25:34.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187185+0000", 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000176949 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187289+0000", 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103523 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:668 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.245185102000001, 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050043780000000003, 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 668 2024-09-10T15:25:34.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221474+0000", 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221483+0000", 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9500000000000007e-06 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221509+0000", 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5627e-05 2024-09-10T15:25:34.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221523+0000", 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4656e-05 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221632+0000", 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108305 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221843+0000", 2024-09-10T15:25:34.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021159600000000001 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.222095+0000", 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025175000000000002 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.223008+0000", 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091253799999999996 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226321+0000", 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033133839999999999 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226414+0000", 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2669000000000003e-05 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226477+0000", 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2990000000000005e-05 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.535 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:675 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.238972049999999, 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00398336, 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 675 2024-09-10T15:25:34.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227687+0000", 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.057e-06 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227699+0000", 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.199e-05 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227731+0000", 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1628999999999998e-05 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227748+0000", 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7274000000000001e-05 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227932+0000", 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018350500000000001 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228079+0000", 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000146849 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228347+0000", 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026789799999999998 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.229446+0000", 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001099308 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231522+0000", 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020760840000000002 2024-09-10T15:25:34.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231611+0000", 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9118999999999998e-05 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231669+0000", 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7646999999999999e-05 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.023717138, 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051962070000000004, 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 798 2024-09-10T15:25:34.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442942+0000", 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0370000000000001e-06 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442953+0000", 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0696000000000001e-05 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442985+0000", 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1853999999999997e-05 2024-09-10T15:25:34.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443000+0000", 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4732999999999999e-05 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443139+0000", 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013904499999999999 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443393+0000", 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025468499999999999 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443859+0000", 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046606600000000001 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.445087+0000", 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001227681 2024-09-10T15:25:34.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.447858+0000", 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027710220000000002 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448017+0000", 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000158789 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448136+0000", 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119599 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.00708131, 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031922360000000002, 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.548 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 804 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459578+0000", 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459590+0000", 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.131e-05 2024-09-10T15:25:34.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459621+0000", 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0932999999999997e-05 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459636+0000", 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5e-05 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459759+0000", 2024-09-10T15:25:34.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012373500000000001 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459981+0000", 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022172500000000001 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.460443+0000", 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000462354 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.461651+0000", 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001207243 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462506+0000", 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085575099999999997 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462657+0000", 2024-09-10T15:25:34.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015077499999999999 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462768+0000", 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111113 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:25:34.554 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.846637571, 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003610715, 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 871 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620022+0000", 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.153e-06 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620033+0000", 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0983e-05 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620062+0000", 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9467000000000001e-05 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620079+0000", 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6226e-05 2024-09-10T15:25:34.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620231+0000", 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152659 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620596+0000", 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036434400000000001 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.621141+0000", 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054557900000000003 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.622459+0000", 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013181930000000001 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623372+0000", 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091299999999999997 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623521+0000", 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014889800000000001 2024-09-10T15:25:34.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623631+0000", 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109213 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.841688400000001, 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031086, 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.560 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 873 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624971+0000", 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9970000000000001e-06 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624983+0000", 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2037e-05 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625016+0000", 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2892999999999998e-05 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625031+0000", 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5290000000000001e-05 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625150+0000", 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011902500000000001 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625371+0000", 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220812 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625841+0000", 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046990600000000002 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627115+0000", 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012742669999999999 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627814+0000", 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069906500000000002 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627963+0000", 2024-09-10T15:25:34.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014890500000000001 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.628078+0000", 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000114403 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.812784826, 2024-09-10T15:25:34.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003669692, 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 886 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653875+0000", 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.34e-06 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653889+0000", 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4127e-05 2024-09-10T15:25:34.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653920+0000", 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0786e-05 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653935+0000", 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4846e-05 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654051+0000", 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011603999999999999 2024-09-10T15:25:34.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654270+0000", 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021907099999999999 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654582+0000", 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031208800000000002 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.655676+0000", 2024-09-10T15:25:34.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010938650000000001 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657273+0000", 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001597654 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657427+0000", 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015405900000000001 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657542+0000", 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011481600000000001 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.80785923, 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032696209999999999, 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.572 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 888 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658800+0000", 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.973e-06 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658813+0000", 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2523e-05 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658845+0000", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2767e-05 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658861+0000", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5760000000000002e-05 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658986+0000", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012435500000000001 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.659210+0000", 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224522 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.659674+0000", 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046431 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.660932+0000", 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00125764 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.661789+0000", 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085672299999999999 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.661951+0000", 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016220899999999999 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662068+0000", 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000116839 2024-09-10T15:25:34.577 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.704719793000001, 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048721060000000002, 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.578 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 933 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761940+0000", 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0999999999999998e-06 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761950+0000", 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0733e-05 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761982+0000", 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1826999999999999e-05 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761997+0000", 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5228999999999999e-05 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762140+0000", 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014274900000000001 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762269+0000", 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000128529 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762518+0000", 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249335 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.763664+0000", 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011457679999999999 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766649+0000", 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029852699999999999 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766742+0000", 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2373000000000005e-05 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766810+0000", 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8193000000000003e-05 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.583 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.671164678, 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032080849999999998, 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:34.584 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 946 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795495+0000", 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3590000000000002e-06 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795506+0000", 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1246999999999999e-05 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795537+0000", 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0840000000000003e-05 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795552+0000", 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4759999999999999e-05 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795694+0000", 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000142399 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.796074+0000", 2024-09-10T15:25:34.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000379613 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.796628+0000", 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00055361600000000005 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798019+0000", 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001391853 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798440+0000", 2024-09-10T15:25:34.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000420433 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798591+0000", 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150805 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798701+0000", 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011016 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:34.590 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:34.590 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:34.591 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:25:34.592 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:34.588+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:34.693 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:34.693+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:34.721 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:34.721 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:25:34.721 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:34.736 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:25:34.828 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:34.829+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:34.895 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:34.893+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:34.901 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:25:34.902 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:25:34.902 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:34.921 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:25:35.004 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:35.005+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:25:35.028 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.3 to 1 (10000) 2024-09-10T15:25:35.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T15:25:35.089 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.089 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.194034389, 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003695229, 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 208 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892426+0000", 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2030000000000002e-06 2024-09-10T15:25:35.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892445+0000", 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8284e-05 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892489+0000", 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3955999999999997e-05 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892519+0000", 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0108999999999999e-05 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892691+0000", 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017201599999999999 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892998+0000", 2024-09-10T15:25:35.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030683400000000002 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.893664+0000", 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066628100000000001 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895375+0000", 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017113969999999999 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895964+0000", 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00058865999999999996 2024-09-10T15:25:35.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896051+0000", 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7515000000000005e-05 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896117+0000", 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5974000000000002e-05 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.095 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.153672780999999, 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003242516, 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 216 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932787+0000", 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.807e-06 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932799+0000", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2785999999999999e-05 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932831+0000", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1350000000000003e-05 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932846+0000", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5696999999999999e-05 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933030+0000", 2024-09-10T15:25:35.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018387500000000001 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933261+0000", 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230442 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933673+0000", 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041251299999999999 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935414+0000", 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017412930000000001 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935865+0000", 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000450941 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935952+0000", 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6971999999999993e-05 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.936026+0000", 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3839999999999998e-05 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.146801852999999, 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003146182, 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.101 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 218 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939657+0000", 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3070000000000001e-06 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939668+0000", 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1345999999999999e-05 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939700+0000", 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1579999999999999e-05 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939715+0000", 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5302999999999999e-05 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939842+0000", 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126389 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940077+0000", 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000235398 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940494+0000", 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041655000000000001 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942043+0000", 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001549538 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942655+0000", 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061185199999999997 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942740+0000", 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4580000000000007e-05 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942801+0000", 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1339000000000003e-05 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.106 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.143433416000001, 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003134179, 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 219 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.107 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943025+0000", 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:25:35.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943034+0000", 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1260000000000004e-06 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943059+0000", 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4559999999999999e-05 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943078+0000", 2024-09-10T15:25:35.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9545999999999999e-05 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943199+0000", 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120766 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943448+0000", 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000248605 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943859+0000", 2024-09-10T15:25:35.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041157299999999998 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.945324+0000", 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014649159999999999 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946012+0000", 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00068786100000000001 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946091+0000", 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9072999999999993e-05 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946157+0000", 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6255999999999997e-05 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.112 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.125157431, 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032517259999999999, 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 224 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:35.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961301+0000", 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2699999999999999e-06 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961314+0000", 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2830000000000001e-05 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961344+0000", 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0307e-05 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961393+0000", 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8668999999999998e-05 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961519+0000", 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012537599999999999 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961726+0000", 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020736800000000001 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.962170+0000", 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044366400000000003 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.963687+0000", 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001517731 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964402+0000", 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071518899999999997 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964490+0000", 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7134999999999998e-05 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964551+0000", 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1186999999999995e-05 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.118 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.085418886999999, 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032143179999999999, 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 235 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:35.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001040+0000", 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001052+0000", 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1686e-05 2024-09-10T15:25:35.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001083+0000", 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001110+0000", 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6899000000000001e-05 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001259+0000", 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148539 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001495+0000", 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023620499999999999 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001955+0000", 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046031300000000001 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.003374+0000", 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001418683 2024-09-10T15:25:35.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004098+0000", 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00072427099999999996 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004188+0000", 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9739000000000003e-05 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004252+0000", 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3856000000000007e-05 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.123 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:351 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.039209517, 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031767259999999999, 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 351 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047250+0000", 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2160000000000002e-06 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047265+0000", 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4443999999999999e-05 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047310+0000", 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5435999999999997e-05 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047359+0000", 2024-09-10T15:25:35.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8863000000000003e-05 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047541+0000", 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182332 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047953+0000", 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000412194 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.048423+0000", 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046960600000000002 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.049909+0000", 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014863249999999999 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050169+0000", 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025944199999999997 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050312+0000", 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014267500000000001 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050424+0000", 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112193 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.129 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:368 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.035140074999999, 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041994140000000003, 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 368 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051318+0000", 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4330000000000001e-06 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051326+0000", 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4270000000000008e-06 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051342+0000", 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5569999999999998e-05 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051356+0000", 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4402e-05 2024-09-10T15:25:35.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051765+0000", 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040867799999999999 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052006+0000", 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240678 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052449+0000", 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044326000000000001 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053565+0000", 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001116384 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055273+0000", 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00170733 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055412+0000", 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000139393 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055516+0000", 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103859 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:378 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:35.135 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.031281148, 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028653440000000001, 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 378 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055178+0000", 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.79e-06 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055192+0000", 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4096e-05 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055223+0000", 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0323000000000001e-05 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055242+0000", 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9513000000000001e-05 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055624+0000", 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038226500000000001 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055809+0000", 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000184489 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056219+0000", 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040993900000000001 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057655+0000", 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001436622 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057704+0000", 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8285999999999998e-05 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057868+0000", 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164129 2024-09-10T15:25:35.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058041+0000", 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017289200000000001 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:401 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.024744186, 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004220583, 2024-09-10T15:25:35.141 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 401 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061715+0000", 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7269999999999999e-06 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061732+0000", 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6696000000000001e-05 2024-09-10T15:25:35.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061764+0000", 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2184000000000002e-05 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061786+0000", 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1676e-05 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061935+0000", 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014901500000000001 2024-09-10T15:25:35.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062062+0000", 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000127317 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062269+0000", 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000206744 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.063459+0000", 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001190226 2024-09-10T15:25:35.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065746+0000", 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022868900000000002 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065870+0000", 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124129 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065933+0000", 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2978999999999995e-05 2024-09-10T15:25:35.146 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:442 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.006014573, 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028624620000000001, 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.147 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 442 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080444+0000", 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.916e-06 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080455+0000", 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.076e-05 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080478+0000", 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3269999999999999e-05 2024-09-10T15:25:35.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080495+0000", 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6764000000000001e-05 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080598+0000", 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103502 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080752+0000", 2024-09-10T15:25:35.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000153914 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.081097+0000", 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034484899999999999 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.082189+0000", 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001092045 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083095+0000", 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090592799999999996 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083210+0000", 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115253 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083304+0000", 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4260999999999998e-05 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.152 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:514 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.971834611, 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002949002, 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.153 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 514 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114624+0000", 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114633+0000", 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114654+0000", 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1287000000000001e-05 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114671+0000", 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7099999999999999e-05 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114747+0000", 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6309000000000004e-05 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114841+0000", 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3691999999999997e-05 2024-09-10T15:25:35.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115037+0000", 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019563100000000001 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115920+0000", 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088357799999999999 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117412+0000", 2024-09-10T15:25:35.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001491746 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117495+0000", 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2465000000000004e-05 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117571+0000", 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6344e-05 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:577 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.930036468000001, 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002869932, 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 577 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.159 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156422+0000", 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2639999999999998e-06 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156434+0000", 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1206000000000001e-05 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156462+0000", 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8294e-05 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156476+0000", 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4667999999999999e-05 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156581+0000", 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010480399999999999 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156756+0000", 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174694 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157050+0000", 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00029385499999999998 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157899+0000", 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00084936799999999998 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159140+0000", 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012406470000000001 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159228+0000", 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7696999999999997e-05 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159290+0000", 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2434999999999994e-05 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.164 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:587 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.922994848, 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042266669999999999, 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 587 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163464+0000", 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163475+0000", 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1070000000000001e-05 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163503+0000", 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8062999999999999e-05 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163518+0000", 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4627000000000001e-05 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163646+0000", 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012872099999999999 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163827+0000", 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018048399999999999 2024-09-10T15:25:35.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.164224+0000", 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039711999999999999 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165380+0000", 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011557990000000001 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167476+0000", 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020961119999999998 2024-09-10T15:25:35.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167595+0000", 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118585 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167688+0000", 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3789000000000006e-05 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.170 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.742718375000001, 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028733140000000001, 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 751 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343740+0000", 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3259999999999998e-06 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343752+0000", 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1590000000000001e-05 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343783+0000", 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343799+0000", 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343980+0000", 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018106200000000001 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344186+0000", 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020671099999999999 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344505+0000", 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031894099999999999 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.345596+0000", 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001090925 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346462+0000", 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086563700000000005 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346548+0000", 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5971999999999996e-05 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346611+0000", 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3700000000000003e-05 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.666329545, 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029293980000000002, 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.176 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 787 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420130+0000", 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8729999999999999e-06 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420142+0000", 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2106999999999999e-05 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420172+0000", 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0456000000000001e-05 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420188+0000", 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5359999999999999e-05 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420313+0000", 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125253 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420534+0000", 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220974 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420856+0000", 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032206200000000002 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.421932+0000", 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010764380000000001 2024-09-10T15:25:35.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422868+0000", 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00093595899999999999 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422950+0000", 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2039999999999994e-05 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.423056+0000", 2024-09-10T15:25:35.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000105876 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.623421526, 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00345248, 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.182 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 805 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463037+0000", 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463049+0000", 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1620000000000001e-05 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463079+0000", 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9876e-05 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463094+0000", 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4766999999999999e-05 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463256+0000", 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016214499999999999 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463625+0000", 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036956700000000001 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.464163+0000", 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053810299999999995 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.465401+0000", 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012375940000000001 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466225+0000", 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000824277 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466379+0000", 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000154172 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466487+0000", 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108006 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.187 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.618541661, 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030487999999999999, 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 807 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467917+0000", 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1239999999999999e-06 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467928+0000", 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0966e-05 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467961+0000", 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2762999999999998e-05 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467980+0000", 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8960000000000001e-05 2024-09-10T15:25:35.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468104+0000", 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012481600000000001 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468336+0000", 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231055 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468793+0000", 2024-09-10T15:25:35.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045788699999999998 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470004+0000", 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012103859999999999 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470810+0000", 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00080637799999999996 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470900+0000", 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9412000000000004e-05 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470964+0000", 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4053000000000005e-05 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:35.193 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.424208047, 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030323030000000001, 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 889 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662252+0000", 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0570000000000001e-06 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662268+0000", 2024-09-10T15:25:35.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6093e-05 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662299+0000", 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1795999999999998e-05 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662315+0000", 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.524e-05 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662441+0000", 2024-09-10T15:25:35.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012639199999999999 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662672+0000", 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023079200000000001 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.663000+0000", 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032838099999999999 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.664150+0000", 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011496639999999999 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665089+0000", 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000939203 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665174+0000", 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4886e-05 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665281+0000", 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679900000000001 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.410338654, 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030863430000000001, 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 895 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:35.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676120+0000", 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.216e-06 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676131+0000", 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1243999999999999e-05 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676162+0000", 2024-09-10T15:25:35.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0692999999999999e-05 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676177+0000", 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5366000000000002e-05 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676353+0000", 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017565899999999999 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676575+0000", 2024-09-10T15:25:35.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000222208 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676894+0000", 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031855099999999998 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.677954+0000", 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010597919999999999 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679048+0000", 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010947719999999999 2024-09-10T15:25:35.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679140+0000", 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1911999999999997e-05 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679204+0000", 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3930000000000006e-05 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:35.204 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:35.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:35.207 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:35.204+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:35.307 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:35.304+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:35.333 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:35.333 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:35.334 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:35.349 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:35.436 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:35.436+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:35.510 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:35.508+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:35.510 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:35.510 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:35.510 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:35.511 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:35.511 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:35.524 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:35.613 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:35.612+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:35.698 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:35.698 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.829936161999999, 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:25:35.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:25:35.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:25:35.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.796300871, 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:25:35.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.690646907, 2024-09-10T15:25:35.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:25:35.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:25:35.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.814906551, 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.799039543999999, 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.723 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:25:35.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:25:35.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.779559862999999, 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:25:35.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:25:35.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.766753599999999, 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.744849412000001, 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.740 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:25:35.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:25:35.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.726283134999999, 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:25:35.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:25:35.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:25:35.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.672766969, 2024-09-10T15:25:35.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:35.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:25:35.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:25:35.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.667562934999999, 2024-09-10T15:25:35.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:25:35.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.655017817999999, 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:25:35.763 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:25:35.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.654317581000001, 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:25:35.769 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:25:35.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.647109551, 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:25:35.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:25:35.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.475294776, 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:25:35.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.359024875999999, 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:25:35.785 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:25:35.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:25:35.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:25:35.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.321985245, 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:25:35.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.795 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.314790428, 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:25:35.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:25:35.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:25:35.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.801 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.310340852, 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:25:35.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:25:35.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:25:35.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:25:35.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:35.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:25:35.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:35.810 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.11107597, 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:35.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:35.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:35.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:25:35.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:25:35.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:25:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:35.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:35.816 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:35.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:35.818 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:35.817+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:35.818 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:35.918 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:35.916+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:35.994 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:35.995 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:35.995 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:36.011 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:36.019 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:36.021+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:36.023 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T15:25:36.026 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:36.026 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:36.048 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:36.048 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:36.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T15:25:36.066 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:36.066 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:36.090 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:36.091 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:36.111 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:36.111 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:36.120 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:36.121+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:36.132 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:36.132 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:36.147 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:36.147 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:36.153 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:36.153 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:36.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:36.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:36.175 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:36.236 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:36.236+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:36.295 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:36.295 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:36.310 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:36.353 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:36.352+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:36.422 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:36.420+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:36.473 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:36.474 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:36.487 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:36.533 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:36.532+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:36.624 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:36.625+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:36.651 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:36.651 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:36.665 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:36.725 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:36.725+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:36.781 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:36.782 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:36.795 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:36.841 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:36.840+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:36.921 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:36.921 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:36.927 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:36.925+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:36.935 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:37.028 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:37.024+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:37.041 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T15:25:37.053 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:25:37.063 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T15:25:37.098 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:37.098 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:37.115 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:37.161 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:37.160+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:37.230 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:37.229+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:37.279 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:37.279 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:37.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:37.340 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:37.341+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:37.427 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:37.428 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:37.432 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:37.428+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:37.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:37.533 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:37.533+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:37.600 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:37.600 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:37.614 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:25:37.633 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:37.632+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:37.734 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:37.732+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:37.773 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:37.773 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:37.787 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:25:37.835 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:37.832+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:37.911 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:37.911 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:37.925 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:25:37.936 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:37.932+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:38.037 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:38.037+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:38.050 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T15:25:38.050 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:38.051 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:38.052 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:25:38.066 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:25:38.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T15:25:38.152 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:38.153+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:38.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:25:38.230 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:38.231 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:38.240 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:38.240+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:38.245 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:25:38.331 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:38.332 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:38.340 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:38.336+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:38.349 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:38.349 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:38.366 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:38.366 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:38.385 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:38.386 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:38.406 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:38.406 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:38.413 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:38.413 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:38.425 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:38.426 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:38.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:25:38.441 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:38.440+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:38.445 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:38.445 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:38.464 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:38.464 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:38.542 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:38.540+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:38.551 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:38.552 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:38.552 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:25:38.552 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:25:38.552 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:38.566 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:25:38.643 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:38.641+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:38.696 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:38.696 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:38.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:38.696 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:38.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.696 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.853862538000001, 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:25:38.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:25:38.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.701 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.798720854999999, 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032891270000000002, 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.702 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894908+0000", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3099999999999997e-07 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894927+0000", 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9320000000000001e-05 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894953+0000", 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6305e-05 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894974+0000", 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0315000000000001e-05 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895666+0000", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069212899999999999 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895705+0000", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511000000000002e-05 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898094+0000", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023885450000000002 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898196+0000", 2024-09-10T15:25:38.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102271 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.784784182999999, 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067331149999999996, 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.706 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 212 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908847+0000", 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908860+0000", 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908886+0000", 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6553000000000001e-05 2024-09-10T15:25:38.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908902+0000", 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5437000000000001e-05 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909091+0000", 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018897799999999999 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:25:38.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909108+0000", 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7603000000000001e-05 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.911974+0000", 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002865098 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912318+0000", 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034433499999999998 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912981+0000", 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066294100000000001 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.914409+0000", 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014279259999999999 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915383+0000", 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00097384900000000005 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915475+0000", 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2439e-05 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915577+0000", 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101876 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.712 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.721106153999999, 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031354550000000001, 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 227 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.713 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972524+0000", 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6299999999999998e-06 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972537+0000", 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2279999999999999e-05 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972569+0000", 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2199000000000001e-05 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972584+0000", 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4793999999999999e-05 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972705+0000", 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012087900000000001 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972927+0000", 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022207499999999999 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.973341+0000", 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041414000000000002 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.974687+0000", 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001345913 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975402+0000", 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071543400000000004 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975544+0000", 2024-09-10T15:25:38.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141896 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975657+0000", 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011321500000000001 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.714159200999999, 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031521919999999998, 2024-09-10T15:25:38.718 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 229 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979471+0000", 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979485+0000", 2024-09-10T15:25:38.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979517+0000", 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979531+0000", 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4769999999999999e-05 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979672+0000", 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014040600000000001 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979916+0000", 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000244305 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.980332+0000", 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041584599999999999 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.981945+0000", 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001612701 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982476+0000", 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053147299999999997 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982557+0000", 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0835999999999997e-05 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982621+0000", 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3938999999999999e-05 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.700210775, 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035617890000000001, 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.724 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 233 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993420+0000", 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993431+0000", 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.151e-05 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993463+0000", 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1662999999999998e-05 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993477+0000", 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.47e-05 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993627+0000", 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014946499999999999 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993999+0000", 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037189100000000001 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.994779+0000", 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077995400000000002 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996617+0000", 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001838519 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996817+0000", 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000199655 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996908+0000", 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1232999999999999e-05 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996979+0000", 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0878999999999997e-05 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.729 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:380 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.637999865999999, 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046206290000000002, 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.730 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 380 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055631+0000", 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2540000000000001e-06 2024-09-10T15:25:38.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055643+0000", 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1875999999999999e-05 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055674+0000", 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0623000000000001e-05 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055689+0000", 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5339999999999999e-05 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055853+0000", 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000163523 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056161+0000", 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030789700000000001 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056575+0000", 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041402000000000002 2024-09-10T15:25:38.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058087+0000", 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0015127649999999999 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060135+0000", 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020474849999999999 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060199+0000", 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4264999999999995e-05 2024-09-10T15:25:38.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060249+0000", 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9580999999999998e-05 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:398 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.632439044, 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005050527, 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.735 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 398 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061191+0000", 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5880000000000001e-06 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061199+0000", 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7269999999999996e-06 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061219+0000", 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9743000000000001e-05 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061230+0000", 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1124999999999999e-05 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061335+0000", 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104786 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061525+0000", 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000190361 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062771+0000", 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001245538 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064149+0000", 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013781380000000001 2024-09-10T15:25:38.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066121+0000", 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001971914 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066188+0000", 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6895000000000002e-05 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066239+0000", 2024-09-10T15:25:38.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1712000000000002e-05 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.514917355, 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048961990000000004, 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.741 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 607 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178712+0000", 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.443e-06 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178720+0000", 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1049999999999995e-06 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178740+0000", 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9558000000000001e-05 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178751+0000", 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0886e-05 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178837+0000", 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5889000000000004e-05 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178957+0000", 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120044 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.179175+0000", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021854200000000001 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.180055+0000", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088007899999999997 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183495+0000", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034399489999999999 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183560+0000", 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4669e-05 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183607+0000", 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7034999999999999e-05 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:614 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.509492358999999, 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003153304, 2024-09-10T15:25:38.746 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 614 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:25:38.747 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184137+0000", 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184143+0000", 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8540000000000002e-06 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184155+0000", 2024-09-10T15:25:38.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2622e-05 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184163+0000", 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0299999999999994e-06 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184251+0000", 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7998999999999996e-05 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.749 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184348+0000", 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6212000000000007e-05 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184654+0000", 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030643899999999998 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.186177+0000", 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001522661 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187008+0000", 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00083182099999999995 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187185+0000", 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000176949 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187289+0000", 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103523 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.751 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:668 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.472155709000001, 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050043780000000003, 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.752 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 668 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.753 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221474+0000", 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221483+0000", 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9500000000000007e-06 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.754 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221509+0000", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5627e-05 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221523+0000", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4656e-05 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221632+0000", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108305 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.755 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221843+0000", 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021159600000000001 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.222095+0000", 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025175000000000002 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.223008+0000", 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091253799999999996 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.756 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226321+0000", 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033133839999999999 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226414+0000", 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2669000000000003e-05 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226477+0000", 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2990000000000005e-05 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.757 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:675 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.465942656999999, 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00398336, 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 675 2024-09-10T15:25:38.758 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.759 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227687+0000", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.057e-06 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227699+0000", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.199e-05 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227731+0000", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1628999999999998e-05 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227748+0000", 2024-09-10T15:25:38.760 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7274000000000001e-05 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227932+0000", 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018350500000000001 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228079+0000", 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000146849 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228347+0000", 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026789799999999998 2024-09-10T15:25:38.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.229446+0000", 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001099308 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231522+0000", 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020760840000000002 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231611+0000", 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9118999999999998e-05 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231669+0000", 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7646999999999999e-05 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.250687745, 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051962070000000004, 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.763 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 798 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.764 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442942+0000", 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0370000000000001e-06 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442953+0000", 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0696000000000001e-05 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442985+0000", 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1853999999999997e-05 2024-09-10T15:25:38.765 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443000+0000", 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4732999999999999e-05 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443139+0000", 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013904499999999999 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.766 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443393+0000", 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025468499999999999 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443859+0000", 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046606600000000001 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.445087+0000", 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001227681 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.767 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.447858+0000", 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027710220000000002 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448017+0000", 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000158789 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448136+0000", 2024-09-10T15:25:38.768 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119599 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.234051917, 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031922360000000002, 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.769 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 804 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.770 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459578+0000", 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459590+0000", 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.131e-05 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.771 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459621+0000", 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0932999999999997e-05 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459636+0000", 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5e-05 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459759+0000", 2024-09-10T15:25:38.772 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012373500000000001 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459981+0000", 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022172500000000001 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.460443+0000", 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000462354 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.773 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.461651+0000", 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001207243 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462506+0000", 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085575099999999997 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462657+0000", 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015077499999999999 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462768+0000", 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111113 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.073608178000001, 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003610715, 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 871 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620022+0000", 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.153e-06 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620033+0000", 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0983e-05 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620062+0000", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9467000000000001e-05 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620079+0000", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6226e-05 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620231+0000", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152659 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620596+0000", 2024-09-10T15:25:38.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036434400000000001 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.621141+0000", 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054557900000000003 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.622459+0000", 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013181930000000001 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623372+0000", 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091299999999999997 2024-09-10T15:25:38.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623521+0000", 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014889800000000001 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623631+0000", 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109213 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.780 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.068659007000001, 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031086, 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 873 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.781 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624971+0000", 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9970000000000001e-06 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624983+0000", 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2037e-05 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625016+0000", 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2892999999999998e-05 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625031+0000", 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5290000000000001e-05 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625150+0000", 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011902500000000001 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625371+0000", 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220812 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625841+0000", 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046990600000000002 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627115+0000", 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012742669999999999 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627814+0000", 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069906500000000002 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627963+0000", 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014890500000000001 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.628078+0000", 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000114403 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.039755433, 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003669692, 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.786 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 886 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653875+0000", 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.34e-06 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653889+0000", 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4127e-05 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653920+0000", 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0786e-05 2024-09-10T15:25:38.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653935+0000", 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4846e-05 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654051+0000", 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011603999999999999 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654270+0000", 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021907099999999999 2024-09-10T15:25:38.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654582+0000", 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031208800000000002 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.655676+0000", 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010938650000000001 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657273+0000", 2024-09-10T15:25:38.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001597654 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657427+0000", 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015405900000000001 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657542+0000", 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011481600000000001 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.034829837, 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032696209999999999, 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 888 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658800+0000", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.973e-06 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658813+0000", 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2523e-05 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658845+0000", 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2767e-05 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658861+0000", 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5760000000000002e-05 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.794 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658986+0000", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012435500000000001 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.659210+0000", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224522 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.659674+0000", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046431 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.660932+0000", 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00125764 2024-09-10T15:25:38.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.661789+0000", 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085672299999999999 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.661951+0000", 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016220899999999999 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662068+0000", 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000116839 2024-09-10T15:25:38.796 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.931690400000001, 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048721060000000002, 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.797 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 933 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761940+0000", 2024-09-10T15:25:38.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0999999999999998e-06 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761950+0000", 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0733e-05 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761982+0000", 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1826999999999999e-05 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761997+0000", 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5228999999999999e-05 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762140+0000", 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014274900000000001 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762269+0000", 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000128529 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762518+0000", 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249335 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.763664+0000", 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011457679999999999 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766649+0000", 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029852699999999999 2024-09-10T15:25:38.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766742+0000", 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2373000000000005e-05 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766810+0000", 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8193000000000003e-05 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.898135285, 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032080849999999998, 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 946 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:38.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795495+0000", 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3590000000000002e-06 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795506+0000", 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1246999999999999e-05 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795537+0000", 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0840000000000003e-05 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795552+0000", 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4759999999999999e-05 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795694+0000", 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000142399 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.796074+0000", 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000379613 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.796628+0000", 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00055361600000000005 2024-09-10T15:25:38.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798019+0000", 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001391853 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798440+0000", 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000420433 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798591+0000", 2024-09-10T15:25:38.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150805 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798701+0000", 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011016 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:38.808 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:38.810 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:25:38.810 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:38.808+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:38.911 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:38.909+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:38.978 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:38.979 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:38.979 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:25:38.979 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:38.993 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:25:39.036 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:39.037+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:39.068 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T15:25:39.092 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T15:25:39.092 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:39.112 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:39.113+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:39.162 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:39.162 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:39.162 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:25:39.162 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:25:39.162 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:39.177 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:25:39.220 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:39.221+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:39.313 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:39.312+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.452192047, 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003695229, 2024-09-10T15:25:39.345 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 208 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.346 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892426+0000", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2030000000000002e-06 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892445+0000", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8284e-05 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892489+0000", 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3955999999999997e-05 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892519+0000", 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0108999999999999e-05 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892691+0000", 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017201599999999999 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892998+0000", 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030683400000000002 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.893664+0000", 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066628100000000001 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895375+0000", 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017113969999999999 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895964+0000", 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00058865999999999996 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896051+0000", 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7515000000000005e-05 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896117+0000", 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5974000000000002e-05 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.350 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.411830438999999, 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003242516, 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.351 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 216 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932787+0000", 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.807e-06 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932799+0000", 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2785999999999999e-05 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932831+0000", 2024-09-10T15:25:39.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1350000000000003e-05 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932846+0000", 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5696999999999999e-05 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933030+0000", 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018387500000000001 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933261+0000", 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230442 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933673+0000", 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041251299999999999 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935414+0000", 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017412930000000001 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935865+0000", 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000450941 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935952+0000", 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6971999999999993e-05 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.936026+0000", 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3839999999999998e-05 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.356 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.404959511000001, 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003146182, 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.357 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 218 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939657+0000", 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3070000000000001e-06 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939668+0000", 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1345999999999999e-05 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939700+0000", 2024-09-10T15:25:39.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1579999999999999e-05 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939715+0000", 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5302999999999999e-05 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939842+0000", 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126389 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940077+0000", 2024-09-10T15:25:39.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000235398 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940494+0000", 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041655000000000001 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942043+0000", 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001549538 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942655+0000", 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061185199999999997 2024-09-10T15:25:39.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942740+0000", 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4580000000000007e-05 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942801+0000", 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1339000000000003e-05 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.362 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.401591073999999, 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003134179, 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 219 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:39.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943025+0000", 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943034+0000", 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1260000000000004e-06 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943059+0000", 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4559999999999999e-05 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943078+0000", 2024-09-10T15:25:39.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9545999999999999e-05 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943199+0000", 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120766 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943448+0000", 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000248605 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943859+0000", 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041157299999999998 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.945324+0000", 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014649159999999999 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946012+0000", 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00068786100000000001 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946091+0000", 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9072999999999993e-05 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946157+0000", 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6255999999999997e-05 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.368 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.383315089, 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032517259999999999, 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 224 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961301+0000", 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2699999999999999e-06 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961314+0000", 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2830000000000001e-05 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961344+0000", 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0307e-05 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961393+0000", 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8668999999999998e-05 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961519+0000", 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012537599999999999 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961726+0000", 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020736800000000001 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.962170+0000", 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044366400000000003 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.963687+0000", 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001517731 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964402+0000", 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071518899999999997 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964490+0000", 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7134999999999998e-05 2024-09-10T15:25:39.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964551+0000", 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1186999999999995e-05 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.343576545000001, 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032143179999999999, 2024-09-10T15:25:39.374 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 235 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001040+0000", 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:25:39.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001052+0000", 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1686e-05 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001083+0000", 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001110+0000", 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6899000000000001e-05 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001259+0000", 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148539 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001495+0000", 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023620499999999999 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001955+0000", 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046031300000000001 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.003374+0000", 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001418683 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004098+0000", 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00072427099999999996 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004188+0000", 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9739000000000003e-05 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004252+0000", 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3856000000000007e-05 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:351 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.380 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.297367175000002, 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031767259999999999, 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 351 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047250+0000", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2160000000000002e-06 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047265+0000", 2024-09-10T15:25:39.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4443999999999999e-05 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047310+0000", 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5435999999999997e-05 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047359+0000", 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8863000000000003e-05 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047541+0000", 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182332 2024-09-10T15:25:39.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047953+0000", 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000412194 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.048423+0000", 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046960600000000002 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.049909+0000", 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014863249999999999 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050169+0000", 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025944199999999997 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050312+0000", 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014267500000000001 2024-09-10T15:25:39.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050424+0000", 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112193 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:368 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.293297732999999, 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041994140000000003, 2024-09-10T15:25:39.386 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 368 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051318+0000", 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4330000000000001e-06 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051326+0000", 2024-09-10T15:25:39.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4270000000000008e-06 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051342+0000", 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5569999999999998e-05 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051356+0000", 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4402e-05 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051765+0000", 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040867799999999999 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052006+0000", 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240678 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052449+0000", 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044326000000000001 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053565+0000", 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001116384 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055273+0000", 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00170733 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055412+0000", 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000139393 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055516+0000", 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103859 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:378 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.289438806, 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028653440000000001, 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.392 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 378 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055178+0000", 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.79e-06 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055192+0000", 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4096e-05 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055223+0000", 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0323000000000001e-05 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055242+0000", 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9513000000000001e-05 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055624+0000", 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038226500000000001 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055809+0000", 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000184489 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056219+0000", 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040993900000000001 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057655+0000", 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001436622 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057704+0000", 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8285999999999998e-05 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057868+0000", 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164129 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058041+0000", 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017289200000000001 2024-09-10T15:25:39.397 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:401 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.282901844000001, 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004220583, 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 401 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061715+0000", 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7269999999999999e-06 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061732+0000", 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6696000000000001e-05 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061764+0000", 2024-09-10T15:25:39.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2184000000000002e-05 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061786+0000", 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1676e-05 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061935+0000", 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014901500000000001 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062062+0000", 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000127317 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062269+0000", 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000206744 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.063459+0000", 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001190226 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065746+0000", 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022868900000000002 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065870+0000", 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124129 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065933+0000", 2024-09-10T15:25:39.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2978999999999995e-05 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:442 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.264172231, 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028624620000000001, 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.404 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 442 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:39.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080444+0000", 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.916e-06 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080455+0000", 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.076e-05 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080478+0000", 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3269999999999999e-05 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080495+0000", 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6764000000000001e-05 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080598+0000", 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103502 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080752+0000", 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000153914 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.081097+0000", 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034484899999999999 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.082189+0000", 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001092045 2024-09-10T15:25:39.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083095+0000", 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090592799999999996 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083210+0000", 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115253 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083304+0000", 2024-09-10T15:25:39.409 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4260999999999998e-05 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:514 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.229992269, 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002949002, 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.410 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 514 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114624+0000", 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114633+0000", 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114654+0000", 2024-09-10T15:25:39.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1287000000000001e-05 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114671+0000", 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7099999999999999e-05 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114747+0000", 2024-09-10T15:25:39.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6309000000000004e-05 2024-09-10T15:25:39.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.415 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114841+0000", 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3691999999999997e-05 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115037+0000", 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019563100000000001 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115920+0000", 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088357799999999999 2024-09-10T15:25:39.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117412+0000", 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001491746 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117495+0000", 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2465000000000004e-05 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117571+0000", 2024-09-10T15:25:39.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6344e-05 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:577 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.188194125999999, 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002869932, 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.418 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 577 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156422+0000", 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2639999999999998e-06 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156434+0000", 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1206000000000001e-05 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156462+0000", 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8294e-05 2024-09-10T15:25:39.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156476+0000", 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4667999999999999e-05 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156581+0000", 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010480399999999999 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156756+0000", 2024-09-10T15:25:39.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174694 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157050+0000", 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00029385499999999998 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157899+0000", 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00084936799999999998 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159140+0000", 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012406470000000001 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159228+0000", 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7696999999999997e-05 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159290+0000", 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2434999999999994e-05 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.423 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:587 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.181152506, 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042266669999999999, 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 587 2024-09-10T15:25:39.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163464+0000", 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163475+0000", 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1070000000000001e-05 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163503+0000", 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8062999999999999e-05 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163518+0000", 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4627000000000001e-05 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163646+0000", 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012872099999999999 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163827+0000", 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018048399999999999 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.164224+0000", 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039711999999999999 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165380+0000", 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011557990000000001 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167476+0000", 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020961119999999998 2024-09-10T15:25:39.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167595+0000", 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118585 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167688+0000", 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3789000000000006e-05 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.429 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.000876033000001, 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028733140000000001, 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 751 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343740+0000", 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3259999999999998e-06 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343752+0000", 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1590000000000001e-05 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343783+0000", 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343799+0000", 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343980+0000", 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018106200000000001 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344186+0000", 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020671099999999999 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344505+0000", 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031894099999999999 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.345596+0000", 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001090925 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346462+0000", 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086563700000000005 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346548+0000", 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5971999999999996e-05 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346611+0000", 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3700000000000003e-05 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.924487203, 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029293980000000002, 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.435 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 787 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:39.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420130+0000", 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8729999999999999e-06 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420142+0000", 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2106999999999999e-05 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420172+0000", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0456000000000001e-05 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420188+0000", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5359999999999999e-05 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420313+0000", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125253 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420534+0000", 2024-09-10T15:25:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220974 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420856+0000", 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032206200000000002 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.421932+0000", 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010764380000000001 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422868+0000", 2024-09-10T15:25:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00093595899999999999 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422950+0000", 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2039999999999994e-05 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.423056+0000", 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000105876 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.440 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.881579184, 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00345248, 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 805 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.441 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463037+0000", 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:25:39.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463049+0000", 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1620000000000001e-05 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463079+0000", 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9876e-05 2024-09-10T15:25:39.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463094+0000", 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4766999999999999e-05 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463256+0000", 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016214499999999999 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463625+0000", 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036956700000000001 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.464163+0000", 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053810299999999995 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.465401+0000", 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012375940000000001 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466225+0000", 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000824277 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466379+0000", 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000154172 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466487+0000", 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108006 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.446 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.876699319, 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030487999999999999, 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 807 2024-09-10T15:25:39.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.448 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467917+0000", 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1239999999999999e-06 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467928+0000", 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0966e-05 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467961+0000", 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2762999999999998e-05 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467980+0000", 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8960000000000001e-05 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468104+0000", 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012481600000000001 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468336+0000", 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231055 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468793+0000", 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045788699999999998 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470004+0000", 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012103859999999999 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470810+0000", 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00080637799999999996 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470900+0000", 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9412000000000004e-05 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470964+0000", 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4053000000000005e-05 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.452 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.682365705, 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030323030000000001, 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 889 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.453 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662252+0000", 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0570000000000001e-06 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662268+0000", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6093e-05 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662299+0000", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1795999999999998e-05 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662315+0000", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.524e-05 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662441+0000", 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012639199999999999 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662672+0000", 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023079200000000001 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.663000+0000", 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032838099999999999 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.664150+0000", 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011496639999999999 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665089+0000", 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000939203 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665174+0000", 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4886e-05 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665281+0000", 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679900000000001 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.668496312, 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030863430000000001, 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:39.458 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 895 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676120+0000", 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.216e-06 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676131+0000", 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1243999999999999e-05 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676162+0000", 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0692999999999999e-05 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676177+0000", 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5366000000000002e-05 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676353+0000", 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017565899999999999 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676575+0000", 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000222208 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676894+0000", 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031855099999999998 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.677954+0000", 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010597919999999999 2024-09-10T15:25:39.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679048+0000", 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010947719999999999 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679140+0000", 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1911999999999997e-05 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679204+0000", 2024-09-10T15:25:39.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3930000000000006e-05 2024-09-10T15:25:39.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.464 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:39.464 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:39.464 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:39.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:39.466 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:39.464+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:39.490 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:39.496 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:39.508 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-10T15:25:39.062234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225516,"kb_used_data":5080,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749204,"statfs":{"total":773094113280,"available":772863184896,"internally_reserved":0,"allocated":5201920,"data_stored":2932848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038392"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830838+0000","last_change":"2024-09-10T15:25:11.842625+0000","last_active":"2024-09-10T15:25:36.830838+0000","last_peered":"2024-09-10T15:25:36.830838+0000","last_clean":"2024-09-10T15:25:36.830838+0000","last_became_active":"2024-09-10T15:25:11.842298+0000","last_became_peered":"2024-09-10T15:25:11.842298+0000","last_unstale":"2024-09-10T15:25:36.830838+0000","last_undegraded":"2024-09-10T15:25:36.830838+0000","last_fullsized":"2024-09-10T15:25:36.830838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051661+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:25:38.051661+0000","last_peered":"2024-09-10T15:25:38.051661+0000","last_clean":"2024-09-10T15:25:38.051661+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:25:38.051661+0000","last_undegraded":"2024-09-10T15:25:38.051661+0000","last_fullsized":"2024-09-10T15:25:38.051661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833453+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:25:36.833453+0000","last_peered":"2024-09-10T15:25:36.833453+0000","last_clean":"2024-09-10T15:25:36.833453+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:25:36.833453+0000","last_undegraded":"2024-09-10T15:25:36.833453+0000","last_fullsized":"2024-09-10T15:25:36.833453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047754+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:25:37.047754+0000","last_peered":"2024-09-10T15:25:37.047754+0000","last_clean":"2024-09-10T15:25:37.047754+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:25:37.047754+0000","last_undegraded":"2024-09-10T15:25:37.047754+0000","last_fullsized":"2024-09-10T15:25:37.047754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832429+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:25:36.832429+0000","last_peered":"2024-09-10T15:25:36.832429+0000","last_clean":"2024-09-10T15:25:36.832429+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:25:36.832429+0000","last_undegraded":"2024-09-10T15:25:36.832429+0000","last_fullsized":"2024-09-10T15:25:36.832429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048164+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:25:37.048164+0000","last_peered":"2024-09-10T15:25:37.048164+0000","last_clean":"2024-09-10T15:25:37.048164+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:25:37.048164+0000","last_undegraded":"2024-09-10T15:25:37.048164+0000","last_fullsized":"2024-09-10T15:25:37.048164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830207+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:25:36.830207+0000","last_peered":"2024-09-10T15:25:36.830207+0000","last_clean":"2024-09-10T15:25:36.830207+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:25:36.830207+0000","last_undegraded":"2024-09-10T15:25:36.830207+0000","last_fullsized":"2024-09-10T15:25:36.830207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051926+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:25:38.051926+0000","last_peered":"2024-09-10T15:25:38.051926+0000","last_clean":"2024-09-10T15:25:38.051926+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:25:38.051926+0000","last_undegraded":"2024-09-10T15:25:38.051926+0000","last_fullsized":"2024-09-10T15:25:38.051926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830075+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:25:36.830075+0000","last_peered":"2024-09-10T15:25:36.830075+0000","last_clean":"2024-09-10T15:25:36.830075+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:25:36.830075+0000","last_undegraded":"2024-09-10T15:25:36.830075+0000","last_fullsized":"2024-09-10T15:25:36.830075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828767+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:25:36.828767+0000","last_peered":"2024-09-10T15:25:36.828767+0000","last_clean":"2024-09-10T15:25:36.828767+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:25:36.828767+0000","last_undegraded":"2024-09-10T15:25:36.828767+0000","last_fullsized":"2024-09-10T15:25:36.828767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828946+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:25:36.828946+0000","last_peered":"2024-09-10T15:25:36.828946+0000","last_clean":"2024-09-10T15:25:36.828946+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:25:36.828946+0000","last_undegraded":"2024-09-10T15:25:36.828946+0000","last_fullsized":"2024-09-10T15:25:36.828946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830278+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:25:36.830278+0000","last_peered":"2024-09-10T15:25:36.830278+0000","last_clean":"2024-09-10T15:25:36.830278+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:25:36.830278+0000","last_undegraded":"2024-09-10T15:25:36.830278+0000","last_fullsized":"2024-09-10T15:25:36.830278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831240+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:25:36.831240+0000","last_peered":"2024-09-10T15:25:36.831240+0000","last_clean":"2024-09-10T15:25:36.831240+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:25:36.831240+0000","last_undegraded":"2024-09-10T15:25:36.831240+0000","last_fullsized":"2024-09-10T15:25:36.831240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830212+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:25:36.830212+0000","last_peered":"2024-09-10T15:25:36.830212+0000","last_clean":"2024-09-10T15:25:36.830212+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:25:36.830212+0000","last_undegraded":"2024-09-10T15:25:36.830212+0000","last_fullsized":"2024-09-10T15:25:36.830212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830404+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:25:36.830404+0000","last_peered":"2024-09-10T15:25:36.830404+0000","last_clean":"2024-09-10T15:25:36.830404+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:25:36.830404+0000","last_undegraded":"2024-09-10T15:25:36.830404+0000","last_fullsized":"2024-09-10T15:25:36.830404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833031+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:25:36.833031+0000","last_peered":"2024-09-10T15:25:36.833031+0000","last_clean":"2024-09-10T15:25:36.833031+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:25:36.833031+0000","last_undegraded":"2024-09-10T15:25:36.833031+0000","last_fullsized":"2024-09-10T15:25:36.833031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047192+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:25:37.047192+0000","last_peered":"2024-09-10T15:25:37.047192+0000","last_clean":"2024-09-10T15:25:37.047192+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:25:37.047192+0000","last_undegraded":"2024-09-10T15:25:37.047192+0000","last_fullsized":"2024-09-10T15:25:37.047192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055570+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:25:38.055570+0000","last_peered":"2024-09-10T15:25:38.055570+0000","last_clean":"2024-09-10T15:25:38.055570+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:25:38.055570+0000","last_undegraded":"2024-09-10T15:25:38.055570+0000","last_fullsized":"2024-09-10T15:25:38.055570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830824+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:25:36.830824+0000","last_peered":"2024-09-10T15:25:36.830824+0000","last_clean":"2024-09-10T15:25:36.830824+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:25:36.830824+0000","last_undegraded":"2024-09-10T15:25:36.830824+0000","last_fullsized":"2024-09-10T15:25:36.830824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830051+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:25:36.830051+0000","last_peered":"2024-09-10T15:25:36.830051+0000","last_clean":"2024-09-10T15:25:36.830051+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:25:36.830051+0000","last_undegraded":"2024-09-10T15:25:36.830051+0000","last_fullsized":"2024-09-10T15:25:36.830051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054234+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:25:38.054234+0000","last_peered":"2024-09-10T15:25:38.054234+0000","last_clean":"2024-09-10T15:25:38.054234+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:25:38.054234+0000","last_undegraded":"2024-09-10T15:25:38.054234+0000","last_fullsized":"2024-09-10T15:25:38.054234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830460+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:25:36.830460+0000","last_peered":"2024-09-10T15:25:36.830460+0000","last_clean":"2024-09-10T15:25:36.830460+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:25:36.830460+0000","last_undegraded":"2024-09-10T15:25:36.830460+0000","last_fullsized":"2024-09-10T15:25:36.830460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225345+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:25:37.225345+0000","last_peered":"2024-09-10T15:25:37.225345+0000","last_clean":"2024-09-10T15:25:37.225345+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:25:37.225345+0000","last_undegraded":"2024-09-10T15:25:37.225345+0000","last_fullsized":"2024-09-10T15:25:37.225345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828998+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:25:36.828998+0000","last_peered":"2024-09-10T15:25:36.828998+0000","last_clean":"2024-09-10T15:25:36.828998+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:25:36.828998+0000","last_undegraded":"2024-09-10T15:25:36.828998+0000","last_fullsized":"2024-09-10T15:25:36.828998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831513+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:25:36.831513+0000","last_peered":"2024-09-10T15:25:36.831513+0000","last_clean":"2024-09-10T15:25:36.831513+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:25:36.831513+0000","last_undegraded":"2024-09-10T15:25:36.831513+0000","last_fullsized":"2024-09-10T15:25:36.831513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226198+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:25:37.226198+0000","last_peered":"2024-09-10T15:25:37.226198+0000","last_clean":"2024-09-10T15:25:37.226198+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:25:37.226198+0000","last_undegraded":"2024-09-10T15:25:37.226198+0000","last_fullsized":"2024-09-10T15:25:37.226198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055575+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:25:38.055575+0000","last_peered":"2024-09-10T15:25:38.055575+0000","last_clean":"2024-09-10T15:25:38.055575+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:25:38.055575+0000","last_undegraded":"2024-09-10T15:25:38.055575+0000","last_fullsized":"2024-09-10T15:25:38.055575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225301+0000","last_change":"2024-09-10T15:25:11.843256+0000","last_active":"2024-09-10T15:25:37.225301+0000","last_peered":"2024-09-10T15:25:37.225301+0000","last_clean":"2024-09-10T15:25:37.225301+0000","last_became_active":"2024-09-10T15:25:11.842370+0000","last_became_peered":"2024-09-10T15:25:11.842370+0000","last_unstale":"2024-09-10T15:25:37.225301+0000","last_undegraded":"2024-09-10T15:25:37.225301+0000","last_fullsized":"2024-09-10T15:25:37.225301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.827698+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:25:36.827698+0000","last_peered":"2024-09-10T15:25:36.827698+0000","last_clean":"2024-09-10T15:25:36.827698+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:25:36.827698+0000","last_undegraded":"2024-09-10T15:25:36.827698+0000","last_fullsized":"2024-09-10T15:25:36.827698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226099+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:25:37.226099+0000","last_peered":"2024-09-10T15:25:37.226099+0000","last_clean":"2024-09-10T15:25:37.226099+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:25:37.226099+0000","last_undegraded":"2024-09-10T15:25:37.226099+0000","last_fullsized":"2024-09-10T15:25:37.226099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048405+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:25:37.048405+0000","last_peered":"2024-09-10T15:25:37.048405+0000","last_clean":"2024-09-10T15:25:37.048405+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:25:37.048405+0000","last_undegraded":"2024-09-10T15:25:37.048405+0000","last_fullsized":"2024-09-10T15:25:37.048405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049560+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:25:37.049560+0000","last_peered":"2024-09-10T15:25:37.049560+0000","last_clean":"2024-09-10T15:25:37.049560+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:25:37.049560+0000","last_undegraded":"2024-09-10T15:25:37.049560+0000","last_fullsized":"2024-09-10T15:25:37.049560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051916+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:25:38.051916+0000","last_peered":"2024-09-10T15:25:38.051916+0000","last_clean":"2024-09-10T15:25:38.051916+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:25:38.051916+0000","last_undegraded":"2024-09-10T15:25:38.051916+0000","last_fullsized":"2024-09-10T15:25:38.051916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055087+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:25:38.055087+0000","last_peered":"2024-09-10T15:25:38.055087+0000","last_clean":"2024-09-10T15:25:38.055087+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:25:38.055087+0000","last_undegraded":"2024-09-10T15:25:38.055087+0000","last_fullsized":"2024-09-10T15:25:38.055087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051975+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:25:38.051975+0000","last_peered":"2024-09-10T15:25:38.051975+0000","last_clean":"2024-09-10T15:25:38.051975+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:25:38.051975+0000","last_undegraded":"2024-09-10T15:25:38.051975+0000","last_fullsized":"2024-09-10T15:25:38.051975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049374+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:25:37.049374+0000","last_peered":"2024-09-10T15:25:37.049374+0000","last_clean":"2024-09-10T15:25:37.049374+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:25:37.049374+0000","last_undegraded":"2024-09-10T15:25:37.049374+0000","last_fullsized":"2024-09-10T15:25:37.049374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225623+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:25:37.225623+0000","last_peered":"2024-09-10T15:25:37.225623+0000","last_clean":"2024-09-10T15:25:37.225623+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:25:37.225623+0000","last_undegraded":"2024-09-10T15:25:37.225623+0000","last_fullsized":"2024-09-10T15:25:37.225623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052090+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:25:38.052090+0000","last_peered":"2024-09-10T15:25:38.052090+0000","last_clean":"2024-09-10T15:25:38.052090+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:25:38.052090+0000","last_undegraded":"2024-09-10T15:25:38.052090+0000","last_fullsized":"2024-09-10T15:25:38.052090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055130+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:25:38.055130+0000","last_peered":"2024-09-10T15:25:38.055130+0000","last_clean":"2024-09-10T15:25:38.055130+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:25:38.055130+0000","last_undegraded":"2024-09-10T15:25:38.055130+0000","last_fullsized":"2024-09-10T15:25:38.055130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054806+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:25:38.054806+0000","last_peered":"2024-09-10T15:25:38.054806+0000","last_clean":"2024-09-10T15:25:38.054806+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:25:38.054806+0000","last_undegraded":"2024-09-10T15:25:38.054806+0000","last_fullsized":"2024-09-10T15:25:38.054806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224744+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:25:37.224744+0000","last_peered":"2024-09-10T15:25:37.224744+0000","last_clean":"2024-09-10T15:25:37.224744+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:25:37.224744+0000","last_undegraded":"2024-09-10T15:25:37.224744+0000","last_fullsized":"2024-09-10T15:25:37.224744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831945+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:25:36.831945+0000","last_peered":"2024-09-10T15:25:36.831945+0000","last_clean":"2024-09-10T15:25:36.831945+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:25:36.831945+0000","last_undegraded":"2024-09-10T15:25:36.831945+0000","last_fullsized":"2024-09-10T15:25:36.831945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047894+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:25:37.047894+0000","last_peered":"2024-09-10T15:25:37.047894+0000","last_clean":"2024-09-10T15:25:37.047894+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:25:37.047894+0000","last_undegraded":"2024-09-10T15:25:37.047894+0000","last_fullsized":"2024-09-10T15:25:37.047894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053275+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:25:38.053275+0000","last_peered":"2024-09-10T15:25:38.053275+0000","last_clean":"2024-09-10T15:25:38.053275+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:25:38.053275+0000","last_undegraded":"2024-09-10T15:25:38.053275+0000","last_fullsized":"2024-09-10T15:25:38.053275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051676+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:25:38.051676+0000","last_peered":"2024-09-10T15:25:38.051676+0000","last_clean":"2024-09-10T15:25:38.051676+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:25:38.051676+0000","last_undegraded":"2024-09-10T15:25:38.051676+0000","last_fullsized":"2024-09-10T15:25:38.051676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049605+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:25:37.049605+0000","last_peered":"2024-09-10T15:25:37.049605+0000","last_clean":"2024-09-10T15:25:37.049605+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:25:37.049605+0000","last_undegraded":"2024-09-10T15:25:37.049605+0000","last_fullsized":"2024-09-10T15:25:37.049605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828628+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:25:36.828628+0000","last_peered":"2024-09-10T15:25:36.828628+0000","last_clean":"2024-09-10T15:25:36.828628+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:25:36.828628+0000","last_undegraded":"2024-09-10T15:25:36.828628+0000","last_fullsized":"2024-09-10T15:25:36.828628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832622+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:25:36.832622+0000","last_peered":"2024-09-10T15:25:36.832622+0000","last_clean":"2024-09-10T15:25:36.832622+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:25:36.832622+0000","last_undegraded":"2024-09-10T15:25:36.832622+0000","last_fullsized":"2024-09-10T15:25:36.832622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051970+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:25:38.051970+0000","last_peered":"2024-09-10T15:25:38.051970+0000","last_clean":"2024-09-10T15:25:38.051970+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:25:38.051970+0000","last_undegraded":"2024-09-10T15:25:38.051970+0000","last_fullsized":"2024-09-10T15:25:38.051970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048684+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:25:37.048684+0000","last_peered":"2024-09-10T15:25:37.048684+0000","last_clean":"2024-09-10T15:25:37.048684+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:25:37.048684+0000","last_undegraded":"2024-09-10T15:25:37.048684+0000","last_fullsized":"2024-09-10T15:25:37.048684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829673+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:25:36.829673+0000","last_peered":"2024-09-10T15:25:36.829673+0000","last_clean":"2024-09-10T15:25:36.829673+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:25:36.829673+0000","last_undegraded":"2024-09-10T15:25:36.829673+0000","last_fullsized":"2024-09-10T15:25:36.829673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832170+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:25:36.832170+0000","last_peered":"2024-09-10T15:25:36.832170+0000","last_clean":"2024-09-10T15:25:36.832170+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:25:36.832170+0000","last_undegraded":"2024-09-10T15:25:36.832170+0000","last_fullsized":"2024-09-10T15:25:36.832170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047282+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:25:37.047282+0000","last_peered":"2024-09-10T15:25:37.047282+0000","last_clean":"2024-09-10T15:25:37.047282+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:25:37.047282+0000","last_undegraded":"2024-09-10T15:25:37.047282+0000","last_fullsized":"2024-09-10T15:25:37.047282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830961+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:25:36.830961+0000","last_peered":"2024-09-10T15:25:36.830961+0000","last_clean":"2024-09-10T15:25:36.830961+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:25:36.830961+0000","last_undegraded":"2024-09-10T15:25:36.830961+0000","last_fullsized":"2024-09-10T15:25:36.830961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052911+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:25:38.052911+0000","last_peered":"2024-09-10T15:25:38.052911+0000","last_clean":"2024-09-10T15:25:38.052911+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:25:38.052911+0000","last_undegraded":"2024-09-10T15:25:38.052911+0000","last_fullsized":"2024-09-10T15:25:38.052911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828471+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:25:36.828471+0000","last_peered":"2024-09-10T15:25:36.828471+0000","last_clean":"2024-09-10T15:25:36.828471+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:25:36.828471+0000","last_undegraded":"2024-09-10T15:25:36.828471+0000","last_fullsized":"2024-09-10T15:25:36.828471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225038+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:25:37.225038+0000","last_peered":"2024-09-10T15:25:37.225038+0000","last_clean":"2024-09-10T15:25:37.225038+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:25:37.225038+0000","last_undegraded":"2024-09-10T15:25:37.225038+0000","last_fullsized":"2024-09-10T15:25:37.225038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829775+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:25:36.829775+0000","last_peered":"2024-09-10T15:25:36.829775+0000","last_clean":"2024-09-10T15:25:36.829775+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:25:36.829775+0000","last_undegraded":"2024-09-10T15:25:36.829775+0000","last_fullsized":"2024-09-10T15:25:36.829775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053253+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:25:38.053253+0000","last_peered":"2024-09-10T15:25:38.053253+0000","last_clean":"2024-09-10T15:25:38.053253+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:25:38.053253+0000","last_undegraded":"2024-09-10T15:25:38.053253+0000","last_fullsized":"2024-09-10T15:25:38.053253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830561+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:25:36.830561+0000","last_peered":"2024-09-10T15:25:36.830561+0000","last_clean":"2024-09-10T15:25:36.830561+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:25:36.830561+0000","last_undegraded":"2024-09-10T15:25:36.830561+0000","last_fullsized":"2024-09-10T15:25:36.830561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224446+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:25:37.224446+0000","last_peered":"2024-09-10T15:25:37.224446+0000","last_clean":"2024-09-10T15:25:37.224446+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:25:37.224446+0000","last_undegraded":"2024-09-10T15:25:37.224446+0000","last_fullsized":"2024-09-10T15:25:37.224446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051073+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:25:38.051073+0000","last_peered":"2024-09-10T15:25:38.051073+0000","last_clean":"2024-09-10T15:25:38.051073+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:25:38.051073+0000","last_undegraded":"2024-09-10T15:25:38.051073+0000","last_fullsized":"2024-09-10T15:25:38.051073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050762+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:25:38.050762+0000","last_peered":"2024-09-10T15:25:38.050762+0000","last_clean":"2024-09-10T15:25:38.050762+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:25:38.050762+0000","last_undegraded":"2024-09-10T15:25:38.050762+0000","last_fullsized":"2024-09-10T15:25:38.050762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054796+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:25:38.054796+0000","last_peered":"2024-09-10T15:25:38.054796+0000","last_clean":"2024-09-10T15:25:38.054796+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:25:38.054796+0000","last_undegraded":"2024-09-10T15:25:38.054796+0000","last_fullsized":"2024-09-10T15:25:38.054796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828479+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:25:36.828479+0000","last_peered":"2024-09-10T15:25:36.828479+0000","last_clean":"2024-09-10T15:25:36.828479+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:25:36.828479+0000","last_undegraded":"2024-09-10T15:25:36.828479+0000","last_fullsized":"2024-09-10T15:25:36.828479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049164+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:25:37.049164+0000","last_peered":"2024-09-10T15:25:37.049164+0000","last_clean":"2024-09-10T15:25:37.049164+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:25:37.049164+0000","last_undegraded":"2024-09-10T15:25:37.049164+0000","last_fullsized":"2024-09-10T15:25:37.049164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830512+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:25:36.830512+0000","last_peered":"2024-09-10T15:25:36.830512+0000","last_clean":"2024-09-10T15:25:36.830512+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:25:36.830512+0000","last_undegraded":"2024-09-10T15:25:36.830512+0000","last_fullsized":"2024-09-10T15:25:36.830512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047046+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:25:37.047046+0000","last_peered":"2024-09-10T15:25:37.047046+0000","last_clean":"2024-09-10T15:25:37.047046+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:25:37.047046+0000","last_undegraded":"2024-09-10T15:25:37.047046+0000","last_fullsized":"2024-09-10T15:25:37.047046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830360+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:25:36.830360+0000","last_peered":"2024-09-10T15:25:36.830360+0000","last_clean":"2024-09-10T15:25:36.830360+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:25:36.830360+0000","last_undegraded":"2024-09-10T15:25:36.830360+0000","last_fullsized":"2024-09-10T15:25:36.830360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225994+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:25:37.225994+0000","last_peered":"2024-09-10T15:25:37.225994+0000","last_clean":"2024-09-10T15:25:37.225994+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:25:37.225994+0000","last_undegraded":"2024-09-10T15:25:37.225994+0000","last_fullsized":"2024-09-10T15:25:37.225994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832750+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:25:36.832750+0000","last_peered":"2024-09-10T15:25:36.832750+0000","last_clean":"2024-09-10T15:25:36.832750+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:25:36.832750+0000","last_undegraded":"2024-09-10T15:25:36.832750+0000","last_fullsized":"2024-09-10T15:25:36.832750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829460+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:25:36.829460+0000","last_peered":"2024-09-10T15:25:36.829460+0000","last_clean":"2024-09-10T15:25:36.829460+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:25:36.829460+0000","last_undegraded":"2024-09-10T15:25:36.829460+0000","last_fullsized":"2024-09-10T15:25:36.829460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224939+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:25:37.224939+0000","last_peered":"2024-09-10T15:25:37.224939+0000","last_clean":"2024-09-10T15:25:37.224939+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:25:37.224939+0000","last_undegraded":"2024-09-10T15:25:37.224939+0000","last_fullsized":"2024-09-10T15:25:37.224939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":56,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050569+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:25:38.050569+0000","last_peered":"2024-09-10T15:25:38.050569+0000","last_clean":"2024-09-10T15:25:38.050569+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:25:38.050569+0000","last_undegraded":"2024-09-10T15:25:38.050569+0000","last_fullsized":"2024-09-10T15:25:38.050569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831104+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:25:36.831104+0000","last_peered":"2024-09-10T15:25:36.831104+0000","last_clean":"2024-09-10T15:25:36.831104+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:25:36.831104+0000","last_undegraded":"2024-09-10T15:25:36.831104+0000","last_fullsized":"2024-09-10T15:25:36.831104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049953+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:25:37.049953+0000","last_peered":"2024-09-10T15:25:37.049953+0000","last_clean":"2024-09-10T15:25:37.049953+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:25:37.049953+0000","last_undegraded":"2024-09-10T15:25:37.049953+0000","last_fullsized":"2024-09-10T15:25:37.049953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829106+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:36.829106+0000","last_peered":"2024-09-10T15:25:36.829106+0000","last_clean":"2024-09-10T15:25:36.829106+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:25:36.829106+0000","last_undegraded":"2024-09-10T15:25:36.829106+0000","last_fullsized":"2024-09-10T15:25:36.829106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049586+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:25:37.049586+0000","last_peered":"2024-09-10T15:25:37.049586+0000","last_clean":"2024-09-10T15:25:37.049586+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:25:37.049586+0000","last_undegraded":"2024-09-10T15:25:37.049586+0000","last_fullsized":"2024-09-10T15:25:37.049586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049437+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:25:37.049437+0000","last_peered":"2024-09-10T15:25:37.049437+0000","last_clean":"2024-09-10T15:25:37.049437+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:25:37.049437+0000","last_undegraded":"2024-09-10T15:25:37.049437+0000","last_fullsized":"2024-09-10T15:25:37.049437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054970+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:25:38.054970+0000","last_peered":"2024-09-10T15:25:38.054970+0000","last_clean":"2024-09-10T15:25:38.054970+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:25:38.054970+0000","last_undegraded":"2024-09-10T15:25:38.054970+0000","last_fullsized":"2024-09-10T15:25:38.054970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049775+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:25:37.049775+0000","last_peered":"2024-09-10T15:25:37.049775+0000","last_clean":"2024-09-10T15:25:37.049775+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:25:37.049775+0000","last_undegraded":"2024-09-10T15:25:37.049775+0000","last_fullsized":"2024-09-10T15:25:37.049775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829758+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:25:36.829758+0000","last_peered":"2024-09-10T15:25:36.829758+0000","last_clean":"2024-09-10T15:25:36.829758+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:25:36.829758+0000","last_undegraded":"2024-09-10T15:25:36.829758+0000","last_fullsized":"2024-09-10T15:25:36.829758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049517+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:25:37.049517+0000","last_peered":"2024-09-10T15:25:37.049517+0000","last_clean":"2024-09-10T15:25:37.049517+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:25:37.049517+0000","last_undegraded":"2024-09-10T15:25:37.049517+0000","last_fullsized":"2024-09-10T15:25:37.049517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048405+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:25:37.048405+0000","last_peered":"2024-09-10T15:25:37.048405+0000","last_clean":"2024-09-10T15:25:37.048405+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:25:37.048405+0000","last_undegraded":"2024-09-10T15:25:37.048405+0000","last_fullsized":"2024-09-10T15:25:37.048405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831242+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:25:36.831242+0000","last_peered":"2024-09-10T15:25:36.831242+0000","last_clean":"2024-09-10T15:25:36.831242+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:25:36.831242+0000","last_undegraded":"2024-09-10T15:25:36.831242+0000","last_fullsized":"2024-09-10T15:25:36.831242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832188+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:25:36.832188+0000","last_peered":"2024-09-10T15:25:36.832188+0000","last_clean":"2024-09-10T15:25:36.832188+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:25:36.832188+0000","last_undegraded":"2024-09-10T15:25:36.832188+0000","last_fullsized":"2024-09-10T15:25:36.832188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049854+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:25:37.049854+0000","last_peered":"2024-09-10T15:25:37.049854+0000","last_clean":"2024-09-10T15:25:37.049854+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:25:37.049854+0000","last_undegraded":"2024-09-10T15:25:37.049854+0000","last_fullsized":"2024-09-10T15:25:37.049854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224600+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:25:37.224600+0000","last_peered":"2024-09-10T15:25:37.224600+0000","last_clean":"2024-09-10T15:25:37.224600+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:25:37.224600+0000","last_undegraded":"2024-09-10T15:25:37.224600+0000","last_fullsized":"2024-09-10T15:25:37.224600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829959+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:25:36.829959+0000","last_peered":"2024-09-10T15:25:36.829959+0000","last_clean":"2024-09-10T15:25:36.829959+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:25:36.829959+0000","last_undegraded":"2024-09-10T15:25:36.829959+0000","last_fullsized":"2024-09-10T15:25:36.829959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047969+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:25:37.047969+0000","last_peered":"2024-09-10T15:25:37.047969+0000","last_clean":"2024-09-10T15:25:37.047969+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:25:37.047969+0000","last_undegraded":"2024-09-10T15:25:37.047969+0000","last_fullsized":"2024-09-10T15:25:37.047969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055334+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:25:38.055334+0000","last_peered":"2024-09-10T15:25:38.055334+0000","last_clean":"2024-09-10T15:25:38.055334+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:25:38.055334+0000","last_undegraded":"2024-09-10T15:25:38.055334+0000","last_fullsized":"2024-09-10T15:25:38.055334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225440+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:25:37.225440+0000","last_peered":"2024-09-10T15:25:37.225440+0000","last_clean":"2024-09-10T15:25:37.225440+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:25:37.225440+0000","last_undegraded":"2024-09-10T15:25:37.225440+0000","last_fullsized":"2024-09-10T15:25:37.225440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055430+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:25:38.055430+0000","last_peered":"2024-09-10T15:25:38.055430+0000","last_clean":"2024-09-10T15:25:38.055430+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:25:38.055430+0000","last_undegraded":"2024-09-10T15:25:38.055430+0000","last_fullsized":"2024-09-10T15:25:38.055430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828264+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:25:36.828264+0000","last_peered":"2024-09-10T15:25:36.828264+0000","last_clean":"2024-09-10T15:25:36.828264+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:25:36.828264+0000","last_undegraded":"2024-09-10T15:25:36.828264+0000","last_fullsized":"2024-09-10T15:25:36.828264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050255+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:25:37.050255+0000","last_peered":"2024-09-10T15:25:37.050255+0000","last_clean":"2024-09-10T15:25:37.050255+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:25:37.050255+0000","last_undegraded":"2024-09-10T15:25:37.050255+0000","last_fullsized":"2024-09-10T15:25:37.050255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050904+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:25:38.050904+0000","last_peered":"2024-09-10T15:25:38.050904+0000","last_clean":"2024-09-10T15:25:38.050904+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:25:38.050904+0000","last_undegraded":"2024-09-10T15:25:38.050904+0000","last_fullsized":"2024-09-10T15:25:38.050904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048790+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:25:37.048790+0000","last_peered":"2024-09-10T15:25:37.048790+0000","last_clean":"2024-09-10T15:25:37.048790+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:25:37.048790+0000","last_undegraded":"2024-09-10T15:25:37.048790+0000","last_fullsized":"2024-09-10T15:25:37.048790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055085+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:25:38.055085+0000","last_peered":"2024-09-10T15:25:38.055085+0000","last_clean":"2024-09-10T15:25:38.055085+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:25:38.055085+0000","last_undegraded":"2024-09-10T15:25:38.055085+0000","last_fullsized":"2024-09-10T15:25:38.055085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830100+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:25:36.830100+0000","last_peered":"2024-09-10T15:25:36.830100+0000","last_clean":"2024-09-10T15:25:36.830100+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:25:36.830100+0000","last_undegraded":"2024-09-10T15:25:36.830100+0000","last_fullsized":"2024-09-10T15:25:36.830100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048732+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:25:37.048732+0000","last_peered":"2024-09-10T15:25:37.048732+0000","last_clean":"2024-09-10T15:25:37.048732+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:25:37.048732+0000","last_undegraded":"2024-09-10T15:25:37.048732+0000","last_fullsized":"2024-09-10T15:25:37.048732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049219+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:25:37.049219+0000","last_peered":"2024-09-10T15:25:37.049219+0000","last_clean":"2024-09-10T15:25:37.049219+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:25:37.049219+0000","last_undegraded":"2024-09-10T15:25:37.049219+0000","last_fullsized":"2024-09-10T15:25:37.049219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052087+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:38.052087+0000","last_peered":"2024-09-10T15:25:38.052087+0000","last_clean":"2024-09-10T15:25:38.052087+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:38.052087+0000","last_undegraded":"2024-09-10T15:25:38.052087+0000","last_fullsized":"2024-09-10T15:25:38.052087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048682+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:37.048682+0000","last_peered":"2024-09-10T15:25:37.048682+0000","last_clean":"2024-09-10T15:25:37.048682+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:37.048682+0000","last_undegraded":"2024-09-10T15:25:37.048682+0000","last_fullsized":"2024-09-10T15:25:37.048682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051619+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:25:38.051619+0000","last_peered":"2024-09-10T15:25:38.051619+0000","last_clean":"2024-09-10T15:25:38.051619+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:25:38.051619+0000","last_undegraded":"2024-09-10T15:25:38.051619+0000","last_fullsized":"2024-09-10T15:25:38.051619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828639+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:25:36.828639+0000","last_peered":"2024-09-10T15:25:36.828639+0000","last_clean":"2024-09-10T15:25:36.828639+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:25:36.828639+0000","last_undegraded":"2024-09-10T15:25:36.828639+0000","last_fullsized":"2024-09-10T15:25:36.828639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049264+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:25:37.049264+0000","last_peered":"2024-09-10T15:25:37.049264+0000","last_clean":"2024-09-10T15:25:37.049264+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:25:37.049264+0000","last_undegraded":"2024-09-10T15:25:37.049264+0000","last_fullsized":"2024-09-10T15:25:37.049264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831470+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:25:36.831470+0000","last_peered":"2024-09-10T15:25:36.831470+0000","last_clean":"2024-09-10T15:25:36.831470+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:25:36.831470+0000","last_undegraded":"2024-09-10T15:25:36.831470+0000","last_fullsized":"2024-09-10T15:25:36.831470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828639+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:25:36.828639+0000","last_peered":"2024-09-10T15:25:36.828639+0000","last_clean":"2024-09-10T15:25:36.828639+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:25:36.828639+0000","last_undegraded":"2024-09-10T15:25:36.828639+0000","last_fullsized":"2024-09-10T15:25:36.828639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833446+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:25:36.833446+0000","last_peered":"2024-09-10T15:25:36.833446+0000","last_clean":"2024-09-10T15:25:36.833446+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:25:36.833446+0000","last_undegraded":"2024-09-10T15:25:36.833446+0000","last_fullsized":"2024-09-10T15:25:36.833446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047498+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:37.047498+0000","last_peered":"2024-09-10T15:25:37.047498+0000","last_clean":"2024-09-10T15:25:37.047498+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:37.047498+0000","last_undegraded":"2024-09-10T15:25:37.047498+0000","last_fullsized":"2024-09-10T15:25:37.047498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225270+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:25:37.225270+0000","last_peered":"2024-09-10T15:25:37.225270+0000","last_clean":"2024-09-10T15:25:37.225270+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:25:37.225270+0000","last_undegraded":"2024-09-10T15:25:37.225270+0000","last_fullsized":"2024-09-10T15:25:37.225270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048799+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:25:37.048799+0000","last_peered":"2024-09-10T15:25:37.048799+0000","last_clean":"2024-09-10T15:25:37.048799+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:25:37.048799+0000","last_undegraded":"2024-09-10T15:25:37.048799+0000","last_fullsized":"2024-09-10T15:25:37.048799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":76,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049111+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:25:37.049111+0000","last_peered":"2024-09-10T15:25:37.049111+0000","last_clean":"2024-09-10T15:25:37.049111+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:25:37.049111+0000","last_undegraded":"2024-09-10T15:25:37.049111+0000","last_fullsized":"2024-09-10T15:25:37.049111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049474+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:25:37.049474+0000","last_peered":"2024-09-10T15:25:37.049474+0000","last_clean":"2024-09-10T15:25:37.049474+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:25:37.049474+0000","last_undegraded":"2024-09-10T15:25:37.049474+0000","last_fullsized":"2024-09-10T15:25:37.049474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830793+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:25:36.830793+0000","last_peered":"2024-09-10T15:25:36.830793+0000","last_clean":"2024-09-10T15:25:36.830793+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:25:36.830793+0000","last_undegraded":"2024-09-10T15:25:36.830793+0000","last_fullsized":"2024-09-10T15:25:36.830793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226260+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:25:37.226260+0000","last_peered":"2024-09-10T15:25:37.226260+0000","last_clean":"2024-09-10T15:25:37.226260+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:25:37.226260+0000","last_undegraded":"2024-09-10T15:25:37.226260+0000","last_fullsized":"2024-09-10T15:25:37.226260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048603+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:37.048603+0000","last_peered":"2024-09-10T15:25:37.048603+0000","last_clean":"2024-09-10T15:25:37.048603+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:37.048603+0000","last_undegraded":"2024-09-10T15:25:37.048603+0000","last_fullsized":"2024-09-10T15:25:37.048603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831381+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:25:36.831381+0000","last_peered":"2024-09-10T15:25:36.831381+0000","last_clean":"2024-09-10T15:25:36.831381+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:25:36.831381+0000","last_undegraded":"2024-09-10T15:25:36.831381+0000","last_fullsized":"2024-09-10T15:25:36.831381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050098+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:25:37.050098+0000","last_peered":"2024-09-10T15:25:37.050098+0000","last_clean":"2024-09-10T15:25:37.050098+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:25:37.050098+0000","last_undegraded":"2024-09-10T15:25:37.050098+0000","last_fullsized":"2024-09-10T15:25:37.050098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829739+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:25:36.829739+0000","last_peered":"2024-09-10T15:25:36.829739+0000","last_clean":"2024-09-10T15:25:36.829739+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:25:36.829739+0000","last_undegraded":"2024-09-10T15:25:36.829739+0000","last_fullsized":"2024-09-10T15:25:36.829739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052647+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:25:38.052647+0000","last_peered":"2024-09-10T15:25:38.052647+0000","last_clean":"2024-09-10T15:25:38.052647+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:25:38.052647+0000","last_undegraded":"2024-09-10T15:25:38.052647+0000","last_fullsized":"2024-09-10T15:25:38.052647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050902+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:25:38.050902+0000","last_peered":"2024-09-10T15:25:38.050902+0000","last_clean":"2024-09-10T15:25:38.050902+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:25:38.050902+0000","last_undegraded":"2024-09-10T15:25:38.050902+0000","last_fullsized":"2024-09-10T15:25:38.050902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226344+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:25:37.226344+0000","last_peered":"2024-09-10T15:25:37.226344+0000","last_clean":"2024-09-10T15:25:37.226344+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:25:37.226344+0000","last_undegraded":"2024-09-10T15:25:37.226344+0000","last_fullsized":"2024-09-10T15:25:37.226344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048501+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:37.048501+0000","last_peered":"2024-09-10T15:25:37.048501+0000","last_clean":"2024-09-10T15:25:37.048501+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:37.048501+0000","last_undegraded":"2024-09-10T15:25:37.048501+0000","last_fullsized":"2024-09-10T15:25:37.048501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830085+0000","last_change":"2024-09-10T15:25:11.842227+0000","last_active":"2024-09-10T15:25:36.830085+0000","last_peered":"2024-09-10T15:25:36.830085+0000","last_clean":"2024-09-10T15:25:36.830085+0000","last_became_active":"2024-09-10T15:25:11.841833+0000","last_became_peered":"2024-09-10T15:25:11.841833+0000","last_unstale":"2024-09-10T15:25:36.830085+0000","last_undegraded":"2024-09-10T15:25:36.830085+0000","last_fullsized":"2024-09-10T15:25:36.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049426+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:25:37.049426+0000","last_peered":"2024-09-10T15:25:37.049426+0000","last_clean":"2024-09-10T15:25:37.049426+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:25:37.049426+0000","last_undegraded":"2024-09-10T15:25:37.049426+0000","last_fullsized":"2024-09-10T15:25:37.049426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831549+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:25:36.831549+0000","last_peered":"2024-09-10T15:25:36.831549+0000","last_clean":"2024-09-10T15:25:36.831549+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:25:36.831549+0000","last_undegraded":"2024-09-10T15:25:36.831549+0000","last_fullsized":"2024-09-10T15:25:36.831549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049049+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:25:37.049049+0000","last_peered":"2024-09-10T15:25:37.049049+0000","last_clean":"2024-09-10T15:25:37.049049+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:25:37.049049+0000","last_undegraded":"2024-09-10T15:25:37.049049+0000","last_fullsized":"2024-09-10T15:25:37.049049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051183+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:25:38.051183+0000","last_peered":"2024-09-10T15:25:38.051183+0000","last_clean":"2024-09-10T15:25:38.051183+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:25:38.051183+0000","last_undegraded":"2024-09-10T15:25:38.051183+0000","last_fullsized":"2024-09-10T15:25:38.051183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225028+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:25:37.225028+0000","last_peered":"2024-09-10T15:25:37.225028+0000","last_clean":"2024-09-10T15:25:37.225028+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:25:37.225028+0000","last_undegraded":"2024-09-10T15:25:37.225028+0000","last_fullsized":"2024-09-10T15:25:37.225028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829787+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:25:36.829787+0000","last_peered":"2024-09-10T15:25:36.829787+0000","last_clean":"2024-09-10T15:25:36.829787+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:25:36.829787+0000","last_undegraded":"2024-09-10T15:25:36.829787+0000","last_fullsized":"2024-09-10T15:25:36.829787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832447+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:36.832447+0000","last_peered":"2024-09-10T15:25:36.832447+0000","last_clean":"2024-09-10T15:25:36.832447+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:36.832447+0000","last_undegraded":"2024-09-10T15:25:36.832447+0000","last_fullsized":"2024-09-10T15:25:36.832447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051414+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:25:38.051414+0000","last_peered":"2024-09-10T15:25:38.051414+0000","last_clean":"2024-09-10T15:25:38.051414+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:25:38.051414+0000","last_undegraded":"2024-09-10T15:25:38.051414+0000","last_fullsized":"2024-09-10T15:25:38.051414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048108+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:25:37.048108+0000","last_peered":"2024-09-10T15:25:37.048108+0000","last_clean":"2024-09-10T15:25:37.048108+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:25:37.048108+0000","last_undegraded":"2024-09-10T15:25:37.048108+0000","last_fullsized":"2024-09-10T15:25:37.048108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828153+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:25:36.828153+0000","last_peered":"2024-09-10T15:25:36.828153+0000","last_clean":"2024-09-10T15:25:36.828153+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:25:36.828153+0000","last_undegraded":"2024-09-10T15:25:36.828153+0000","last_fullsized":"2024-09-10T15:25:36.828153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831242+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:25:36.831242+0000","last_peered":"2024-09-10T15:25:36.831242+0000","last_clean":"2024-09-10T15:25:36.831242+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:25:36.831242+0000","last_undegraded":"2024-09-10T15:25:36.831242+0000","last_fullsized":"2024-09-10T15:25:36.831242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225624+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:25:37.225624+0000","last_peered":"2024-09-10T15:25:37.225624+0000","last_clean":"2024-09-10T15:25:37.225624+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:25:37.225624+0000","last_undegraded":"2024-09-10T15:25:37.225624+0000","last_fullsized":"2024-09-10T15:25:37.225624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226569+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:25:37.226569+0000","last_peered":"2024-09-10T15:25:37.226569+0000","last_clean":"2024-09-10T15:25:37.226569+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:25:37.226569+0000","last_undegraded":"2024-09-10T15:25:37.226569+0000","last_fullsized":"2024-09-10T15:25:37.226569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048997+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:37.048997+0000","last_peered":"2024-09-10T15:25:37.048997+0000","last_clean":"2024-09-10T15:25:37.048997+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:37.048997+0000","last_undegraded":"2024-09-10T15:25:37.048997+0000","last_fullsized":"2024-09-10T15:25:37.048997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828357+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:25:36.828357+0000","last_peered":"2024-09-10T15:25:36.828357+0000","last_clean":"2024-09-10T15:25:36.828357+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:25:36.828357+0000","last_undegraded":"2024-09-10T15:25:36.828357+0000","last_fullsized":"2024-09-10T15:25:36.828357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224942+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:25:37.224942+0000","last_peered":"2024-09-10T15:25:37.224942+0000","last_clean":"2024-09-10T15:25:37.224942+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:25:37.224942+0000","last_undegraded":"2024-09-10T15:25:37.224942+0000","last_fullsized":"2024-09-10T15:25:37.224942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051441+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:25:38.051441+0000","last_peered":"2024-09-10T15:25:38.051441+0000","last_clean":"2024-09-10T15:25:38.051441+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:25:38.051441+0000","last_undegraded":"2024-09-10T15:25:38.051441+0000","last_fullsized":"2024-09-10T15:25:38.051441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049733+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:25:37.049733+0000","last_peered":"2024-09-10T15:25:37.049733+0000","last_clean":"2024-09-10T15:25:37.049733+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:25:37.049733+0000","last_undegraded":"2024-09-10T15:25:37.049733+0000","last_fullsized":"2024-09-10T15:25:37.049733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050852+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:25:38.050852+0000","last_peered":"2024-09-10T15:25:38.050852+0000","last_clean":"2024-09-10T15:25:38.050852+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:25:38.050852+0000","last_undegraded":"2024-09-10T15:25:38.050852+0000","last_fullsized":"2024-09-10T15:25:38.050852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053681+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:25:38.053681+0000","last_peered":"2024-09-10T15:25:38.053681+0000","last_clean":"2024-09-10T15:25:38.053681+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:25:38.053681+0000","last_undegraded":"2024-09-10T15:25:38.053681+0000","last_fullsized":"2024-09-10T15:25:38.053681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053047+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:38.053047+0000","last_peered":"2024-09-10T15:25:38.053047+0000","last_clean":"2024-09-10T15:25:38.053047+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:38.053047+0000","last_undegraded":"2024-09-10T15:25:38.053047+0000","last_fullsized":"2024-09-10T15:25:38.053047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047675+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:25:37.047675+0000","last_peered":"2024-09-10T15:25:37.047675+0000","last_clean":"2024-09-10T15:25:37.047675+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:25:37.047675+0000","last_undegraded":"2024-09-10T15:25:37.047675+0000","last_fullsized":"2024-09-10T15:25:37.047675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048213+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:25:37.048213+0000","last_peered":"2024-09-10T15:25:37.048213+0000","last_clean":"2024-09-10T15:25:37.048213+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:25:37.048213+0000","last_undegraded":"2024-09-10T15:25:37.048213+0000","last_fullsized":"2024-09-10T15:25:37.048213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832983+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:25:36.832983+0000","last_peered":"2024-09-10T15:25:36.832983+0000","last_clean":"2024-09-10T15:25:36.832983+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:25:36.832983+0000","last_undegraded":"2024-09-10T15:25:36.832983+0000","last_fullsized":"2024-09-10T15:25:36.832983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830697+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:25:36.830697+0000","last_peered":"2024-09-10T15:25:36.830697+0000","last_clean":"2024-09-10T15:25:36.830697+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:25:36.830697+0000","last_undegraded":"2024-09-10T15:25:36.830697+0000","last_fullsized":"2024-09-10T15:25:36.830697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828367+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:25:36.828367+0000","last_peered":"2024-09-10T15:25:36.828367+0000","last_clean":"2024-09-10T15:25:36.828367+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:25:36.828367+0000","last_undegraded":"2024-09-10T15:25:36.828367+0000","last_fullsized":"2024-09-10T15:25:36.828367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052829+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:25:38.052829+0000","last_peered":"2024-09-10T15:25:38.052829+0000","last_clean":"2024-09-10T15:25:38.052829+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:25:38.052829+0000","last_undegraded":"2024-09-10T15:25:38.052829+0000","last_fullsized":"2024-09-10T15:25:38.052829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049215+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:37.049215+0000","last_peered":"2024-09-10T15:25:37.049215+0000","last_clean":"2024-09-10T15:25:37.049215+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:37.049215+0000","last_undegraded":"2024-09-10T15:25:37.049215+0000","last_fullsized":"2024-09-10T15:25:37.049215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050594+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:25:38.050594+0000","last_peered":"2024-09-10T15:25:38.050594+0000","last_clean":"2024-09-10T15:25:38.050594+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:25:38.050594+0000","last_undegraded":"2024-09-10T15:25:38.050594+0000","last_fullsized":"2024-09-10T15:25:38.050594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829459+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:25:36.829459+0000","last_peered":"2024-09-10T15:25:36.829459+0000","last_clean":"2024-09-10T15:25:36.829459+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:25:36.829459+0000","last_undegraded":"2024-09-10T15:25:36.829459+0000","last_fullsized":"2024-09-10T15:25:36.829459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051251+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:25:38.051251+0000","last_peered":"2024-09-10T15:25:38.051251+0000","last_clean":"2024-09-10T15:25:38.051251+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:25:38.051251+0000","last_undegraded":"2024-09-10T15:25:38.051251+0000","last_fullsized":"2024-09-10T15:25:38.051251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829559+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:25:36.829559+0000","last_peered":"2024-09-10T15:25:36.829559+0000","last_clean":"2024-09-10T15:25:36.829559+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:25:36.829559+0000","last_undegraded":"2024-09-10T15:25:36.829559+0000","last_fullsized":"2024-09-10T15:25:36.829559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053086+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:25:38.053086+0000","last_peered":"2024-09-10T15:25:38.053086+0000","last_clean":"2024-09-10T15:25:38.053086+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:25:38.053086+0000","last_undegraded":"2024-09-10T15:25:38.053086+0000","last_fullsized":"2024-09-10T15:25:38.053086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829286+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:25:36.829286+0000","last_peered":"2024-09-10T15:25:36.829286+0000","last_clean":"2024-09-10T15:25:36.829286+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:25:36.829286+0000","last_undegraded":"2024-09-10T15:25:36.829286+0000","last_fullsized":"2024-09-10T15:25:36.829286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048799+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:25:37.048799+0000","last_peered":"2024-09-10T15:25:37.048799+0000","last_clean":"2024-09-10T15:25:37.048799+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:25:37.048799+0000","last_undegraded":"2024-09-10T15:25:37.048799+0000","last_fullsized":"2024-09-10T15:25:37.048799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225217+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:25:37.225217+0000","last_peered":"2024-09-10T15:25:37.225217+0000","last_clean":"2024-09-10T15:25:37.225217+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:25:37.225217+0000","last_undegraded":"2024-09-10T15:25:37.225217+0000","last_fullsized":"2024-09-10T15:25:37.225217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224771+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:25:37.224771+0000","last_peered":"2024-09-10T15:25:37.224771+0000","last_clean":"2024-09-10T15:25:37.224771+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:25:37.224771+0000","last_undegraded":"2024-09-10T15:25:37.224771+0000","last_fullsized":"2024-09-10T15:25:37.224771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048061+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:25:37.048061+0000","last_peered":"2024-09-10T15:25:37.048061+0000","last_clean":"2024-09-10T15:25:37.048061+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:25:37.048061+0000","last_undegraded":"2024-09-10T15:25:37.048061+0000","last_fullsized":"2024-09-10T15:25:37.048061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049768+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:25:37.049768+0000","last_peered":"2024-09-10T15:25:37.049768+0000","last_clean":"2024-09-10T15:25:37.049768+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:25:37.049768+0000","last_undegraded":"2024-09-10T15:25:37.049768+0000","last_fullsized":"2024-09-10T15:25:37.049768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051115+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:25:38.051115+0000","last_peered":"2024-09-10T15:25:38.051115+0000","last_clean":"2024-09-10T15:25:38.051115+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:25:38.051115+0000","last_undegraded":"2024-09-10T15:25:38.051115+0000","last_fullsized":"2024-09-10T15:25:38.051115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830545+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:25:36.830545+0000","last_peered":"2024-09-10T15:25:36.830545+0000","last_clean":"2024-09-10T15:25:36.830545+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:25:36.830545+0000","last_undegraded":"2024-09-10T15:25:36.830545+0000","last_fullsized":"2024-09-10T15:25:36.830545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051178+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:25:38.051178+0000","last_peered":"2024-09-10T15:25:38.051178+0000","last_clean":"2024-09-10T15:25:38.051178+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:25:38.051178+0000","last_undegraded":"2024-09-10T15:25:38.051178+0000","last_fullsized":"2024-09-10T15:25:38.051178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050393+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:25:38.050393+0000","last_peered":"2024-09-10T15:25:38.050393+0000","last_clean":"2024-09-10T15:25:38.050393+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:25:38.050393+0000","last_undegraded":"2024-09-10T15:25:38.050393+0000","last_fullsized":"2024-09-10T15:25:38.050393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828060+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:25:36.828060+0000","last_peered":"2024-09-10T15:25:36.828060+0000","last_clean":"2024-09-10T15:25:36.828060+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:25:36.828060+0000","last_undegraded":"2024-09-10T15:25:36.828060+0000","last_fullsized":"2024-09-10T15:25:36.828060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225619+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:25:37.225619+0000","last_peered":"2024-09-10T15:25:37.225619+0000","last_clean":"2024-09-10T15:25:37.225619+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:25:37.225619+0000","last_undegraded":"2024-09-10T15:25:37.225619+0000","last_fullsized":"2024-09-10T15:25:37.225619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051200+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:25:38.051200+0000","last_peered":"2024-09-10T15:25:38.051200+0000","last_clean":"2024-09-10T15:25:38.051200+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:25:38.051200+0000","last_undegraded":"2024-09-10T15:25:38.051200+0000","last_fullsized":"2024-09-10T15:25:38.051200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830482+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:25:36.830482+0000","last_peered":"2024-09-10T15:25:36.830482+0000","last_clean":"2024-09-10T15:25:36.830482+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:25:36.830482+0000","last_undegraded":"2024-09-10T15:25:36.830482+0000","last_fullsized":"2024-09-10T15:25:36.830482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828130+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:25:36.828130+0000","last_peered":"2024-09-10T15:25:36.828130+0000","last_clean":"2024-09-10T15:25:36.828130+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:25:36.828130+0000","last_undegraded":"2024-09-10T15:25:36.828130+0000","last_fullsized":"2024-09-10T15:25:36.828130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049314+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:25:37.049314+0000","last_peered":"2024-09-10T15:25:37.049314+0000","last_clean":"2024-09-10T15:25:37.049314+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:25:37.049314+0000","last_undegraded":"2024-09-10T15:25:37.049314+0000","last_fullsized":"2024-09-10T15:25:37.049314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053856+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:25:38.053856+0000","last_peered":"2024-09-10T15:25:38.053856+0000","last_clean":"2024-09-10T15:25:38.053856+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:25:38.053856+0000","last_undegraded":"2024-09-10T15:25:38.053856+0000","last_fullsized":"2024-09-10T15:25:38.053856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048254+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:25:37.048254+0000","last_peered":"2024-09-10T15:25:37.048254+0000","last_clean":"2024-09-10T15:25:37.048254+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:25:37.048254+0000","last_undegraded":"2024-09-10T15:25:37.048254+0000","last_fullsized":"2024-09-10T15:25:37.048254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048350+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:25:37.048350+0000","last_peered":"2024-09-10T15:25:37.048350+0000","last_clean":"2024-09-10T15:25:37.048350+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:25:37.048350+0000","last_undegraded":"2024-09-10T15:25:37.048350+0000","last_fullsized":"2024-09-10T15:25:37.048350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833145+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:25:36.833145+0000","last_peered":"2024-09-10T15:25:36.833145+0000","last_clean":"2024-09-10T15:25:36.833145+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:25:36.833145+0000","last_undegraded":"2024-09-10T15:25:36.833145+0000","last_fullsized":"2024-09-10T15:25:36.833145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047462+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:25:37.047462+0000","last_peered":"2024-09-10T15:25:37.047462+0000","last_clean":"2024-09-10T15:25:37.047462+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:25:37.047462+0000","last_undegraded":"2024-09-10T15:25:37.047462+0000","last_fullsized":"2024-09-10T15:25:37.047462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828223+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:25:36.828223+0000","last_peered":"2024-09-10T15:25:36.828223+0000","last_clean":"2024-09-10T15:25:36.828223+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:25:36.828223+0000","last_undegraded":"2024-09-10T15:25:36.828223+0000","last_fullsized":"2024-09-10T15:25:36.828223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048945+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:25:37.048945+0000","last_peered":"2024-09-10T15:25:37.048945+0000","last_clean":"2024-09-10T15:25:37.048945+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:25:37.048945+0000","last_undegraded":"2024-09-10T15:25:37.048945+0000","last_fullsized":"2024-09-10T15:25:37.048945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048929+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:25:37.048929+0000","last_peered":"2024-09-10T15:25:37.048929+0000","last_clean":"2024-09-10T15:25:37.048929+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:25:37.048929+0000","last_undegraded":"2024-09-10T15:25:37.048929+0000","last_fullsized":"2024-09-10T15:25:37.048929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833433+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:25:36.833433+0000","last_peered":"2024-09-10T15:25:36.833433+0000","last_clean":"2024-09-10T15:25:36.833433+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:25:36.833433+0000","last_undegraded":"2024-09-10T15:25:36.833433+0000","last_fullsized":"2024-09-10T15:25:36.833433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226256+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:25:37.226256+0000","last_peered":"2024-09-10T15:25:37.226256+0000","last_clean":"2024-09-10T15:25:37.226256+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:25:37.226256+0000","last_undegraded":"2024-09-10T15:25:37.226256+0000","last_fullsized":"2024-09-10T15:25:37.226256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225926+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:25:37.225926+0000","last_peered":"2024-09-10T15:25:37.225926+0000","last_clean":"2024-09-10T15:25:37.225926+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:25:37.225926+0000","last_undegraded":"2024-09-10T15:25:37.225926+0000","last_fullsized":"2024-09-10T15:25:37.225926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828873+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:25:36.828873+0000","last_peered":"2024-09-10T15:25:36.828873+0000","last_clean":"2024-09-10T15:25:36.828873+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:25:36.828873+0000","last_undegraded":"2024-09-10T15:25:36.828873+0000","last_fullsized":"2024-09-10T15:25:36.828873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830272+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:25:36.830272+0000","last_peered":"2024-09-10T15:25:36.830272+0000","last_clean":"2024-09-10T15:25:36.830272+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:25:36.830272+0000","last_undegraded":"2024-09-10T15:25:36.830272+0000","last_fullsized":"2024-09-10T15:25:36.830272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052672+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:25:38.052672+0000","last_peered":"2024-09-10T15:25:38.052672+0000","last_clean":"2024-09-10T15:25:38.052672+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:25:38.052672+0000","last_undegraded":"2024-09-10T15:25:38.052672+0000","last_fullsized":"2024-09-10T15:25:38.052672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051618+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:25:38.051618+0000","last_peered":"2024-09-10T15:25:38.051618+0000","last_clean":"2024-09-10T15:25:38.051618+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:25:38.051618+0000","last_undegraded":"2024-09-10T15:25:38.051618+0000","last_fullsized":"2024-09-10T15:25:38.051618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829529+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:25:36.829529+0000","last_peered":"2024-09-10T15:25:36.829529+0000","last_clean":"2024-09-10T15:25:36.829529+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:25:36.829529+0000","last_undegraded":"2024-09-10T15:25:36.829529+0000","last_fullsized":"2024-09-10T15:25:36.829529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048636+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:25:37.048636+0000","last_peered":"2024-09-10T15:25:37.048636+0000","last_clean":"2024-09-10T15:25:37.048636+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:25:37.048636+0000","last_undegraded":"2024-09-10T15:25:37.048636+0000","last_fullsized":"2024-09-10T15:25:37.048636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830890+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:25:36.830890+0000","last_peered":"2024-09-10T15:25:36.830890+0000","last_clean":"2024-09-10T15:25:36.830890+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:25:36.830890+0000","last_undegraded":"2024-09-10T15:25:36.830890+0000","last_fullsized":"2024-09-10T15:25:36.830890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048418+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:25:37.048418+0000","last_peered":"2024-09-10T15:25:37.048418+0000","last_clean":"2024-09-10T15:25:37.048418+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:25:37.048418+0000","last_undegraded":"2024-09-10T15:25:37.048418+0000","last_fullsized":"2024-09-10T15:25:37.048418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049683+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:25:37.049683+0000","last_peered":"2024-09-10T15:25:37.049683+0000","last_clean":"2024-09-10T15:25:37.049683+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:25:37.049683+0000","last_undegraded":"2024-09-10T15:25:37.049683+0000","last_fullsized":"2024-09-10T15:25:37.049683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054429+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:25:38.054429+0000","last_peered":"2024-09-10T15:25:38.054429+0000","last_clean":"2024-09-10T15:25:38.054429+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:25:38.054429+0000","last_undegraded":"2024-09-10T15:25:38.054429+0000","last_fullsized":"2024-09-10T15:25:38.054429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829900+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:25:36.829900+0000","last_peered":"2024-09-10T15:25:36.829900+0000","last_clean":"2024-09-10T15:25:36.829900+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:25:36.829900+0000","last_undegraded":"2024-09-10T15:25:36.829900+0000","last_fullsized":"2024-09-10T15:25:36.829900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225922+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:25:37.225922+0000","last_peered":"2024-09-10T15:25:37.225922+0000","last_clean":"2024-09-10T15:25:37.225922+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:25:37.225922+0000","last_undegraded":"2024-09-10T15:25:37.225922+0000","last_fullsized":"2024-09-10T15:25:37.225922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049570+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:25:37.049570+0000","last_peered":"2024-09-10T15:25:37.049570+0000","last_clean":"2024-09-10T15:25:37.049570+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:25:37.049570+0000","last_undegraded":"2024-09-10T15:25:37.049570+0000","last_fullsized":"2024-09-10T15:25:37.049570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047163+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:25:37.047163+0000","last_peered":"2024-09-10T15:25:37.047163+0000","last_clean":"2024-09-10T15:25:37.047163+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:25:37.047163+0000","last_undegraded":"2024-09-10T15:25:37.047163+0000","last_fullsized":"2024-09-10T15:25:37.047163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052998+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:25:38.052998+0000","last_peered":"2024-09-10T15:25:38.052998+0000","last_clean":"2024-09-10T15:25:38.052998+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:25:38.052998+0000","last_undegraded":"2024-09-10T15:25:38.052998+0000","last_fullsized":"2024-09-10T15:25:38.052998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052041+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:25:38.052041+0000","last_peered":"2024-09-10T15:25:38.052041+0000","last_clean":"2024-09-10T15:25:38.052041+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:25:38.052041+0000","last_undegraded":"2024-09-10T15:25:38.052041+0000","last_fullsized":"2024-09-10T15:25:38.052041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051847+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:25:38.051847+0000","last_peered":"2024-09-10T15:25:38.051847+0000","last_clean":"2024-09-10T15:25:38.051847+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:25:38.051847+0000","last_undegraded":"2024-09-10T15:25:38.051847+0000","last_fullsized":"2024-09-10T15:25:38.051847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048764+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:25:37.048764+0000","last_peered":"2024-09-10T15:25:37.048764+0000","last_clean":"2024-09-10T15:25:37.048764+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:25:37.048764+0000","last_undegraded":"2024-09-10T15:25:37.048764+0000","last_fullsized":"2024-09-10T15:25:37.048764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830692+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:25:36.830692+0000","last_peered":"2024-09-10T15:25:36.830692+0000","last_clean":"2024-09-10T15:25:36.830692+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:25:36.830692+0000","last_undegraded":"2024-09-10T15:25:36.830692+0000","last_fullsized":"2024-09-10T15:25:36.830692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.046840+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:25:37.046840+0000","last_peered":"2024-09-10T15:25:37.046840+0000","last_clean":"2024-09-10T15:25:37.046840+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:25:37.046840+0000","last_undegraded":"2024-09-10T15:25:37.046840+0000","last_fullsized":"2024-09-10T15:25:37.046840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829186+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:25:36.829186+0000","last_peered":"2024-09-10T15:25:36.829186+0000","last_clean":"2024-09-10T15:25:36.829186+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:25:36.829186+0000","last_undegraded":"2024-09-10T15:25:36.829186+0000","last_fullsized":"2024-09-10T15:25:36.829186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055186+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:25:38.055186+0000","last_peered":"2024-09-10T15:25:38.055186+0000","last_clean":"2024-09-10T15:25:38.055186+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:25:38.055186+0000","last_undegraded":"2024-09-10T15:25:38.055186+0000","last_fullsized":"2024-09-10T15:25:38.055186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054061+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:25:38.054061+0000","last_peered":"2024-09-10T15:25:38.054061+0000","last_clean":"2024-09-10T15:25:38.054061+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:25:38.054061+0000","last_undegraded":"2024-09-10T15:25:38.054061+0000","last_fullsized":"2024-09-10T15:25:38.054061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828263+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:25:36.828263+0000","last_peered":"2024-09-10T15:25:36.828263+0000","last_clean":"2024-09-10T15:25:36.828263+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:25:36.828263+0000","last_undegraded":"2024-09-10T15:25:36.828263+0000","last_fullsized":"2024-09-10T15:25:36.828263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050520+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:25:38.050520+0000","last_peered":"2024-09-10T15:25:38.050520+0000","last_clean":"2024-09-10T15:25:38.050520+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:25:38.050520+0000","last_undegraded":"2024-09-10T15:25:38.050520+0000","last_fullsized":"2024-09-10T15:25:38.050520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054977+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:25:38.054977+0000","last_peered":"2024-09-10T15:25:38.054977+0000","last_clean":"2024-09-10T15:25:38.054977+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:25:38.054977+0000","last_undegraded":"2024-09-10T15:25:38.054977+0000","last_fullsized":"2024-09-10T15:25:38.054977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828398+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:25:36.828398+0000","last_peered":"2024-09-10T15:25:36.828398+0000","last_clean":"2024-09-10T15:25:36.828398+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:25:36.828398+0000","last_undegraded":"2024-09-10T15:25:36.828398+0000","last_fullsized":"2024-09-10T15:25:36.828398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049268+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:25:37.049268+0000","last_peered":"2024-09-10T15:25:37.049268+0000","last_clean":"2024-09-10T15:25:37.049268+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:25:37.049268+0000","last_undegraded":"2024-09-10T15:25:37.049268+0000","last_fullsized":"2024-09-10T15:25:37.049268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829020+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:25:36.829020+0000","last_peered":"2024-09-10T15:25:36.829020+0000","last_clean":"2024-09-10T15:25:36.829020+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:25:36.829020+0000","last_undegraded":"2024-09-10T15:25:36.829020+0000","last_fullsized":"2024-09-10T15:25:36.829020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050790+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:25:38.050790+0000","last_peered":"2024-09-10T15:25:38.050790+0000","last_clean":"2024-09-10T15:25:38.050790+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:25:38.050790+0000","last_undegraded":"2024-09-10T15:25:38.050790+0000","last_fullsized":"2024-09-10T15:25:38.050790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047573+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:25:37.047573+0000","last_peered":"2024-09-10T15:25:37.047573+0000","last_clean":"2024-09-10T15:25:37.047573+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:25:37.047573+0000","last_undegraded":"2024-09-10T15:25:37.047573+0000","last_fullsized":"2024-09-10T15:25:37.047573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830706+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:25:36.830706+0000","last_peered":"2024-09-10T15:25:36.830706+0000","last_clean":"2024-09-10T15:25:36.830706+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:25:36.830706+0000","last_undegraded":"2024-09-10T15:25:36.830706+0000","last_fullsized":"2024-09-10T15:25:36.830706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048428+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:25:37.048428+0000","last_peered":"2024-09-10T15:25:37.048428+0000","last_clean":"2024-09-10T15:25:37.048428+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:25:37.048428+0000","last_undegraded":"2024-09-10T15:25:37.048428+0000","last_fullsized":"2024-09-10T15:25:37.048428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833687+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:25:36.833687+0000","last_peered":"2024-09-10T15:25:36.833687+0000","last_clean":"2024-09-10T15:25:36.833687+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:25:36.833687+0000","last_undegraded":"2024-09-10T15:25:36.833687+0000","last_fullsized":"2024-09-10T15:25:36.833687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051559+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:25:38.051559+0000","last_peered":"2024-09-10T15:25:38.051559+0000","last_clean":"2024-09-10T15:25:38.051559+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:25:38.051559+0000","last_undegraded":"2024-09-10T15:25:38.051559+0000","last_fullsized":"2024-09-10T15:25:38.051559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225292+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:25:37.225292+0000","last_peered":"2024-09-10T15:25:37.225292+0000","last_clean":"2024-09-10T15:25:37.225292+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:25:37.225292+0000","last_undegraded":"2024-09-10T15:25:37.225292+0000","last_fullsized":"2024-09-10T15:25:37.225292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047156+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:25:37.047156+0000","last_peered":"2024-09-10T15:25:37.047156+0000","last_clean":"2024-09-10T15:25:37.047156+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:25:37.047156+0000","last_undegraded":"2024-09-10T15:25:37.047156+0000","last_fullsized":"2024-09-10T15:25:37.047156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048608+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:25:37.048608+0000","last_peered":"2024-09-10T15:25:37.048608+0000","last_clean":"2024-09-10T15:25:37.048608+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:25:37.048608+0000","last_undegraded":"2024-09-10T15:25:37.048608+0000","last_fullsized":"2024-09-10T15:25:37.048608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:25:36.828248+0000","last_peered":"2024-09-10T15:25:36.828248+0000","last_clean":"2024-09-10T15:25:36.828248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:25:36.828248+0000","last_undegraded":"2024-09-10T15:25:36.828248+0000","last_fullsized":"2024-09-10T15:25:36.828248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832917+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:25:36.832917+0000","last_peered":"2024-09-10T15:25:36.832917+0000","last_clean":"2024-09-10T15:25:36.832917+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:25:36.832917+0000","last_undegraded":"2024-09-10T15:25:36.832917+0000","last_fullsized":"2024-09-10T15:25:36.832917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":38,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050857+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:25:38.050857+0000","last_peered":"2024-09-10T15:25:38.050857+0000","last_clean":"2024-09-10T15:25:38.050857+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:25:38.050857+0000","last_undegraded":"2024-09-10T15:25:38.050857+0000","last_fullsized":"2024-09-10T15:25:38.050857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047280+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:25:37.047280+0000","last_peered":"2024-09-10T15:25:37.047280+0000","last_clean":"2024-09-10T15:25:37.047280+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:25:37.047280+0000","last_undegraded":"2024-09-10T15:25:37.047280+0000","last_fullsized":"2024-09-10T15:25:37.047280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051560+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:25:38.051560+0000","last_peered":"2024-09-10T15:25:38.051560+0000","last_clean":"2024-09-10T15:25:38.051560+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:25:38.051560+0000","last_undegraded":"2024-09-10T15:25:38.051560+0000","last_fullsized":"2024-09-10T15:25:38.051560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829325+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:25:36.829325+0000","last_peered":"2024-09-10T15:25:36.829325+0000","last_clean":"2024-09-10T15:25:36.829325+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:25:36.829325+0000","last_undegraded":"2024-09-10T15:25:36.829325+0000","last_fullsized":"2024-09-10T15:25:36.829325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053535+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:25:38.053535+0000","last_peered":"2024-09-10T15:25:38.053535+0000","last_clean":"2024-09-10T15:25:38.053535+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:25:38.053535+0000","last_undegraded":"2024-09-10T15:25:38.053535+0000","last_fullsized":"2024-09-10T15:25:38.053535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828494+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:25:36.828494+0000","last_peered":"2024-09-10T15:25:36.828494+0000","last_clean":"2024-09-10T15:25:36.828494+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:25:36.828494+0000","last_undegraded":"2024-09-10T15:25:36.828494+0000","last_fullsized":"2024-09-10T15:25:36.828494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050354+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:25:37.050354+0000","last_peered":"2024-09-10T15:25:37.050354+0000","last_clean":"2024-09-10T15:25:37.050354+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:25:37.050354+0000","last_undegraded":"2024-09-10T15:25:37.050354+0000","last_fullsized":"2024-09-10T15:25:37.050354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048327+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:25:37.048327+0000","last_peered":"2024-09-10T15:25:37.048327+0000","last_clean":"2024-09-10T15:25:37.048327+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:25:37.048327+0000","last_undegraded":"2024-09-10T15:25:37.048327+0000","last_fullsized":"2024-09-10T15:25:37.048327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049083+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:25:37.049083+0000","last_peered":"2024-09-10T15:25:37.049083+0000","last_clean":"2024-09-10T15:25:37.049083+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:25:37.049083+0000","last_undegraded":"2024-09-10T15:25:37.049083+0000","last_fullsized":"2024-09-10T15:25:37.049083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048314+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:25:37.048314+0000","last_peered":"2024-09-10T15:25:37.048314+0000","last_clean":"2024-09-10T15:25:37.048314+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:25:37.048314+0000","last_undegraded":"2024-09-10T15:25:37.048314+0000","last_fullsized":"2024-09-10T15:25:37.048314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832222+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:25:36.832222+0000","last_peered":"2024-09-10T15:25:36.832222+0000","last_clean":"2024-09-10T15:25:36.832222+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:25:36.832222+0000","last_undegraded":"2024-09-10T15:25:36.832222+0000","last_fullsized":"2024-09-10T15:25:36.832222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833279+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:25:36.833279+0000","last_peered":"2024-09-10T15:25:36.833279+0000","last_clean":"2024-09-10T15:25:36.833279+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:25:36.833279+0000","last_undegraded":"2024-09-10T15:25:36.833279+0000","last_fullsized":"2024-09-10T15:25:36.833279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831113+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:25:36.831113+0000","last_peered":"2024-09-10T15:25:36.831113+0000","last_clean":"2024-09-10T15:25:36.831113+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:25:36.831113+0000","last_undegraded":"2024-09-10T15:25:36.831113+0000","last_fullsized":"2024-09-10T15:25:36.831113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226497+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:25:37.226497+0000","last_peered":"2024-09-10T15:25:37.226497+0000","last_clean":"2024-09-10T15:25:37.226497+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:25:37.226497+0000","last_undegraded":"2024-09-10T15:25:37.226497+0000","last_fullsized":"2024-09-10T15:25:37.226497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828521+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:25:36.828521+0000","last_peered":"2024-09-10T15:25:36.828521+0000","last_clean":"2024-09-10T15:25:36.828521+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:25:36.828521+0000","last_undegraded":"2024-09-10T15:25:36.828521+0000","last_fullsized":"2024-09-10T15:25:36.828521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226978+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:25:37.226978+0000","last_peered":"2024-09-10T15:25:37.226978+0000","last_clean":"2024-09-10T15:25:37.226978+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:25:37.226978+0000","last_undegraded":"2024-09-10T15:25:37.226978+0000","last_fullsized":"2024-09-10T15:25:37.226978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225266+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:25:37.225266+0000","last_peered":"2024-09-10T15:25:37.225266+0000","last_clean":"2024-09-10T15:25:37.225266+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:25:37.225266+0000","last_undegraded":"2024-09-10T15:25:37.225266+0000","last_fullsized":"2024-09-10T15:25:37.225266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830405+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:25:36.830405+0000","last_peered":"2024-09-10T15:25:36.830405+0000","last_clean":"2024-09-10T15:25:36.830405+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:25:36.830405+0000","last_undegraded":"2024-09-10T15:25:36.830405+0000","last_fullsized":"2024-09-10T15:25:36.830405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051885+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:25:38.051885+0000","last_peered":"2024-09-10T15:25:38.051885+0000","last_clean":"2024-09-10T15:25:38.051885+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:25:38.051885+0000","last_undegraded":"2024-09-10T15:25:38.051885+0000","last_fullsized":"2024-09-10T15:25:38.051885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832735+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:25:36.832735+0000","last_peered":"2024-09-10T15:25:36.832735+0000","last_clean":"2024-09-10T15:25:36.832735+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:25:36.832735+0000","last_undegraded":"2024-09-10T15:25:36.832735+0000","last_fullsized":"2024-09-10T15:25:36.832735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050125+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:25:37.050125+0000","last_peered":"2024-09-10T15:25:37.050125+0000","last_clean":"2024-09-10T15:25:37.050125+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:25:37.050125+0000","last_undegraded":"2024-09-10T15:25:37.050125+0000","last_fullsized":"2024-09-10T15:25:37.050125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047414+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:25:37.047414+0000","last_peered":"2024-09-10T15:25:37.047414+0000","last_clean":"2024-09-10T15:25:37.047414+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:25:37.047414+0000","last_undegraded":"2024-09-10T15:25:37.047414+0000","last_fullsized":"2024-09-10T15:25:37.047414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829777+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:25:36.829777+0000","last_peered":"2024-09-10T15:25:36.829777+0000","last_clean":"2024-09-10T15:25:36.829777+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:25:36.829777+0000","last_undegraded":"2024-09-10T15:25:36.829777+0000","last_fullsized":"2024-09-10T15:25:36.829777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831183+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:25:36.831183+0000","last_peered":"2024-09-10T15:25:36.831183+0000","last_clean":"2024-09-10T15:25:36.831183+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:25:36.831183+0000","last_undegraded":"2024-09-10T15:25:36.831183+0000","last_fullsized":"2024-09-10T15:25:36.831183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832163+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:25:36.832163+0000","last_peered":"2024-09-10T15:25:36.832163+0000","last_clean":"2024-09-10T15:25:36.832163+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:25:36.832163+0000","last_undegraded":"2024-09-10T15:25:36.832163+0000","last_fullsized":"2024-09-10T15:25:36.832163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054267+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:25:38.054267+0000","last_peered":"2024-09-10T15:25:38.054267+0000","last_clean":"2024-09-10T15:25:38.054267+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:25:38.054267+0000","last_undegraded":"2024-09-10T15:25:38.054267+0000","last_fullsized":"2024-09-10T15:25:38.054267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054797+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:38.054797+0000","last_peered":"2024-09-10T15:25:38.054797+0000","last_clean":"2024-09-10T15:25:38.054797+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:25:38.054797+0000","last_undegraded":"2024-09-10T15:25:38.054797+0000","last_fullsized":"2024-09-10T15:25:38.054797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051796+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:25:38.051796+0000","last_peered":"2024-09-10T15:25:38.051796+0000","last_clean":"2024-09-10T15:25:38.051796+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:25:38.051796+0000","last_undegraded":"2024-09-10T15:25:38.051796+0000","last_fullsized":"2024-09-10T15:25:38.051796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054517+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:25:38.054517+0000","last_peered":"2024-09-10T15:25:38.054517+0000","last_clean":"2024-09-10T15:25:38.054517+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:25:38.054517+0000","last_undegraded":"2024-09-10T15:25:38.054517+0000","last_fullsized":"2024-09-10T15:25:38.054517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829215+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:25:36.829215+0000","last_peered":"2024-09-10T15:25:36.829215+0000","last_clean":"2024-09-10T15:25:36.829215+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:25:36.829215+0000","last_undegraded":"2024-09-10T15:25:36.829215+0000","last_fullsized":"2024-09-10T15:25:36.829215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048749+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:25:37.048749+0000","last_peered":"2024-09-10T15:25:37.048749+0000","last_clean":"2024-09-10T15:25:37.048749+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:25:37.048749+0000","last_undegraded":"2024-09-10T15:25:37.048749+0000","last_fullsized":"2024-09-10T15:25:37.048749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049328+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:25:37.049328+0000","last_peered":"2024-09-10T15:25:37.049328+0000","last_clean":"2024-09-10T15:25:37.049328+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:25:37.049328+0000","last_undegraded":"2024-09-10T15:25:37.049328+0000","last_fullsized":"2024-09-10T15:25:37.049328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051384+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:25:38.051384+0000","last_peered":"2024-09-10T15:25:38.051384+0000","last_clean":"2024-09-10T15:25:38.051384+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:25:38.051384+0000","last_undegraded":"2024-09-10T15:25:38.051384+0000","last_fullsized":"2024-09-10T15:25:38.051384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050522+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:25:37.050522+0000","last_peered":"2024-09-10T15:25:37.050522+0000","last_clean":"2024-09-10T15:25:37.050522+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:25:37.050522+0000","last_undegraded":"2024-09-10T15:25:37.050522+0000","last_fullsized":"2024-09-10T15:25:37.050522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051854+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:25:38.051854+0000","last_peered":"2024-09-10T15:25:38.051854+0000","last_clean":"2024-09-10T15:25:38.051854+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:25:38.051854+0000","last_undegraded":"2024-09-10T15:25:38.051854+0000","last_fullsized":"2024-09-10T15:25:38.051854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049137+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:25:37.049137+0000","last_peered":"2024-09-10T15:25:37.049137+0000","last_clean":"2024-09-10T15:25:37.049137+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:25:37.049137+0000","last_undegraded":"2024-09-10T15:25:37.049137+0000","last_fullsized":"2024-09-10T15:25:37.049137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047329+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:25:37.047329+0000","last_peered":"2024-09-10T15:25:37.047329+0000","last_clean":"2024-09-10T15:25:37.047329+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:25:37.047329+0000","last_undegraded":"2024-09-10T15:25:37.047329+0000","last_fullsized":"2024-09-10T15:25:37.047329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053463+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:25:38.053463+0000","last_peered":"2024-09-10T15:25:38.053463+0000","last_clean":"2024-09-10T15:25:38.053463+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:25:38.053463+0000","last_undegraded":"2024-09-10T15:25:38.053463+0000","last_fullsized":"2024-09-10T15:25:38.053463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830894+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:25:36.830894+0000","last_peered":"2024-09-10T15:25:36.830894+0000","last_clean":"2024-09-10T15:25:36.830894+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:25:36.830894+0000","last_undegraded":"2024-09-10T15:25:36.830894+0000","last_fullsized":"2024-09-10T15:25:36.830894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055250+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:25:38.055250+0000","last_peered":"2024-09-10T15:25:38.055250+0000","last_clean":"2024-09-10T15:25:38.055250+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:25:38.055250+0000","last_undegraded":"2024-09-10T15:25:38.055250+0000","last_fullsized":"2024-09-10T15:25:38.055250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":499712,"data_stored":220435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":503808,"data_stored":221483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1081344,"data_stored":803307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":221620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":495616,"data_stored":220316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":212279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1134592,"data_stored":819521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":213887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:39.517 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:39.566 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:39.565+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:39.593 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:39.593 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:39.593 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:39.593 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:39.607 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:39.667 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:39.665+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:39.723 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:39.723 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:39.738 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:39.768 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:39.769+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.991983884, 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.858 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:25:39.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:25:39.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:25:39.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.958348593, 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:25:39.866 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:25:39.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:25:39.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.852694628999998, 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:25:39.872 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:25:39.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:25:39.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:25:39.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.976954273, 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:25:39.878 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.884 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.961087266, 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:25:39.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.941607585, 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:25:39.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.896 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.928801321999998, 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:25:39.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:39.902 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.906897134000001, 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:39.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:25:39.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:25:39.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:39.908 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.888330857, 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:25:39.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:25:39.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:39.914 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.834814690999998, 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:39.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:25:39.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:25:39.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.920 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.829610657, 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:25:39.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.817065540000002, 2024-09-10T15:25:39.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:25:39.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:25:39.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:25:39.932 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.816365303000001, 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.933 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:25:39.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.939 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.809157273, 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:25:39.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:25:39.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:25:39.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.637342497999999, 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:25:39.946 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:25:39.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:25:39.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:25:39.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:25:39.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.521072598, 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.952 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:25:39.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.958 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.484032967000001, 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:25:39.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:25:39.964 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.476838149999999, 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.965 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:25:39.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:25:39.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:25:39.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.971 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.971 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:39.971 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.472388574, 2024-09-10T15:25:39.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:25:39.971 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.971 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:25:39.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:39.978 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.273123691999999, 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:39.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:39.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:25:39.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:39.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:39.984 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:39.986 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:39.991 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:39.997 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:39.985+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:39.997 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:39.998 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-10T15:25:39.062234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225516,"kb_used_data":5080,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749204,"statfs":{"total":773094113280,"available":772863184896,"internally_reserved":0,"allocated":5201920,"data_stored":2932848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038392"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830838+0000","last_change":"2024-09-10T15:25:11.842625+0000","last_active":"2024-09-10T15:25:36.830838+0000","last_peered":"2024-09-10T15:25:36.830838+0000","last_clean":"2024-09-10T15:25:36.830838+0000","last_became_active":"2024-09-10T15:25:11.842298+0000","last_became_peered":"2024-09-10T15:25:11.842298+0000","last_unstale":"2024-09-10T15:25:36.830838+0000","last_undegraded":"2024-09-10T15:25:36.830838+0000","last_fullsized":"2024-09-10T15:25:36.830838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051661+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:25:38.051661+0000","last_peered":"2024-09-10T15:25:38.051661+0000","last_clean":"2024-09-10T15:25:38.051661+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:25:38.051661+0000","last_undegraded":"2024-09-10T15:25:38.051661+0000","last_fullsized":"2024-09-10T15:25:38.051661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833453+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:25:36.833453+0000","last_peered":"2024-09-10T15:25:36.833453+0000","last_clean":"2024-09-10T15:25:36.833453+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:25:36.833453+0000","last_undegraded":"2024-09-10T15:25:36.833453+0000","last_fullsized":"2024-09-10T15:25:36.833453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047754+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:25:37.047754+0000","last_peered":"2024-09-10T15:25:37.047754+0000","last_clean":"2024-09-10T15:25:37.047754+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:25:37.047754+0000","last_undegraded":"2024-09-10T15:25:37.047754+0000","last_fullsized":"2024-09-10T15:25:37.047754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832429+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:25:36.832429+0000","last_peered":"2024-09-10T15:25:36.832429+0000","last_clean":"2024-09-10T15:25:36.832429+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:25:36.832429+0000","last_undegraded":"2024-09-10T15:25:36.832429+0000","last_fullsized":"2024-09-10T15:25:36.832429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048164+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:25:37.048164+0000","last_peered":"2024-09-10T15:25:37.048164+0000","last_clean":"2024-09-10T15:25:37.048164+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:25:37.048164+0000","last_undegraded":"2024-09-10T15:25:37.048164+0000","last_fullsized":"2024-09-10T15:25:37.048164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830207+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:25:36.830207+0000","last_peered":"2024-09-10T15:25:36.830207+0000","last_clean":"2024-09-10T15:25:36.830207+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:25:36.830207+0000","last_undegraded":"2024-09-10T15:25:36.830207+0000","last_fullsized":"2024-09-10T15:25:36.830207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051926+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:25:38.051926+0000","last_peered":"2024-09-10T15:25:38.051926+0000","last_clean":"2024-09-10T15:25:38.051926+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:25:38.051926+0000","last_undegraded":"2024-09-10T15:25:38.051926+0000","last_fullsized":"2024-09-10T15:25:38.051926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830075+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:25:36.830075+0000","last_peered":"2024-09-10T15:25:36.830075+0000","last_clean":"2024-09-10T15:25:36.830075+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:25:36.830075+0000","last_undegraded":"2024-09-10T15:25:36.830075+0000","last_fullsized":"2024-09-10T15:25:36.830075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828767+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:25:36.828767+0000","last_peered":"2024-09-10T15:25:36.828767+0000","last_clean":"2024-09-10T15:25:36.828767+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:25:36.828767+0000","last_undegraded":"2024-09-10T15:25:36.828767+0000","last_fullsized":"2024-09-10T15:25:36.828767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828946+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:25:36.828946+0000","last_peered":"2024-09-10T15:25:36.828946+0000","last_clean":"2024-09-10T15:25:36.828946+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:25:36.828946+0000","last_undegraded":"2024-09-10T15:25:36.828946+0000","last_fullsized":"2024-09-10T15:25:36.828946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830278+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:25:36.830278+0000","last_peered":"2024-09-10T15:25:36.830278+0000","last_clean":"2024-09-10T15:25:36.830278+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:25:36.830278+0000","last_undegraded":"2024-09-10T15:25:36.830278+0000","last_fullsized":"2024-09-10T15:25:36.830278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831240+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:25:36.831240+0000","last_peered":"2024-09-10T15:25:36.831240+0000","last_clean":"2024-09-10T15:25:36.831240+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:25:36.831240+0000","last_undegraded":"2024-09-10T15:25:36.831240+0000","last_fullsized":"2024-09-10T15:25:36.831240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830212+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:25:36.830212+0000","last_peered":"2024-09-10T15:25:36.830212+0000","last_clean":"2024-09-10T15:25:36.830212+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:25:36.830212+0000","last_undegraded":"2024-09-10T15:25:36.830212+0000","last_fullsized":"2024-09-10T15:25:36.830212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830404+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:25:36.830404+0000","last_peered":"2024-09-10T15:25:36.830404+0000","last_clean":"2024-09-10T15:25:36.830404+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:25:36.830404+0000","last_undegraded":"2024-09-10T15:25:36.830404+0000","last_fullsized":"2024-09-10T15:25:36.830404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833031+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:25:36.833031+0000","last_peered":"2024-09-10T15:25:36.833031+0000","last_clean":"2024-09-10T15:25:36.833031+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:25:36.833031+0000","last_undegraded":"2024-09-10T15:25:36.833031+0000","last_fullsized":"2024-09-10T15:25:36.833031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047192+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:25:37.047192+0000","last_peered":"2024-09-10T15:25:37.047192+0000","last_clean":"2024-09-10T15:25:37.047192+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:25:37.047192+0000","last_undegraded":"2024-09-10T15:25:37.047192+0000","last_fullsized":"2024-09-10T15:25:37.047192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055570+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:25:38.055570+0000","last_peered":"2024-09-10T15:25:38.055570+0000","last_clean":"2024-09-10T15:25:38.055570+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:25:38.055570+0000","last_undegraded":"2024-09-10T15:25:38.055570+0000","last_fullsized":"2024-09-10T15:25:38.055570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830824+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:25:36.830824+0000","last_peered":"2024-09-10T15:25:36.830824+0000","last_clean":"2024-09-10T15:25:36.830824+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:25:36.830824+0000","last_undegraded":"2024-09-10T15:25:36.830824+0000","last_fullsized":"2024-09-10T15:25:36.830824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830051+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:25:36.830051+0000","last_peered":"2024-09-10T15:25:36.830051+0000","last_clean":"2024-09-10T15:25:36.830051+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:25:36.830051+0000","last_undegraded":"2024-09-10T15:25:36.830051+0000","last_fullsized":"2024-09-10T15:25:36.830051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054234+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:25:38.054234+0000","last_peered":"2024-09-10T15:25:38.054234+0000","last_clean":"2024-09-10T15:25:38.054234+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:25:38.054234+0000","last_undegraded":"2024-09-10T15:25:38.054234+0000","last_fullsized":"2024-09-10T15:25:38.054234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830460+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:25:36.830460+0000","last_peered":"2024-09-10T15:25:36.830460+0000","last_clean":"2024-09-10T15:25:36.830460+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:25:36.830460+0000","last_undegraded":"2024-09-10T15:25:36.830460+0000","last_fullsized":"2024-09-10T15:25:36.830460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225345+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:25:37.225345+0000","last_peered":"2024-09-10T15:25:37.225345+0000","last_clean":"2024-09-10T15:25:37.225345+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:25:37.225345+0000","last_undegraded":"2024-09-10T15:25:37.225345+0000","last_fullsized":"2024-09-10T15:25:37.225345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828998+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:25:36.828998+0000","last_peered":"2024-09-10T15:25:36.828998+0000","last_clean":"2024-09-10T15:25:36.828998+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:25:36.828998+0000","last_undegraded":"2024-09-10T15:25:36.828998+0000","last_fullsized":"2024-09-10T15:25:36.828998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831513+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:25:36.831513+0000","last_peered":"2024-09-10T15:25:36.831513+0000","last_clean":"2024-09-10T15:25:36.831513+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:25:36.831513+0000","last_undegraded":"2024-09-10T15:25:36.831513+0000","last_fullsized":"2024-09-10T15:25:36.831513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226198+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:25:37.226198+0000","last_peered":"2024-09-10T15:25:37.226198+0000","last_clean":"2024-09-10T15:25:37.226198+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:25:37.226198+0000","last_undegraded":"2024-09-10T15:25:37.226198+0000","last_fullsized":"2024-09-10T15:25:37.226198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055575+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:25:38.055575+0000","last_peered":"2024-09-10T15:25:38.055575+0000","last_clean":"2024-09-10T15:25:38.055575+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:25:38.055575+0000","last_undegraded":"2024-09-10T15:25:38.055575+0000","last_fullsized":"2024-09-10T15:25:38.055575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225301+0000","last_change":"2024-09-10T15:25:11.843256+0000","last_active":"2024-09-10T15:25:37.225301+0000","last_peered":"2024-09-10T15:25:37.225301+0000","last_clean":"2024-09-10T15:25:37.225301+0000","last_became_active":"2024-09-10T15:25:11.842370+0000","last_became_peered":"2024-09-10T15:25:11.842370+0000","last_unstale":"2024-09-10T15:25:37.225301+0000","last_undegraded":"2024-09-10T15:25:37.225301+0000","last_fullsized":"2024-09-10T15:25:37.225301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.827698+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:25:36.827698+0000","last_peered":"2024-09-10T15:25:36.827698+0000","last_clean":"2024-09-10T15:25:36.827698+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:25:36.827698+0000","last_undegraded":"2024-09-10T15:25:36.827698+0000","last_fullsized":"2024-09-10T15:25:36.827698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226099+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:25:37.226099+0000","last_peered":"2024-09-10T15:25:37.226099+0000","last_clean":"2024-09-10T15:25:37.226099+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:25:37.226099+0000","last_undegraded":"2024-09-10T15:25:37.226099+0000","last_fullsized":"2024-09-10T15:25:37.226099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048405+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:25:37.048405+0000","last_peered":"2024-09-10T15:25:37.048405+0000","last_clean":"2024-09-10T15:25:37.048405+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:25:37.048405+0000","last_undegraded":"2024-09-10T15:25:37.048405+0000","last_fullsized":"2024-09-10T15:25:37.048405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049560+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:25:37.049560+0000","last_peered":"2024-09-10T15:25:37.049560+0000","last_clean":"2024-09-10T15:25:37.049560+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:25:37.049560+0000","last_undegraded":"2024-09-10T15:25:37.049560+0000","last_fullsized":"2024-09-10T15:25:37.049560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051916+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:25:38.051916+0000","last_peered":"2024-09-10T15:25:38.051916+0000","last_clean":"2024-09-10T15:25:38.051916+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:25:38.051916+0000","last_undegraded":"2024-09-10T15:25:38.051916+0000","last_fullsized":"2024-09-10T15:25:38.051916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055087+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:25:38.055087+0000","last_peered":"2024-09-10T15:25:38.055087+0000","last_clean":"2024-09-10T15:25:38.055087+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:25:38.055087+0000","last_undegraded":"2024-09-10T15:25:38.055087+0000","last_fullsized":"2024-09-10T15:25:38.055087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051975+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:25:38.051975+0000","last_peered":"2024-09-10T15:25:38.051975+0000","last_clean":"2024-09-10T15:25:38.051975+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:25:38.051975+0000","last_undegraded":"2024-09-10T15:25:38.051975+0000","last_fullsized":"2024-09-10T15:25:38.051975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049374+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:25:37.049374+0000","last_peered":"2024-09-10T15:25:37.049374+0000","last_clean":"2024-09-10T15:25:37.049374+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:25:37.049374+0000","last_undegraded":"2024-09-10T15:25:37.049374+0000","last_fullsized":"2024-09-10T15:25:37.049374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225623+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:25:37.225623+0000","last_peered":"2024-09-10T15:25:37.225623+0000","last_clean":"2024-09-10T15:25:37.225623+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:25:37.225623+0000","last_undegraded":"2024-09-10T15:25:37.225623+0000","last_fullsized":"2024-09-10T15:25:37.225623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052090+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:25:38.052090+0000","last_peered":"2024-09-10T15:25:38.052090+0000","last_clean":"2024-09-10T15:25:38.052090+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:25:38.052090+0000","last_undegraded":"2024-09-10T15:25:38.052090+0000","last_fullsized":"2024-09-10T15:25:38.052090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055130+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:25:38.055130+0000","last_peered":"2024-09-10T15:25:38.055130+0000","last_clean":"2024-09-10T15:25:38.055130+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:25:38.055130+0000","last_undegraded":"2024-09-10T15:25:38.055130+0000","last_fullsized":"2024-09-10T15:25:38.055130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054806+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:25:38.054806+0000","last_peered":"2024-09-10T15:25:38.054806+0000","last_clean":"2024-09-10T15:25:38.054806+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:25:38.054806+0000","last_undegraded":"2024-09-10T15:25:38.054806+0000","last_fullsized":"2024-09-10T15:25:38.054806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224744+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:25:37.224744+0000","last_peered":"2024-09-10T15:25:37.224744+0000","last_clean":"2024-09-10T15:25:37.224744+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:25:37.224744+0000","last_undegraded":"2024-09-10T15:25:37.224744+0000","last_fullsized":"2024-09-10T15:25:37.224744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831945+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:25:36.831945+0000","last_peered":"2024-09-10T15:25:36.831945+0000","last_clean":"2024-09-10T15:25:36.831945+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:25:36.831945+0000","last_undegraded":"2024-09-10T15:25:36.831945+0000","last_fullsized":"2024-09-10T15:25:36.831945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047894+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:25:37.047894+0000","last_peered":"2024-09-10T15:25:37.047894+0000","last_clean":"2024-09-10T15:25:37.047894+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:25:37.047894+0000","last_undegraded":"2024-09-10T15:25:37.047894+0000","last_fullsized":"2024-09-10T15:25:37.047894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053275+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:25:38.053275+0000","last_peered":"2024-09-10T15:25:38.053275+0000","last_clean":"2024-09-10T15:25:38.053275+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:25:38.053275+0000","last_undegraded":"2024-09-10T15:25:38.053275+0000","last_fullsized":"2024-09-10T15:25:38.053275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051676+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:25:38.051676+0000","last_peered":"2024-09-10T15:25:38.051676+0000","last_clean":"2024-09-10T15:25:38.051676+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:25:38.051676+0000","last_undegraded":"2024-09-10T15:25:38.051676+0000","last_fullsized":"2024-09-10T15:25:38.051676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049605+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:25:37.049605+0000","last_peered":"2024-09-10T15:25:37.049605+0000","last_clean":"2024-09-10T15:25:37.049605+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:25:37.049605+0000","last_undegraded":"2024-09-10T15:25:37.049605+0000","last_fullsized":"2024-09-10T15:25:37.049605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828628+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:25:36.828628+0000","last_peered":"2024-09-10T15:25:36.828628+0000","last_clean":"2024-09-10T15:25:36.828628+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:25:36.828628+0000","last_undegraded":"2024-09-10T15:25:36.828628+0000","last_fullsized":"2024-09-10T15:25:36.828628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832622+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:25:36.832622+0000","last_peered":"2024-09-10T15:25:36.832622+0000","last_clean":"2024-09-10T15:25:36.832622+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:25:36.832622+0000","last_undegraded":"2024-09-10T15:25:36.832622+0000","last_fullsized":"2024-09-10T15:25:36.832622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051970+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:25:38.051970+0000","last_peered":"2024-09-10T15:25:38.051970+0000","last_clean":"2024-09-10T15:25:38.051970+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:25:38.051970+0000","last_undegraded":"2024-09-10T15:25:38.051970+0000","last_fullsized":"2024-09-10T15:25:38.051970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048684+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:25:37.048684+0000","last_peered":"2024-09-10T15:25:37.048684+0000","last_clean":"2024-09-10T15:25:37.048684+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:25:37.048684+0000","last_undegraded":"2024-09-10T15:25:37.048684+0000","last_fullsized":"2024-09-10T15:25:37.048684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829673+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:25:36.829673+0000","last_peered":"2024-09-10T15:25:36.829673+0000","last_clean":"2024-09-10T15:25:36.829673+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:25:36.829673+0000","last_undegraded":"2024-09-10T15:25:36.829673+0000","last_fullsized":"2024-09-10T15:25:36.829673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832170+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:25:36.832170+0000","last_peered":"2024-09-10T15:25:36.832170+0000","last_clean":"2024-09-10T15:25:36.832170+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:25:36.832170+0000","last_undegraded":"2024-09-10T15:25:36.832170+0000","last_fullsized":"2024-09-10T15:25:36.832170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047282+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:25:37.047282+0000","last_peered":"2024-09-10T15:25:37.047282+0000","last_clean":"2024-09-10T15:25:37.047282+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:25:37.047282+0000","last_undegraded":"2024-09-10T15:25:37.047282+0000","last_fullsized":"2024-09-10T15:25:37.047282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830961+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:25:36.830961+0000","last_peered":"2024-09-10T15:25:36.830961+0000","last_clean":"2024-09-10T15:25:36.830961+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:25:36.830961+0000","last_undegraded":"2024-09-10T15:25:36.830961+0000","last_fullsized":"2024-09-10T15:25:36.830961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052911+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:25:38.052911+0000","last_peered":"2024-09-10T15:25:38.052911+0000","last_clean":"2024-09-10T15:25:38.052911+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:25:38.052911+0000","last_undegraded":"2024-09-10T15:25:38.052911+0000","last_fullsized":"2024-09-10T15:25:38.052911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828471+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:25:36.828471+0000","last_peered":"2024-09-10T15:25:36.828471+0000","last_clean":"2024-09-10T15:25:36.828471+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:25:36.828471+0000","last_undegraded":"2024-09-10T15:25:36.828471+0000","last_fullsized":"2024-09-10T15:25:36.828471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225038+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:25:37.225038+0000","last_peered":"2024-09-10T15:25:37.225038+0000","last_clean":"2024-09-10T15:25:37.225038+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:25:37.225038+0000","last_undegraded":"2024-09-10T15:25:37.225038+0000","last_fullsized":"2024-09-10T15:25:37.225038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829775+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:25:36.829775+0000","last_peered":"2024-09-10T15:25:36.829775+0000","last_clean":"2024-09-10T15:25:36.829775+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:25:36.829775+0000","last_undegraded":"2024-09-10T15:25:36.829775+0000","last_fullsized":"2024-09-10T15:25:36.829775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053253+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:25:38.053253+0000","last_peered":"2024-09-10T15:25:38.053253+0000","last_clean":"2024-09-10T15:25:38.053253+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:25:38.053253+0000","last_undegraded":"2024-09-10T15:25:38.053253+0000","last_fullsized":"2024-09-10T15:25:38.053253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830561+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:25:36.830561+0000","last_peered":"2024-09-10T15:25:36.830561+0000","last_clean":"2024-09-10T15:25:36.830561+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:25:36.830561+0000","last_undegraded":"2024-09-10T15:25:36.830561+0000","last_fullsized":"2024-09-10T15:25:36.830561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224446+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:25:37.224446+0000","last_peered":"2024-09-10T15:25:37.224446+0000","last_clean":"2024-09-10T15:25:37.224446+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:25:37.224446+0000","last_undegraded":"2024-09-10T15:25:37.224446+0000","last_fullsized":"2024-09-10T15:25:37.224446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051073+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:25:38.051073+0000","last_peered":"2024-09-10T15:25:38.051073+0000","last_clean":"2024-09-10T15:25:38.051073+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:25:38.051073+0000","last_undegraded":"2024-09-10T15:25:38.051073+0000","last_fullsized":"2024-09-10T15:25:38.051073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050762+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:25:38.050762+0000","last_peered":"2024-09-10T15:25:38.050762+0000","last_clean":"2024-09-10T15:25:38.050762+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:25:38.050762+0000","last_undegraded":"2024-09-10T15:25:38.050762+0000","last_fullsized":"2024-09-10T15:25:38.050762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054796+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:25:38.054796+0000","last_peered":"2024-09-10T15:25:38.054796+0000","last_clean":"2024-09-10T15:25:38.054796+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:25:38.054796+0000","last_undegraded":"2024-09-10T15:25:38.054796+0000","last_fullsized":"2024-09-10T15:25:38.054796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828479+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:25:36.828479+0000","last_peered":"2024-09-10T15:25:36.828479+0000","last_clean":"2024-09-10T15:25:36.828479+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:25:36.828479+0000","last_undegraded":"2024-09-10T15:25:36.828479+0000","last_fullsized":"2024-09-10T15:25:36.828479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049164+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:25:37.049164+0000","last_peered":"2024-09-10T15:25:37.049164+0000","last_clean":"2024-09-10T15:25:37.049164+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:25:37.049164+0000","last_undegraded":"2024-09-10T15:25:37.049164+0000","last_fullsized":"2024-09-10T15:25:37.049164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830512+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:25:36.830512+0000","last_peered":"2024-09-10T15:25:36.830512+0000","last_clean":"2024-09-10T15:25:36.830512+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:25:36.830512+0000","last_undegraded":"2024-09-10T15:25:36.830512+0000","last_fullsized":"2024-09-10T15:25:36.830512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047046+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:25:37.047046+0000","last_peered":"2024-09-10T15:25:37.047046+0000","last_clean":"2024-09-10T15:25:37.047046+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:25:37.047046+0000","last_undegraded":"2024-09-10T15:25:37.047046+0000","last_fullsized":"2024-09-10T15:25:37.047046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830360+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:25:36.830360+0000","last_peered":"2024-09-10T15:25:36.830360+0000","last_clean":"2024-09-10T15:25:36.830360+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:25:36.830360+0000","last_undegraded":"2024-09-10T15:25:36.830360+0000","last_fullsized":"2024-09-10T15:25:36.830360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225994+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:25:37.225994+0000","last_peered":"2024-09-10T15:25:37.225994+0000","last_clean":"2024-09-10T15:25:37.225994+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:25:37.225994+0000","last_undegraded":"2024-09-10T15:25:37.225994+0000","last_fullsized":"2024-09-10T15:25:37.225994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832750+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:25:36.832750+0000","last_peered":"2024-09-10T15:25:36.832750+0000","last_clean":"2024-09-10T15:25:36.832750+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:25:36.832750+0000","last_undegraded":"2024-09-10T15:25:36.832750+0000","last_fullsized":"2024-09-10T15:25:36.832750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829460+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:25:36.829460+0000","last_peered":"2024-09-10T15:25:36.829460+0000","last_clean":"2024-09-10T15:25:36.829460+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:25:36.829460+0000","last_undegraded":"2024-09-10T15:25:36.829460+0000","last_fullsized":"2024-09-10T15:25:36.829460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224939+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:25:37.224939+0000","last_peered":"2024-09-10T15:25:37.224939+0000","last_clean":"2024-09-10T15:25:37.224939+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:25:37.224939+0000","last_undegraded":"2024-09-10T15:25:37.224939+0000","last_fullsized":"2024-09-10T15:25:37.224939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":56,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050569+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:25:38.050569+0000","last_peered":"2024-09-10T15:25:38.050569+0000","last_clean":"2024-09-10T15:25:38.050569+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:25:38.050569+0000","last_undegraded":"2024-09-10T15:25:38.050569+0000","last_fullsized":"2024-09-10T15:25:38.050569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831104+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:25:36.831104+0000","last_peered":"2024-09-10T15:25:36.831104+0000","last_clean":"2024-09-10T15:25:36.831104+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:25:36.831104+0000","last_undegraded":"2024-09-10T15:25:36.831104+0000","last_fullsized":"2024-09-10T15:25:36.831104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049953+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:25:37.049953+0000","last_peered":"2024-09-10T15:25:37.049953+0000","last_clean":"2024-09-10T15:25:37.049953+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:25:37.049953+0000","last_undegraded":"2024-09-10T15:25:37.049953+0000","last_fullsized":"2024-09-10T15:25:37.049953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829106+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:36.829106+0000","last_peered":"2024-09-10T15:25:36.829106+0000","last_clean":"2024-09-10T15:25:36.829106+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:25:36.829106+0000","last_undegraded":"2024-09-10T15:25:36.829106+0000","last_fullsized":"2024-09-10T15:25:36.829106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049586+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:25:37.049586+0000","last_peered":"2024-09-10T15:25:37.049586+0000","last_clean":"2024-09-10T15:25:37.049586+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:25:37.049586+0000","last_undegraded":"2024-09-10T15:25:37.049586+0000","last_fullsized":"2024-09-10T15:25:37.049586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049437+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:25:37.049437+0000","last_peered":"2024-09-10T15:25:37.049437+0000","last_clean":"2024-09-10T15:25:37.049437+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:25:37.049437+0000","last_undegraded":"2024-09-10T15:25:37.049437+0000","last_fullsized":"2024-09-10T15:25:37.049437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054970+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:25:38.054970+0000","last_peered":"2024-09-10T15:25:38.054970+0000","last_clean":"2024-09-10T15:25:38.054970+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:25:38.054970+0000","last_undegraded":"2024-09-10T15:25:38.054970+0000","last_fullsized":"2024-09-10T15:25:38.054970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049775+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:25:37.049775+0000","last_peered":"2024-09-10T15:25:37.049775+0000","last_clean":"2024-09-10T15:25:37.049775+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:25:37.049775+0000","last_undegraded":"2024-09-10T15:25:37.049775+0000","last_fullsized":"2024-09-10T15:25:37.049775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829758+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:25:36.829758+0000","last_peered":"2024-09-10T15:25:36.829758+0000","last_clean":"2024-09-10T15:25:36.829758+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:25:36.829758+0000","last_undegraded":"2024-09-10T15:25:36.829758+0000","last_fullsized":"2024-09-10T15:25:36.829758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049517+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:25:37.049517+0000","last_peered":"2024-09-10T15:25:37.049517+0000","last_clean":"2024-09-10T15:25:37.049517+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:25:37.049517+0000","last_undegraded":"2024-09-10T15:25:37.049517+0000","last_fullsized":"2024-09-10T15:25:37.049517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048405+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:25:37.048405+0000","last_peered":"2024-09-10T15:25:37.048405+0000","last_clean":"2024-09-10T15:25:37.048405+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:25:37.048405+0000","last_undegraded":"2024-09-10T15:25:37.048405+0000","last_fullsized":"2024-09-10T15:25:37.048405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831242+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:25:36.831242+0000","last_peered":"2024-09-10T15:25:36.831242+0000","last_clean":"2024-09-10T15:25:36.831242+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:25:36.831242+0000","last_undegraded":"2024-09-10T15:25:36.831242+0000","last_fullsized":"2024-09-10T15:25:36.831242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832188+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:25:36.832188+0000","last_peered":"2024-09-10T15:25:36.832188+0000","last_clean":"2024-09-10T15:25:36.832188+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:25:36.832188+0000","last_undegraded":"2024-09-10T15:25:36.832188+0000","last_fullsized":"2024-09-10T15:25:36.832188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049854+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:25:37.049854+0000","last_peered":"2024-09-10T15:25:37.049854+0000","last_clean":"2024-09-10T15:25:37.049854+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:25:37.049854+0000","last_undegraded":"2024-09-10T15:25:37.049854+0000","last_fullsized":"2024-09-10T15:25:37.049854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224600+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:25:37.224600+0000","last_peered":"2024-09-10T15:25:37.224600+0000","last_clean":"2024-09-10T15:25:37.224600+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:25:37.224600+0000","last_undegraded":"2024-09-10T15:25:37.224600+0000","last_fullsized":"2024-09-10T15:25:37.224600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829959+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:25:36.829959+0000","last_peered":"2024-09-10T15:25:36.829959+0000","last_clean":"2024-09-10T15:25:36.829959+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:25:36.829959+0000","last_undegraded":"2024-09-10T15:25:36.829959+0000","last_fullsized":"2024-09-10T15:25:36.829959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047969+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:25:37.047969+0000","last_peered":"2024-09-10T15:25:37.047969+0000","last_clean":"2024-09-10T15:25:37.047969+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:25:37.047969+0000","last_undegraded":"2024-09-10T15:25:37.047969+0000","last_fullsized":"2024-09-10T15:25:37.047969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055334+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:25:38.055334+0000","last_peered":"2024-09-10T15:25:38.055334+0000","last_clean":"2024-09-10T15:25:38.055334+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:25:38.055334+0000","last_undegraded":"2024-09-10T15:25:38.055334+0000","last_fullsized":"2024-09-10T15:25:38.055334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225440+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:25:37.225440+0000","last_peered":"2024-09-10T15:25:37.225440+0000","last_clean":"2024-09-10T15:25:37.225440+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:25:37.225440+0000","last_undegraded":"2024-09-10T15:25:37.225440+0000","last_fullsized":"2024-09-10T15:25:37.225440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055430+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:25:38.055430+0000","last_peered":"2024-09-10T15:25:38.055430+0000","last_clean":"2024-09-10T15:25:38.055430+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:25:38.055430+0000","last_undegraded":"2024-09-10T15:25:38.055430+0000","last_fullsized":"2024-09-10T15:25:38.055430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828264+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:25:36.828264+0000","last_peered":"2024-09-10T15:25:36.828264+0000","last_clean":"2024-09-10T15:25:36.828264+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:25:36.828264+0000","last_undegraded":"2024-09-10T15:25:36.828264+0000","last_fullsized":"2024-09-10T15:25:36.828264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050255+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:25:37.050255+0000","last_peered":"2024-09-10T15:25:37.050255+0000","last_clean":"2024-09-10T15:25:37.050255+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:25:37.050255+0000","last_undegraded":"2024-09-10T15:25:37.050255+0000","last_fullsized":"2024-09-10T15:25:37.050255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050904+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:25:38.050904+0000","last_peered":"2024-09-10T15:25:38.050904+0000","last_clean":"2024-09-10T15:25:38.050904+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:25:38.050904+0000","last_undegraded":"2024-09-10T15:25:38.050904+0000","last_fullsized":"2024-09-10T15:25:38.050904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048790+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:25:37.048790+0000","last_peered":"2024-09-10T15:25:37.048790+0000","last_clean":"2024-09-10T15:25:37.048790+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:25:37.048790+0000","last_undegraded":"2024-09-10T15:25:37.048790+0000","last_fullsized":"2024-09-10T15:25:37.048790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055085+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:25:38.055085+0000","last_peered":"2024-09-10T15:25:38.055085+0000","last_clean":"2024-09-10T15:25:38.055085+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:25:38.055085+0000","last_undegraded":"2024-09-10T15:25:38.055085+0000","last_fullsized":"2024-09-10T15:25:38.055085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830100+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:25:36.830100+0000","last_peered":"2024-09-10T15:25:36.830100+0000","last_clean":"2024-09-10T15:25:36.830100+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:25:36.830100+0000","last_undegraded":"2024-09-10T15:25:36.830100+0000","last_fullsized":"2024-09-10T15:25:36.830100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048732+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:25:37.048732+0000","last_peered":"2024-09-10T15:25:37.048732+0000","last_clean":"2024-09-10T15:25:37.048732+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:25:37.048732+0000","last_undegraded":"2024-09-10T15:25:37.048732+0000","last_fullsized":"2024-09-10T15:25:37.048732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049219+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:25:37.049219+0000","last_peered":"2024-09-10T15:25:37.049219+0000","last_clean":"2024-09-10T15:25:37.049219+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:25:37.049219+0000","last_undegraded":"2024-09-10T15:25:37.049219+0000","last_fullsized":"2024-09-10T15:25:37.049219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052087+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:38.052087+0000","last_peered":"2024-09-10T15:25:38.052087+0000","last_clean":"2024-09-10T15:25:38.052087+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:38.052087+0000","last_undegraded":"2024-09-10T15:25:38.052087+0000","last_fullsized":"2024-09-10T15:25:38.052087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048682+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:37.048682+0000","last_peered":"2024-09-10T15:25:37.048682+0000","last_clean":"2024-09-10T15:25:37.048682+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:37.048682+0000","last_undegraded":"2024-09-10T15:25:37.048682+0000","last_fullsized":"2024-09-10T15:25:37.048682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051619+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:25:38.051619+0000","last_peered":"2024-09-10T15:25:38.051619+0000","last_clean":"2024-09-10T15:25:38.051619+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:25:38.051619+0000","last_undegraded":"2024-09-10T15:25:38.051619+0000","last_fullsized":"2024-09-10T15:25:38.051619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828639+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:25:36.828639+0000","last_peered":"2024-09-10T15:25:36.828639+0000","last_clean":"2024-09-10T15:25:36.828639+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:25:36.828639+0000","last_undegraded":"2024-09-10T15:25:36.828639+0000","last_fullsized":"2024-09-10T15:25:36.828639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049264+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:25:37.049264+0000","last_peered":"2024-09-10T15:25:37.049264+0000","last_clean":"2024-09-10T15:25:37.049264+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:25:37.049264+0000","last_undegraded":"2024-09-10T15:25:37.049264+0000","last_fullsized":"2024-09-10T15:25:37.049264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831470+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:25:36.831470+0000","last_peered":"2024-09-10T15:25:36.831470+0000","last_clean":"2024-09-10T15:25:36.831470+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:25:36.831470+0000","last_undegraded":"2024-09-10T15:25:36.831470+0000","last_fullsized":"2024-09-10T15:25:36.831470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828639+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:25:36.828639+0000","last_peered":"2024-09-10T15:25:36.828639+0000","last_clean":"2024-09-10T15:25:36.828639+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:25:36.828639+0000","last_undegraded":"2024-09-10T15:25:36.828639+0000","last_fullsized":"2024-09-10T15:25:36.828639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833446+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:25:36.833446+0000","last_peered":"2024-09-10T15:25:36.833446+0000","last_clean":"2024-09-10T15:25:36.833446+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:25:36.833446+0000","last_undegraded":"2024-09-10T15:25:36.833446+0000","last_fullsized":"2024-09-10T15:25:36.833446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047498+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:37.047498+0000","last_peered":"2024-09-10T15:25:37.047498+0000","last_clean":"2024-09-10T15:25:37.047498+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:37.047498+0000","last_undegraded":"2024-09-10T15:25:37.047498+0000","last_fullsized":"2024-09-10T15:25:37.047498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225270+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:25:37.225270+0000","last_peered":"2024-09-10T15:25:37.225270+0000","last_clean":"2024-09-10T15:25:37.225270+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:25:37.225270+0000","last_undegraded":"2024-09-10T15:25:37.225270+0000","last_fullsized":"2024-09-10T15:25:37.225270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048799+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:25:37.048799+0000","last_peered":"2024-09-10T15:25:37.048799+0000","last_clean":"2024-09-10T15:25:37.048799+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:25:37.048799+0000","last_undegraded":"2024-09-10T15:25:37.048799+0000","last_fullsized":"2024-09-10T15:25:37.048799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":76,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049111+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:25:37.049111+0000","last_peered":"2024-09-10T15:25:37.049111+0000","last_clean":"2024-09-10T15:25:37.049111+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:25:37.049111+0000","last_undegraded":"2024-09-10T15:25:37.049111+0000","last_fullsized":"2024-09-10T15:25:37.049111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049474+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:25:37.049474+0000","last_peered":"2024-09-10T15:25:37.049474+0000","last_clean":"2024-09-10T15:25:37.049474+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:25:37.049474+0000","last_undegraded":"2024-09-10T15:25:37.049474+0000","last_fullsized":"2024-09-10T15:25:37.049474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830793+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:25:36.830793+0000","last_peered":"2024-09-10T15:25:36.830793+0000","last_clean":"2024-09-10T15:25:36.830793+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:25:36.830793+0000","last_undegraded":"2024-09-10T15:25:36.830793+0000","last_fullsized":"2024-09-10T15:25:36.830793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226260+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:25:37.226260+0000","last_peered":"2024-09-10T15:25:37.226260+0000","last_clean":"2024-09-10T15:25:37.226260+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:25:37.226260+0000","last_undegraded":"2024-09-10T15:25:37.226260+0000","last_fullsized":"2024-09-10T15:25:37.226260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048603+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:37.048603+0000","last_peered":"2024-09-10T15:25:37.048603+0000","last_clean":"2024-09-10T15:25:37.048603+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:37.048603+0000","last_undegraded":"2024-09-10T15:25:37.048603+0000","last_fullsized":"2024-09-10T15:25:37.048603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831381+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:25:36.831381+0000","last_peered":"2024-09-10T15:25:36.831381+0000","last_clean":"2024-09-10T15:25:36.831381+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:25:36.831381+0000","last_undegraded":"2024-09-10T15:25:36.831381+0000","last_fullsized":"2024-09-10T15:25:36.831381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050098+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:25:37.050098+0000","last_peered":"2024-09-10T15:25:37.050098+0000","last_clean":"2024-09-10T15:25:37.050098+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:25:37.050098+0000","last_undegraded":"2024-09-10T15:25:37.050098+0000","last_fullsized":"2024-09-10T15:25:37.050098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829739+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:25:36.829739+0000","last_peered":"2024-09-10T15:25:36.829739+0000","last_clean":"2024-09-10T15:25:36.829739+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:25:36.829739+0000","last_undegraded":"2024-09-10T15:25:36.829739+0000","last_fullsized":"2024-09-10T15:25:36.829739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052647+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:25:38.052647+0000","last_peered":"2024-09-10T15:25:38.052647+0000","last_clean":"2024-09-10T15:25:38.052647+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:25:38.052647+0000","last_undegraded":"2024-09-10T15:25:38.052647+0000","last_fullsized":"2024-09-10T15:25:38.052647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050902+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:25:38.050902+0000","last_peered":"2024-09-10T15:25:38.050902+0000","last_clean":"2024-09-10T15:25:38.050902+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:25:38.050902+0000","last_undegraded":"2024-09-10T15:25:38.050902+0000","last_fullsized":"2024-09-10T15:25:38.050902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226344+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:25:37.226344+0000","last_peered":"2024-09-10T15:25:37.226344+0000","last_clean":"2024-09-10T15:25:37.226344+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:25:37.226344+0000","last_undegraded":"2024-09-10T15:25:37.226344+0000","last_fullsized":"2024-09-10T15:25:37.226344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048501+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:37.048501+0000","last_peered":"2024-09-10T15:25:37.048501+0000","last_clean":"2024-09-10T15:25:37.048501+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:37.048501+0000","last_undegraded":"2024-09-10T15:25:37.048501+0000","last_fullsized":"2024-09-10T15:25:37.048501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830085+0000","last_change":"2024-09-10T15:25:11.842227+0000","last_active":"2024-09-10T15:25:36.830085+0000","last_peered":"2024-09-10T15:25:36.830085+0000","last_clean":"2024-09-10T15:25:36.830085+0000","last_became_active":"2024-09-10T15:25:11.841833+0000","last_became_peered":"2024-09-10T15:25:11.841833+0000","last_unstale":"2024-09-10T15:25:36.830085+0000","last_undegraded":"2024-09-10T15:25:36.830085+0000","last_fullsized":"2024-09-10T15:25:36.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049426+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:25:37.049426+0000","last_peered":"2024-09-10T15:25:37.049426+0000","last_clean":"2024-09-10T15:25:37.049426+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:25:37.049426+0000","last_undegraded":"2024-09-10T15:25:37.049426+0000","last_fullsized":"2024-09-10T15:25:37.049426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831549+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:25:36.831549+0000","last_peered":"2024-09-10T15:25:36.831549+0000","last_clean":"2024-09-10T15:25:36.831549+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:25:36.831549+0000","last_undegraded":"2024-09-10T15:25:36.831549+0000","last_fullsized":"2024-09-10T15:25:36.831549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049049+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:25:37.049049+0000","last_peered":"2024-09-10T15:25:37.049049+0000","last_clean":"2024-09-10T15:25:37.049049+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:25:37.049049+0000","last_undegraded":"2024-09-10T15:25:37.049049+0000","last_fullsized":"2024-09-10T15:25:37.049049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051183+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:25:38.051183+0000","last_peered":"2024-09-10T15:25:38.051183+0000","last_clean":"2024-09-10T15:25:38.051183+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:25:38.051183+0000","last_undegraded":"2024-09-10T15:25:38.051183+0000","last_fullsized":"2024-09-10T15:25:38.051183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225028+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:25:37.225028+0000","last_peered":"2024-09-10T15:25:37.225028+0000","last_clean":"2024-09-10T15:25:37.225028+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:25:37.225028+0000","last_undegraded":"2024-09-10T15:25:37.225028+0000","last_fullsized":"2024-09-10T15:25:37.225028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829787+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:25:36.829787+0000","last_peered":"2024-09-10T15:25:36.829787+0000","last_clean":"2024-09-10T15:25:36.829787+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:25:36.829787+0000","last_undegraded":"2024-09-10T15:25:36.829787+0000","last_fullsized":"2024-09-10T15:25:36.829787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832447+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:36.832447+0000","last_peered":"2024-09-10T15:25:36.832447+0000","last_clean":"2024-09-10T15:25:36.832447+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:36.832447+0000","last_undegraded":"2024-09-10T15:25:36.832447+0000","last_fullsized":"2024-09-10T15:25:36.832447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051414+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:25:38.051414+0000","last_peered":"2024-09-10T15:25:38.051414+0000","last_clean":"2024-09-10T15:25:38.051414+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:25:38.051414+0000","last_undegraded":"2024-09-10T15:25:38.051414+0000","last_fullsized":"2024-09-10T15:25:38.051414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048108+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:25:37.048108+0000","last_peered":"2024-09-10T15:25:37.048108+0000","last_clean":"2024-09-10T15:25:37.048108+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:25:37.048108+0000","last_undegraded":"2024-09-10T15:25:37.048108+0000","last_fullsized":"2024-09-10T15:25:37.048108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828153+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:25:36.828153+0000","last_peered":"2024-09-10T15:25:36.828153+0000","last_clean":"2024-09-10T15:25:36.828153+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:25:36.828153+0000","last_undegraded":"2024-09-10T15:25:36.828153+0000","last_fullsized":"2024-09-10T15:25:36.828153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831242+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:25:36.831242+0000","last_peered":"2024-09-10T15:25:36.831242+0000","last_clean":"2024-09-10T15:25:36.831242+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:25:36.831242+0000","last_undegraded":"2024-09-10T15:25:36.831242+0000","last_fullsized":"2024-09-10T15:25:36.831242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225624+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:25:37.225624+0000","last_peered":"2024-09-10T15:25:37.225624+0000","last_clean":"2024-09-10T15:25:37.225624+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:25:37.225624+0000","last_undegraded":"2024-09-10T15:25:37.225624+0000","last_fullsized":"2024-09-10T15:25:37.225624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226569+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:25:37.226569+0000","last_peered":"2024-09-10T15:25:37.226569+0000","last_clean":"2024-09-10T15:25:37.226569+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:25:37.226569+0000","last_undegraded":"2024-09-10T15:25:37.226569+0000","last_fullsized":"2024-09-10T15:25:37.226569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048997+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:37.048997+0000","last_peered":"2024-09-10T15:25:37.048997+0000","last_clean":"2024-09-10T15:25:37.048997+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:37.048997+0000","last_undegraded":"2024-09-10T15:25:37.048997+0000","last_fullsized":"2024-09-10T15:25:37.048997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828357+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:25:36.828357+0000","last_peered":"2024-09-10T15:25:36.828357+0000","last_clean":"2024-09-10T15:25:36.828357+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:25:36.828357+0000","last_undegraded":"2024-09-10T15:25:36.828357+0000","last_fullsized":"2024-09-10T15:25:36.828357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224942+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:25:37.224942+0000","last_peered":"2024-09-10T15:25:37.224942+0000","last_clean":"2024-09-10T15:25:37.224942+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:25:37.224942+0000","last_undegraded":"2024-09-10T15:25:37.224942+0000","last_fullsized":"2024-09-10T15:25:37.224942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051441+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:25:38.051441+0000","last_peered":"2024-09-10T15:25:38.051441+0000","last_clean":"2024-09-10T15:25:38.051441+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:25:38.051441+0000","last_undegraded":"2024-09-10T15:25:38.051441+0000","last_fullsized":"2024-09-10T15:25:38.051441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049733+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:25:37.049733+0000","last_peered":"2024-09-10T15:25:37.049733+0000","last_clean":"2024-09-10T15:25:37.049733+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:25:37.049733+0000","last_undegraded":"2024-09-10T15:25:37.049733+0000","last_fullsized":"2024-09-10T15:25:37.049733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050852+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:25:38.050852+0000","last_peered":"2024-09-10T15:25:38.050852+0000","last_clean":"2024-09-10T15:25:38.050852+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:25:38.050852+0000","last_undegraded":"2024-09-10T15:25:38.050852+0000","last_fullsized":"2024-09-10T15:25:38.050852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053681+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:25:38.053681+0000","last_peered":"2024-09-10T15:25:38.053681+0000","last_clean":"2024-09-10T15:25:38.053681+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:25:38.053681+0000","last_undegraded":"2024-09-10T15:25:38.053681+0000","last_fullsized":"2024-09-10T15:25:38.053681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053047+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:38.053047+0000","last_peered":"2024-09-10T15:25:38.053047+0000","last_clean":"2024-09-10T15:25:38.053047+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:38.053047+0000","last_undegraded":"2024-09-10T15:25:38.053047+0000","last_fullsized":"2024-09-10T15:25:38.053047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047675+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:25:37.047675+0000","last_peered":"2024-09-10T15:25:37.047675+0000","last_clean":"2024-09-10T15:25:37.047675+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:25:37.047675+0000","last_undegraded":"2024-09-10T15:25:37.047675+0000","last_fullsized":"2024-09-10T15:25:37.047675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048213+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:25:37.048213+0000","last_peered":"2024-09-10T15:25:37.048213+0000","last_clean":"2024-09-10T15:25:37.048213+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:25:37.048213+0000","last_undegraded":"2024-09-10T15:25:37.048213+0000","last_fullsized":"2024-09-10T15:25:37.048213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832983+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:25:36.832983+0000","last_peered":"2024-09-10T15:25:36.832983+0000","last_clean":"2024-09-10T15:25:36.832983+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:25:36.832983+0000","last_undegraded":"2024-09-10T15:25:36.832983+0000","last_fullsized":"2024-09-10T15:25:36.832983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830697+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:25:36.830697+0000","last_peered":"2024-09-10T15:25:36.830697+0000","last_clean":"2024-09-10T15:25:36.830697+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:25:36.830697+0000","last_undegraded":"2024-09-10T15:25:36.830697+0000","last_fullsized":"2024-09-10T15:25:36.830697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828367+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:25:36.828367+0000","last_peered":"2024-09-10T15:25:36.828367+0000","last_clean":"2024-09-10T15:25:36.828367+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:25:36.828367+0000","last_undegraded":"2024-09-10T15:25:36.828367+0000","last_fullsized":"2024-09-10T15:25:36.828367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052829+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:25:38.052829+0000","last_peered":"2024-09-10T15:25:38.052829+0000","last_clean":"2024-09-10T15:25:38.052829+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:25:38.052829+0000","last_undegraded":"2024-09-10T15:25:38.052829+0000","last_fullsized":"2024-09-10T15:25:38.052829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049215+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:37.049215+0000","last_peered":"2024-09-10T15:25:37.049215+0000","last_clean":"2024-09-10T15:25:37.049215+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:37.049215+0000","last_undegraded":"2024-09-10T15:25:37.049215+0000","last_fullsized":"2024-09-10T15:25:37.049215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050594+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:25:38.050594+0000","last_peered":"2024-09-10T15:25:38.050594+0000","last_clean":"2024-09-10T15:25:38.050594+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:25:38.050594+0000","last_undegraded":"2024-09-10T15:25:38.050594+0000","last_fullsized":"2024-09-10T15:25:38.050594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829459+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:25:36.829459+0000","last_peered":"2024-09-10T15:25:36.829459+0000","last_clean":"2024-09-10T15:25:36.829459+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:25:36.829459+0000","last_undegraded":"2024-09-10T15:25:36.829459+0000","last_fullsized":"2024-09-10T15:25:36.829459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051251+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:25:38.051251+0000","last_peered":"2024-09-10T15:25:38.051251+0000","last_clean":"2024-09-10T15:25:38.051251+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:25:38.051251+0000","last_undegraded":"2024-09-10T15:25:38.051251+0000","last_fullsized":"2024-09-10T15:25:38.051251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829559+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:25:36.829559+0000","last_peered":"2024-09-10T15:25:36.829559+0000","last_clean":"2024-09-10T15:25:36.829559+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:25:36.829559+0000","last_undegraded":"2024-09-10T15:25:36.829559+0000","last_fullsized":"2024-09-10T15:25:36.829559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053086+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:25:38.053086+0000","last_peered":"2024-09-10T15:25:38.053086+0000","last_clean":"2024-09-10T15:25:38.053086+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:25:38.053086+0000","last_undegraded":"2024-09-10T15:25:38.053086+0000","last_fullsized":"2024-09-10T15:25:38.053086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829286+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:25:36.829286+0000","last_peered":"2024-09-10T15:25:36.829286+0000","last_clean":"2024-09-10T15:25:36.829286+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:25:36.829286+0000","last_undegraded":"2024-09-10T15:25:36.829286+0000","last_fullsized":"2024-09-10T15:25:36.829286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048799+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:25:37.048799+0000","last_peered":"2024-09-10T15:25:37.048799+0000","last_clean":"2024-09-10T15:25:37.048799+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:25:37.048799+0000","last_undegraded":"2024-09-10T15:25:37.048799+0000","last_fullsized":"2024-09-10T15:25:37.048799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225217+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:25:37.225217+0000","last_peered":"2024-09-10T15:25:37.225217+0000","last_clean":"2024-09-10T15:25:37.225217+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:25:37.225217+0000","last_undegraded":"2024-09-10T15:25:37.225217+0000","last_fullsized":"2024-09-10T15:25:37.225217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224771+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:25:37.224771+0000","last_peered":"2024-09-10T15:25:37.224771+0000","last_clean":"2024-09-10T15:25:37.224771+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:25:37.224771+0000","last_undegraded":"2024-09-10T15:25:37.224771+0000","last_fullsized":"2024-09-10T15:25:37.224771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048061+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:25:37.048061+0000","last_peered":"2024-09-10T15:25:37.048061+0000","last_clean":"2024-09-10T15:25:37.048061+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:25:37.048061+0000","last_undegraded":"2024-09-10T15:25:37.048061+0000","last_fullsized":"2024-09-10T15:25:37.048061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049768+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:25:37.049768+0000","last_peered":"2024-09-10T15:25:37.049768+0000","last_clean":"2024-09-10T15:25:37.049768+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:25:37.049768+0000","last_undegraded":"2024-09-10T15:25:37.049768+0000","last_fullsized":"2024-09-10T15:25:37.049768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051115+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:25:38.051115+0000","last_peered":"2024-09-10T15:25:38.051115+0000","last_clean":"2024-09-10T15:25:38.051115+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:25:38.051115+0000","last_undegraded":"2024-09-10T15:25:38.051115+0000","last_fullsized":"2024-09-10T15:25:38.051115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830545+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:25:36.830545+0000","last_peered":"2024-09-10T15:25:36.830545+0000","last_clean":"2024-09-10T15:25:36.830545+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:25:36.830545+0000","last_undegraded":"2024-09-10T15:25:36.830545+0000","last_fullsized":"2024-09-10T15:25:36.830545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051178+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:25:38.051178+0000","last_peered":"2024-09-10T15:25:38.051178+0000","last_clean":"2024-09-10T15:25:38.051178+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:25:38.051178+0000","last_undegraded":"2024-09-10T15:25:38.051178+0000","last_fullsized":"2024-09-10T15:25:38.051178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050393+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:25:38.050393+0000","last_peered":"2024-09-10T15:25:38.050393+0000","last_clean":"2024-09-10T15:25:38.050393+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:25:38.050393+0000","last_undegraded":"2024-09-10T15:25:38.050393+0000","last_fullsized":"2024-09-10T15:25:38.050393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828060+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:25:36.828060+0000","last_peered":"2024-09-10T15:25:36.828060+0000","last_clean":"2024-09-10T15:25:36.828060+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:25:36.828060+0000","last_undegraded":"2024-09-10T15:25:36.828060+0000","last_fullsized":"2024-09-10T15:25:36.828060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225619+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:25:37.225619+0000","last_peered":"2024-09-10T15:25:37.225619+0000","last_clean":"2024-09-10T15:25:37.225619+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:25:37.225619+0000","last_undegraded":"2024-09-10T15:25:37.225619+0000","last_fullsized":"2024-09-10T15:25:37.225619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051200+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:25:38.051200+0000","last_peered":"2024-09-10T15:25:38.051200+0000","last_clean":"2024-09-10T15:25:38.051200+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:25:38.051200+0000","last_undegraded":"2024-09-10T15:25:38.051200+0000","last_fullsized":"2024-09-10T15:25:38.051200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830482+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:25:36.830482+0000","last_peered":"2024-09-10T15:25:36.830482+0000","last_clean":"2024-09-10T15:25:36.830482+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:25:36.830482+0000","last_undegraded":"2024-09-10T15:25:36.830482+0000","last_fullsized":"2024-09-10T15:25:36.830482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828130+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:25:36.828130+0000","last_peered":"2024-09-10T15:25:36.828130+0000","last_clean":"2024-09-10T15:25:36.828130+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:25:36.828130+0000","last_undegraded":"2024-09-10T15:25:36.828130+0000","last_fullsized":"2024-09-10T15:25:36.828130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049314+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:25:37.049314+0000","last_peered":"2024-09-10T15:25:37.049314+0000","last_clean":"2024-09-10T15:25:37.049314+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:25:37.049314+0000","last_undegraded":"2024-09-10T15:25:37.049314+0000","last_fullsized":"2024-09-10T15:25:37.049314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053856+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:25:38.053856+0000","last_peered":"2024-09-10T15:25:38.053856+0000","last_clean":"2024-09-10T15:25:38.053856+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:25:38.053856+0000","last_undegraded":"2024-09-10T15:25:38.053856+0000","last_fullsized":"2024-09-10T15:25:38.053856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048254+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:25:37.048254+0000","last_peered":"2024-09-10T15:25:37.048254+0000","last_clean":"2024-09-10T15:25:37.048254+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:25:37.048254+0000","last_undegraded":"2024-09-10T15:25:37.048254+0000","last_fullsized":"2024-09-10T15:25:37.048254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048350+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:25:37.048350+0000","last_peered":"2024-09-10T15:25:37.048350+0000","last_clean":"2024-09-10T15:25:37.048350+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:25:37.048350+0000","last_undegraded":"2024-09-10T15:25:37.048350+0000","last_fullsized":"2024-09-10T15:25:37.048350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833145+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:25:36.833145+0000","last_peered":"2024-09-10T15:25:36.833145+0000","last_clean":"2024-09-10T15:25:36.833145+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:25:36.833145+0000","last_undegraded":"2024-09-10T15:25:36.833145+0000","last_fullsized":"2024-09-10T15:25:36.833145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047462+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:25:37.047462+0000","last_peered":"2024-09-10T15:25:37.047462+0000","last_clean":"2024-09-10T15:25:37.047462+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:25:37.047462+0000","last_undegraded":"2024-09-10T15:25:37.047462+0000","last_fullsized":"2024-09-10T15:25:37.047462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828223+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:25:36.828223+0000","last_peered":"2024-09-10T15:25:36.828223+0000","last_clean":"2024-09-10T15:25:36.828223+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:25:36.828223+0000","last_undegraded":"2024-09-10T15:25:36.828223+0000","last_fullsized":"2024-09-10T15:25:36.828223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048945+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:25:37.048945+0000","last_peered":"2024-09-10T15:25:37.048945+0000","last_clean":"2024-09-10T15:25:37.048945+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:25:37.048945+0000","last_undegraded":"2024-09-10T15:25:37.048945+0000","last_fullsized":"2024-09-10T15:25:37.048945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048929+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:25:37.048929+0000","last_peered":"2024-09-10T15:25:37.048929+0000","last_clean":"2024-09-10T15:25:37.048929+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:25:37.048929+0000","last_undegraded":"2024-09-10T15:25:37.048929+0000","last_fullsized":"2024-09-10T15:25:37.048929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833433+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:25:36.833433+0000","last_peered":"2024-09-10T15:25:36.833433+0000","last_clean":"2024-09-10T15:25:36.833433+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:25:36.833433+0000","last_undegraded":"2024-09-10T15:25:36.833433+0000","last_fullsized":"2024-09-10T15:25:36.833433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226256+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:25:37.226256+0000","last_peered":"2024-09-10T15:25:37.226256+0000","last_clean":"2024-09-10T15:25:37.226256+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:25:37.226256+0000","last_undegraded":"2024-09-10T15:25:37.226256+0000","last_fullsized":"2024-09-10T15:25:37.226256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225926+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:25:37.225926+0000","last_peered":"2024-09-10T15:25:37.225926+0000","last_clean":"2024-09-10T15:25:37.225926+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:25:37.225926+0000","last_undegraded":"2024-09-10T15:25:37.225926+0000","last_fullsized":"2024-09-10T15:25:37.225926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828873+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:25:36.828873+0000","last_peered":"2024-09-10T15:25:36.828873+0000","last_clean":"2024-09-10T15:25:36.828873+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:25:36.828873+0000","last_undegraded":"2024-09-10T15:25:36.828873+0000","last_fullsized":"2024-09-10T15:25:36.828873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830272+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:25:36.830272+0000","last_peered":"2024-09-10T15:25:36.830272+0000","last_clean":"2024-09-10T15:25:36.830272+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:25:36.830272+0000","last_undegraded":"2024-09-10T15:25:36.830272+0000","last_fullsized":"2024-09-10T15:25:36.830272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052672+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:25:38.052672+0000","last_peered":"2024-09-10T15:25:38.052672+0000","last_clean":"2024-09-10T15:25:38.052672+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:25:38.052672+0000","last_undegraded":"2024-09-10T15:25:38.052672+0000","last_fullsized":"2024-09-10T15:25:38.052672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051618+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:25:38.051618+0000","last_peered":"2024-09-10T15:25:38.051618+0000","last_clean":"2024-09-10T15:25:38.051618+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:25:38.051618+0000","last_undegraded":"2024-09-10T15:25:38.051618+0000","last_fullsized":"2024-09-10T15:25:38.051618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829529+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:25:36.829529+0000","last_peered":"2024-09-10T15:25:36.829529+0000","last_clean":"2024-09-10T15:25:36.829529+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:25:36.829529+0000","last_undegraded":"2024-09-10T15:25:36.829529+0000","last_fullsized":"2024-09-10T15:25:36.829529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048636+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:25:37.048636+0000","last_peered":"2024-09-10T15:25:37.048636+0000","last_clean":"2024-09-10T15:25:37.048636+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:25:37.048636+0000","last_undegraded":"2024-09-10T15:25:37.048636+0000","last_fullsized":"2024-09-10T15:25:37.048636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830890+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:25:36.830890+0000","last_peered":"2024-09-10T15:25:36.830890+0000","last_clean":"2024-09-10T15:25:36.830890+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:25:36.830890+0000","last_undegraded":"2024-09-10T15:25:36.830890+0000","last_fullsized":"2024-09-10T15:25:36.830890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048418+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:25:37.048418+0000","last_peered":"2024-09-10T15:25:37.048418+0000","last_clean":"2024-09-10T15:25:37.048418+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:25:37.048418+0000","last_undegraded":"2024-09-10T15:25:37.048418+0000","last_fullsized":"2024-09-10T15:25:37.048418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049683+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:25:37.049683+0000","last_peered":"2024-09-10T15:25:37.049683+0000","last_clean":"2024-09-10T15:25:37.049683+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:25:37.049683+0000","last_undegraded":"2024-09-10T15:25:37.049683+0000","last_fullsized":"2024-09-10T15:25:37.049683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054429+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:25:38.054429+0000","last_peered":"2024-09-10T15:25:38.054429+0000","last_clean":"2024-09-10T15:25:38.054429+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:25:38.054429+0000","last_undegraded":"2024-09-10T15:25:38.054429+0000","last_fullsized":"2024-09-10T15:25:38.054429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829900+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:25:36.829900+0000","last_peered":"2024-09-10T15:25:36.829900+0000","last_clean":"2024-09-10T15:25:36.829900+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:25:36.829900+0000","last_undegraded":"2024-09-10T15:25:36.829900+0000","last_fullsized":"2024-09-10T15:25:36.829900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225922+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:25:37.225922+0000","last_peered":"2024-09-10T15:25:37.225922+0000","last_clean":"2024-09-10T15:25:37.225922+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:25:37.225922+0000","last_undegraded":"2024-09-10T15:25:37.225922+0000","last_fullsized":"2024-09-10T15:25:37.225922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049570+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:25:37.049570+0000","last_peered":"2024-09-10T15:25:37.049570+0000","last_clean":"2024-09-10T15:25:37.049570+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:25:37.049570+0000","last_undegraded":"2024-09-10T15:25:37.049570+0000","last_fullsized":"2024-09-10T15:25:37.049570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047163+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:25:37.047163+0000","last_peered":"2024-09-10T15:25:37.047163+0000","last_clean":"2024-09-10T15:25:37.047163+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:25:37.047163+0000","last_undegraded":"2024-09-10T15:25:37.047163+0000","last_fullsized":"2024-09-10T15:25:37.047163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052998+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:25:38.052998+0000","last_peered":"2024-09-10T15:25:38.052998+0000","last_clean":"2024-09-10T15:25:38.052998+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:25:38.052998+0000","last_undegraded":"2024-09-10T15:25:38.052998+0000","last_fullsized":"2024-09-10T15:25:38.052998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052041+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:25:38.052041+0000","last_peered":"2024-09-10T15:25:38.052041+0000","last_clean":"2024-09-10T15:25:38.052041+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:25:38.052041+0000","last_undegraded":"2024-09-10T15:25:38.052041+0000","last_fullsized":"2024-09-10T15:25:38.052041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051847+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:25:38.051847+0000","last_peered":"2024-09-10T15:25:38.051847+0000","last_clean":"2024-09-10T15:25:38.051847+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:25:38.051847+0000","last_undegraded":"2024-09-10T15:25:38.051847+0000","last_fullsized":"2024-09-10T15:25:38.051847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048764+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:25:37.048764+0000","last_peered":"2024-09-10T15:25:37.048764+0000","last_clean":"2024-09-10T15:25:37.048764+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:25:37.048764+0000","last_undegraded":"2024-09-10T15:25:37.048764+0000","last_fullsized":"2024-09-10T15:25:37.048764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830692+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:25:36.830692+0000","last_peered":"2024-09-10T15:25:36.830692+0000","last_clean":"2024-09-10T15:25:36.830692+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:25:36.830692+0000","last_undegraded":"2024-09-10T15:25:36.830692+0000","last_fullsized":"2024-09-10T15:25:36.830692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.046840+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:25:37.046840+0000","last_peered":"2024-09-10T15:25:37.046840+0000","last_clean":"2024-09-10T15:25:37.046840+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:25:37.046840+0000","last_undegraded":"2024-09-10T15:25:37.046840+0000","last_fullsized":"2024-09-10T15:25:37.046840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829186+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:25:36.829186+0000","last_peered":"2024-09-10T15:25:36.829186+0000","last_clean":"2024-09-10T15:25:36.829186+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:25:36.829186+0000","last_undegraded":"2024-09-10T15:25:36.829186+0000","last_fullsized":"2024-09-10T15:25:36.829186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055186+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:25:38.055186+0000","last_peered":"2024-09-10T15:25:38.055186+0000","last_clean":"2024-09-10T15:25:38.055186+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:25:38.055186+0000","last_undegraded":"2024-09-10T15:25:38.055186+0000","last_fullsized":"2024-09-10T15:25:38.055186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054061+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:25:38.054061+0000","last_peered":"2024-09-10T15:25:38.054061+0000","last_clean":"2024-09-10T15:25:38.054061+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:25:38.054061+0000","last_undegraded":"2024-09-10T15:25:38.054061+0000","last_fullsized":"2024-09-10T15:25:38.054061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828263+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:25:36.828263+0000","last_peered":"2024-09-10T15:25:36.828263+0000","last_clean":"2024-09-10T15:25:36.828263+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:25:36.828263+0000","last_undegraded":"2024-09-10T15:25:36.828263+0000","last_fullsized":"2024-09-10T15:25:36.828263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050520+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:25:38.050520+0000","last_peered":"2024-09-10T15:25:38.050520+0000","last_clean":"2024-09-10T15:25:38.050520+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:25:38.050520+0000","last_undegraded":"2024-09-10T15:25:38.050520+0000","last_fullsized":"2024-09-10T15:25:38.050520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054977+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:25:38.054977+0000","last_peered":"2024-09-10T15:25:38.054977+0000","last_clean":"2024-09-10T15:25:38.054977+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:25:38.054977+0000","last_undegraded":"2024-09-10T15:25:38.054977+0000","last_fullsized":"2024-09-10T15:25:38.054977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828398+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:25:36.828398+0000","last_peered":"2024-09-10T15:25:36.828398+0000","last_clean":"2024-09-10T15:25:36.828398+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:25:36.828398+0000","last_undegraded":"2024-09-10T15:25:36.828398+0000","last_fullsized":"2024-09-10T15:25:36.828398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049268+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:25:37.049268+0000","last_peered":"2024-09-10T15:25:37.049268+0000","last_clean":"2024-09-10T15:25:37.049268+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:25:37.049268+0000","last_undegraded":"2024-09-10T15:25:37.049268+0000","last_fullsized":"2024-09-10T15:25:37.049268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829020+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:25:36.829020+0000","last_peered":"2024-09-10T15:25:36.829020+0000","last_clean":"2024-09-10T15:25:36.829020+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:25:36.829020+0000","last_undegraded":"2024-09-10T15:25:36.829020+0000","last_fullsized":"2024-09-10T15:25:36.829020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050790+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:25:38.050790+0000","last_peered":"2024-09-10T15:25:38.050790+0000","last_clean":"2024-09-10T15:25:38.050790+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:25:38.050790+0000","last_undegraded":"2024-09-10T15:25:38.050790+0000","last_fullsized":"2024-09-10T15:25:38.050790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047573+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:25:37.047573+0000","last_peered":"2024-09-10T15:25:37.047573+0000","last_clean":"2024-09-10T15:25:37.047573+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:25:37.047573+0000","last_undegraded":"2024-09-10T15:25:37.047573+0000","last_fullsized":"2024-09-10T15:25:37.047573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830706+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:25:36.830706+0000","last_peered":"2024-09-10T15:25:36.830706+0000","last_clean":"2024-09-10T15:25:36.830706+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:25:36.830706+0000","last_undegraded":"2024-09-10T15:25:36.830706+0000","last_fullsized":"2024-09-10T15:25:36.830706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048428+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:25:37.048428+0000","last_peered":"2024-09-10T15:25:37.048428+0000","last_clean":"2024-09-10T15:25:37.048428+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:25:37.048428+0000","last_undegraded":"2024-09-10T15:25:37.048428+0000","last_fullsized":"2024-09-10T15:25:37.048428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833687+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:25:36.833687+0000","last_peered":"2024-09-10T15:25:36.833687+0000","last_clean":"2024-09-10T15:25:36.833687+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:25:36.833687+0000","last_undegraded":"2024-09-10T15:25:36.833687+0000","last_fullsized":"2024-09-10T15:25:36.833687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051559+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:25:38.051559+0000","last_peered":"2024-09-10T15:25:38.051559+0000","last_clean":"2024-09-10T15:25:38.051559+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:25:38.051559+0000","last_undegraded":"2024-09-10T15:25:38.051559+0000","last_fullsized":"2024-09-10T15:25:38.051559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225292+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:25:37.225292+0000","last_peered":"2024-09-10T15:25:37.225292+0000","last_clean":"2024-09-10T15:25:37.225292+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:25:37.225292+0000","last_undegraded":"2024-09-10T15:25:37.225292+0000","last_fullsized":"2024-09-10T15:25:37.225292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047156+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:25:37.047156+0000","last_peered":"2024-09-10T15:25:37.047156+0000","last_clean":"2024-09-10T15:25:37.047156+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:25:37.047156+0000","last_undegraded":"2024-09-10T15:25:37.047156+0000","last_fullsized":"2024-09-10T15:25:37.047156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048608+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:25:37.048608+0000","last_peered":"2024-09-10T15:25:37.048608+0000","last_clean":"2024-09-10T15:25:37.048608+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:25:37.048608+0000","last_undegraded":"2024-09-10T15:25:37.048608+0000","last_fullsized":"2024-09-10T15:25:37.048608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:25:36.828248+0000","last_peered":"2024-09-10T15:25:36.828248+0000","last_clean":"2024-09-10T15:25:36.828248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:25:36.828248+0000","last_undegraded":"2024-09-10T15:25:36.828248+0000","last_fullsized":"2024-09-10T15:25:36.828248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832917+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:25:36.832917+0000","last_peered":"2024-09-10T15:25:36.832917+0000","last_clean":"2024-09-10T15:25:36.832917+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:25:36.832917+0000","last_undegraded":"2024-09-10T15:25:36.832917+0000","last_fullsized":"2024-09-10T15:25:36.832917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":38,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050857+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:25:38.050857+0000","last_peered":"2024-09-10T15:25:38.050857+0000","last_clean":"2024-09-10T15:25:38.050857+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:25:38.050857+0000","last_undegraded":"2024-09-10T15:25:38.050857+0000","last_fullsized":"2024-09-10T15:25:38.050857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047280+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:25:37.047280+0000","last_peered":"2024-09-10T15:25:37.047280+0000","last_clean":"2024-09-10T15:25:37.047280+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:25:37.047280+0000","last_undegraded":"2024-09-10T15:25:37.047280+0000","last_fullsized":"2024-09-10T15:25:37.047280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051560+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:25:38.051560+0000","last_peered":"2024-09-10T15:25:38.051560+0000","last_clean":"2024-09-10T15:25:38.051560+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:25:38.051560+0000","last_undegraded":"2024-09-10T15:25:38.051560+0000","last_fullsized":"2024-09-10T15:25:38.051560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829325+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:25:36.829325+0000","last_peered":"2024-09-10T15:25:36.829325+0000","last_clean":"2024-09-10T15:25:36.829325+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:25:36.829325+0000","last_undegraded":"2024-09-10T15:25:36.829325+0000","last_fullsized":"2024-09-10T15:25:36.829325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053535+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:25:38.053535+0000","last_peered":"2024-09-10T15:25:38.053535+0000","last_clean":"2024-09-10T15:25:38.053535+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:25:38.053535+0000","last_undegraded":"2024-09-10T15:25:38.053535+0000","last_fullsized":"2024-09-10T15:25:38.053535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828494+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:25:36.828494+0000","last_peered":"2024-09-10T15:25:36.828494+0000","last_clean":"2024-09-10T15:25:36.828494+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:25:36.828494+0000","last_undegraded":"2024-09-10T15:25:36.828494+0000","last_fullsized":"2024-09-10T15:25:36.828494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050354+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:25:37.050354+0000","last_peered":"2024-09-10T15:25:37.050354+0000","last_clean":"2024-09-10T15:25:37.050354+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:25:37.050354+0000","last_undegraded":"2024-09-10T15:25:37.050354+0000","last_fullsized":"2024-09-10T15:25:37.050354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048327+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:25:37.048327+0000","last_peered":"2024-09-10T15:25:37.048327+0000","last_clean":"2024-09-10T15:25:37.048327+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:25:37.048327+0000","last_undegraded":"2024-09-10T15:25:37.048327+0000","last_fullsized":"2024-09-10T15:25:37.048327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049083+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:25:37.049083+0000","last_peered":"2024-09-10T15:25:37.049083+0000","last_clean":"2024-09-10T15:25:37.049083+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:25:37.049083+0000","last_undegraded":"2024-09-10T15:25:37.049083+0000","last_fullsized":"2024-09-10T15:25:37.049083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048314+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:25:37.048314+0000","last_peered":"2024-09-10T15:25:37.048314+0000","last_clean":"2024-09-10T15:25:37.048314+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:25:37.048314+0000","last_undegraded":"2024-09-10T15:25:37.048314+0000","last_fullsized":"2024-09-10T15:25:37.048314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832222+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:25:36.832222+0000","last_peered":"2024-09-10T15:25:36.832222+0000","last_clean":"2024-09-10T15:25:36.832222+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:25:36.832222+0000","last_undegraded":"2024-09-10T15:25:36.832222+0000","last_fullsized":"2024-09-10T15:25:36.832222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833279+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:25:36.833279+0000","last_peered":"2024-09-10T15:25:36.833279+0000","last_clean":"2024-09-10T15:25:36.833279+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:25:36.833279+0000","last_undegraded":"2024-09-10T15:25:36.833279+0000","last_fullsized":"2024-09-10T15:25:36.833279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831113+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:25:36.831113+0000","last_peered":"2024-09-10T15:25:36.831113+0000","last_clean":"2024-09-10T15:25:36.831113+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:25:36.831113+0000","last_undegraded":"2024-09-10T15:25:36.831113+0000","last_fullsized":"2024-09-10T15:25:36.831113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226497+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:25:37.226497+0000","last_peered":"2024-09-10T15:25:37.226497+0000","last_clean":"2024-09-10T15:25:37.226497+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:25:37.226497+0000","last_undegraded":"2024-09-10T15:25:37.226497+0000","last_fullsized":"2024-09-10T15:25:37.226497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828521+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:25:36.828521+0000","last_peered":"2024-09-10T15:25:36.828521+0000","last_clean":"2024-09-10T15:25:36.828521+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:25:36.828521+0000","last_undegraded":"2024-09-10T15:25:36.828521+0000","last_fullsized":"2024-09-10T15:25:36.828521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226978+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:25:37.226978+0000","last_peered":"2024-09-10T15:25:37.226978+0000","last_clean":"2024-09-10T15:25:37.226978+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:25:37.226978+0000","last_undegraded":"2024-09-10T15:25:37.226978+0000","last_fullsized":"2024-09-10T15:25:37.226978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225266+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:25:37.225266+0000","last_peered":"2024-09-10T15:25:37.225266+0000","last_clean":"2024-09-10T15:25:37.225266+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:25:37.225266+0000","last_undegraded":"2024-09-10T15:25:37.225266+0000","last_fullsized":"2024-09-10T15:25:37.225266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830405+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:25:36.830405+0000","last_peered":"2024-09-10T15:25:36.830405+0000","last_clean":"2024-09-10T15:25:36.830405+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:25:36.830405+0000","last_undegraded":"2024-09-10T15:25:36.830405+0000","last_fullsized":"2024-09-10T15:25:36.830405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051885+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:25:38.051885+0000","last_peered":"2024-09-10T15:25:38.051885+0000","last_clean":"2024-09-10T15:25:38.051885+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:25:38.051885+0000","last_undegraded":"2024-09-10T15:25:38.051885+0000","last_fullsized":"2024-09-10T15:25:38.051885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832735+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:25:36.832735+0000","last_peered":"2024-09-10T15:25:36.832735+0000","last_clean":"2024-09-10T15:25:36.832735+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:25:36.832735+0000","last_undegraded":"2024-09-10T15:25:36.832735+0000","last_fullsized":"2024-09-10T15:25:36.832735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050125+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:25:37.050125+0000","last_peered":"2024-09-10T15:25:37.050125+0000","last_clean":"2024-09-10T15:25:37.050125+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:25:37.050125+0000","last_undegraded":"2024-09-10T15:25:37.050125+0000","last_fullsized":"2024-09-10T15:25:37.050125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047414+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:25:37.047414+0000","last_peered":"2024-09-10T15:25:37.047414+0000","last_clean":"2024-09-10T15:25:37.047414+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:25:37.047414+0000","last_undegraded":"2024-09-10T15:25:37.047414+0000","last_fullsized":"2024-09-10T15:25:37.047414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829777+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:25:36.829777+0000","last_peered":"2024-09-10T15:25:36.829777+0000","last_clean":"2024-09-10T15:25:36.829777+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:25:36.829777+0000","last_undegraded":"2024-09-10T15:25:36.829777+0000","last_fullsized":"2024-09-10T15:25:36.829777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831183+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:25:36.831183+0000","last_peered":"2024-09-10T15:25:36.831183+0000","last_clean":"2024-09-10T15:25:36.831183+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:25:36.831183+0000","last_undegraded":"2024-09-10T15:25:36.831183+0000","last_fullsized":"2024-09-10T15:25:36.831183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832163+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:25:36.832163+0000","last_peered":"2024-09-10T15:25:36.832163+0000","last_clean":"2024-09-10T15:25:36.832163+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:25:36.832163+0000","last_undegraded":"2024-09-10T15:25:36.832163+0000","last_fullsized":"2024-09-10T15:25:36.832163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054267+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:25:38.054267+0000","last_peered":"2024-09-10T15:25:38.054267+0000","last_clean":"2024-09-10T15:25:38.054267+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:25:38.054267+0000","last_undegraded":"2024-09-10T15:25:38.054267+0000","last_fullsized":"2024-09-10T15:25:38.054267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054797+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:38.054797+0000","last_peered":"2024-09-10T15:25:38.054797+0000","last_clean":"2024-09-10T15:25:38.054797+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:25:38.054797+0000","last_undegraded":"2024-09-10T15:25:38.054797+0000","last_fullsized":"2024-09-10T15:25:38.054797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051796+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:25:38.051796+0000","last_peered":"2024-09-10T15:25:38.051796+0000","last_clean":"2024-09-10T15:25:38.051796+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:25:38.051796+0000","last_undegraded":"2024-09-10T15:25:38.051796+0000","last_fullsized":"2024-09-10T15:25:38.051796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054517+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:25:38.054517+0000","last_peered":"2024-09-10T15:25:38.054517+0000","last_clean":"2024-09-10T15:25:38.054517+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:25:38.054517+0000","last_undegraded":"2024-09-10T15:25:38.054517+0000","last_fullsized":"2024-09-10T15:25:38.054517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829215+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:25:36.829215+0000","last_peered":"2024-09-10T15:25:36.829215+0000","last_clean":"2024-09-10T15:25:36.829215+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:25:36.829215+0000","last_undegraded":"2024-09-10T15:25:36.829215+0000","last_fullsized":"2024-09-10T15:25:36.829215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048749+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:25:37.048749+0000","last_peered":"2024-09-10T15:25:37.048749+0000","last_clean":"2024-09-10T15:25:37.048749+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:25:37.048749+0000","last_undegraded":"2024-09-10T15:25:37.048749+0000","last_fullsized":"2024-09-10T15:25:37.048749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049328+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:25:37.049328+0000","last_peered":"2024-09-10T15:25:37.049328+0000","last_clean":"2024-09-10T15:25:37.049328+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:25:37.049328+0000","last_undegraded":"2024-09-10T15:25:37.049328+0000","last_fullsized":"2024-09-10T15:25:37.049328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051384+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:25:38.051384+0000","last_peered":"2024-09-10T15:25:38.051384+0000","last_clean":"2024-09-10T15:25:38.051384+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:25:38.051384+0000","last_undegraded":"2024-09-10T15:25:38.051384+0000","last_fullsized":"2024-09-10T15:25:38.051384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050522+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:25:37.050522+0000","last_peered":"2024-09-10T15:25:37.050522+0000","last_clean":"2024-09-10T15:25:37.050522+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:25:37.050522+0000","last_undegraded":"2024-09-10T15:25:37.050522+0000","last_fullsized":"2024-09-10T15:25:37.050522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051854+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:25:38.051854+0000","last_peered":"2024-09-10T15:25:38.051854+0000","last_clean":"2024-09-10T15:25:38.051854+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:25:38.051854+0000","last_undegraded":"2024-09-10T15:25:38.051854+0000","last_fullsized":"2024-09-10T15:25:38.051854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049137+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:25:37.049137+0000","last_peered":"2024-09-10T15:25:37.049137+0000","last_clean":"2024-09-10T15:25:37.049137+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:25:37.049137+0000","last_undegraded":"2024-09-10T15:25:37.049137+0000","last_fullsized":"2024-09-10T15:25:37.049137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047329+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:25:37.047329+0000","last_peered":"2024-09-10T15:25:37.047329+0000","last_clean":"2024-09-10T15:25:37.047329+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:25:37.047329+0000","last_undegraded":"2024-09-10T15:25:37.047329+0000","last_fullsized":"2024-09-10T15:25:37.047329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053463+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:25:38.053463+0000","last_peered":"2024-09-10T15:25:38.053463+0000","last_clean":"2024-09-10T15:25:38.053463+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:25:38.053463+0000","last_undegraded":"2024-09-10T15:25:38.053463+0000","last_fullsized":"2024-09-10T15:25:38.053463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830894+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:25:36.830894+0000","last_peered":"2024-09-10T15:25:36.830894+0000","last_clean":"2024-09-10T15:25:36.830894+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:25:36.830894+0000","last_undegraded":"2024-09-10T15:25:36.830894+0000","last_fullsized":"2024-09-10T15:25:36.830894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055250+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:25:38.055250+0000","last_peered":"2024-09-10T15:25:38.055250+0000","last_clean":"2024-09-10T15:25:38.055250+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:25:38.055250+0000","last_undegraded":"2024-09-10T15:25:38.055250+0000","last_fullsized":"2024-09-10T15:25:38.055250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":499712,"data_stored":220435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":503808,"data_stored":221483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1081344,"data_stored":803307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":221620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":495616,"data_stored":220316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":212279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1134592,"data_stored":819521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":213887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:40.007 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T15:25:40.007 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T15:25:40.008 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-10T15:25:40.008 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-10T15:25:40.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:25:40.087 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:40.085+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:40.163 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:40.163 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:40.164 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:40.164 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:40.179 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:40.225 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:40.224+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:40.288 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:40.284+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:40.296 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:40.296 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:40.296 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:40.310 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "epoch": 43, 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "fsid": "4e8f2598-e62a-4186-9762-b22671b00e14", 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "created": "2024-09-10T15:24:44.086812+0000", 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "modified": "2024-09-10T15:25:39.054714+0000", 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "last_up_change": "2024-09-10T15:24:57.289996+0000", 2024-09-10T15:25:40.346 INFO:teuthology.orchestra.run.smithi099.stdout: "last_in_change": "2024-09-10T15:24:46.474296+0000", 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_num": 5804032, 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_set": [ 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nodeep-scrub", 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "pglog_hardlimit", 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "purged_snapdirs", 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "recovery_deletes", 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "sortbitwise" 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_version": 4, 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "full_ratio": 0.94999998807907104, 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-10T15:25:40.347 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_snapshot": "", 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_max": 8, 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "max_osd": 8, 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "require_min_compat_client": "luminous", 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "min_compat_client": "jewel", 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "require_osd_release": "squid", 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "allow_crimson": false, 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "pools": [ 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 1, 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".mgr", 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:24:58.987011+0000", 2024-09-10T15:25:40.348 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.349 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 1, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 1, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 1, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 1, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 1, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "17", 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.350 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.351 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.352 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_max": 32, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_min": 1 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: "mgr": {} 2024-09-10T15:25:40.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 8, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 8, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.25, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 2, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 2, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.354 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 2, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "rbd", 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:02.368798+0000", 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 8193, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.355 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 8, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 8, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 8, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 8, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 8, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "21", 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 2, 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 21, 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.358 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.359 INFO:teuthology.orchestra.run.smithi099.stdout: "options": {}, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "rbd": {} 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 4.9800000190734863, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 4.9800000190734863, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 0.87999999523162842, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 4.380000114440918, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 4.380000114440918, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.360 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 3, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "default.rgw.buckets.data", 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:10.252625+0000", 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.361 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.362 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "25", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.363 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.364 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.365 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "options": {}, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": {} 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.5, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.5, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.5, 2024-09-10T15:25:40.366 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.5, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 4, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "default.rgw.buckets.index", 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:12.200720+0000", 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.367 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 64, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 64, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 64, 2024-09-10T15:25:40.368 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 64, 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 64, 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "27", 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.369 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.370 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.371 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "options": {}, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": {} 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.372 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.1299999952316284, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.1299999952316284, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.1299999952316284, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.1299999952316284, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 5, 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": ".rgw.root", 2024-09-10T15:25:40.373 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:14.120064+0000", 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.374 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.375 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "29", 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.376 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "options": {}, 2024-09-10T15:25:40.378 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": {} 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.75, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.75, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.75, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.75, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.379 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 6, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "default.rgw.log", 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:15.995798+0000", 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.380 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.381 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "31", 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.382 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.383 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.384 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "options": {}, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": {} 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.5, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.5, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.5, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.5, 2024-09-10T15:25:40.385 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 7, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "default.rgw.control", 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:17.927911+0000", 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.386 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.387 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "33", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.388 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.389 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.390 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "options": {}, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": {} 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.5, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.5, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.5, 2024-09-10T15:25:40.391 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.5, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "pool": 8, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_name": "default.rgw.meta", 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "create_time": "2024-09-10T15:25:20.055058+0000", 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flags": 1, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flags_names": "hashpspool", 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type": 1, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 2, 2024-09-10T15:25:40.392 INFO:teuthology.orchestra.run.smithi099.stdout: "min_size": 1, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_rule": 0, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_count": 0, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_target": 0, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_barrier": 0, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "is_stretch_pool": false, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "object_hash": 2, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_mode": "off", 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num": 32, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num": 32, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_placement_num_target": 32, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_target": 32, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_num_pending": 32, 2024-09-10T15:25:40.393 INFO:teuthology.orchestra.run.smithi099.stdout: "last_pg_merge_meta": { 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "source_pgid": "0.0", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "ready_epoch": 0, 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_started": 0, 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "last_epoch_clean": 0, 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "source_version": "0'0", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "target_version": "0'0" 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "last_change": "35", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend": "0", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "last_force_op_resend_preluminous": "0", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "auid": 0, 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_mode": "selfmanaged", 2024-09-10T15:25:40.394 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_seq": 0, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "snap_epoch": 0, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "pool_snaps": [], 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps": "[]", 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_bytes": 0, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "quota_max_objects": 0, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "tiers": [], 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "tier_of": -1, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "read_tier": -1, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "write_tier": -1, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_mode": "none", 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_bytes": 0, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "target_max_objects": 0, 2024-09-10T15:25:40.395 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_flush_age": 0, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "cache_min_evict_age": 0, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profile": "", 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_params": { 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "none" 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_period": 0, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_count": 0, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "use_gmt_hitset": true, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "min_read_recency_for_promote": 0, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "min_write_recency_for_promote": 0, 2024-09-10T15:25:40.396 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_grade_decay_rate": 0, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "hit_set_search_last_n": 0, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "grade_table": [], 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "stripe_width": 0, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "expected_num_objects": 0, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "fast_read": false, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "options": { 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_autoscale_bias": 4 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "application_metadata": { 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "rgw": {} 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "read_balance": { 2024-09-10T15:25:40.397 INFO:teuthology.orchestra.run.smithi099.stdout: "score_type": "Fair distribution", 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "score_acting": 1.5, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "score_stable": 1.5, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "optimal_score": 1, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_acting": 1.5, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "raw_score_stable": 1.5, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity_weighted": 1, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity": 1, 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "average_primary_affinity_weighted": 1 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "osds": [ 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.398 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "81adb850-6bce-4c6a-b91d-d1014dab2114", 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6808", 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6809", 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.400 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6810", 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6811", 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.401 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6814", 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6815", 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.402 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6812", 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6813", 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 2528983694 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.403 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6809/2528983694", 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6811/2528983694", 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6815/2528983694", 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6813/2528983694", 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "266bd277-c43f-45f2-b407-939f7fe60124", 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.404 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6800", 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6801", 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6802", 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6803", 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6806", 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6807", 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6804", 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6805", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 3085897297 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6801/3085897297", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6803/3085897297", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6807/3085897297", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6805/3085897297", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.409 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "8e25e2db-5b96-49e8-84c8-f2c1aec51ca2", 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.410 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6816", 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6817", 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.411 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6818", 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6819", 2024-09-10T15:25:40.412 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6822", 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6823", 2024-09-10T15:25:40.413 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6820", 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6821", 2024-09-10T15:25:40.414 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 4016938445 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6817/4016938445", 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6819/4016938445", 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6823/4016938445", 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6821/4016938445", 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "007bc137-a3a2-40a8-8133-e899cdc6b3d8", 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.416 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6824", 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6825", 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6826", 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6827", 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.418 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6830", 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6831", 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6828", 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.99:6829", 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1667351160 2024-09-10T15:25:40.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.99:6825/1667351160", 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.99:6827/1667351160", 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.99:6831/1667351160", 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.99:6829/1667351160", 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T15:25:40.421 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "7883a376-330f-4123-9d53-b2d16009b55f", 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.422 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6824", 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6825", 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.423 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6826", 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6827", 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.424 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6830", 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6831", 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.425 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6828", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6829", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1728711275 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.159:6825/1728711275", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.159:6827/1728711275", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.159:6831/1728711275", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.159:6829/1728711275", 2024-09-10T15:25:40.426 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8", 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.427 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6800", 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6801", 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.428 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6802", 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6803", 2024-09-10T15:25:40.429 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6806", 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6807", 2024-09-10T15:25:40.430 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6804", 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6805", 2024-09-10T15:25:40.431 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1301853491 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.159:6801/1301853491", 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.159:6803/1301853491", 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.159:6807/1301853491", 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.159:6805/1301853491", 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T15:25:40.432 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "54a77e0e-03c3-44d4-baed-702a89305ed8", 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6816", 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6817", 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6818", 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6819", 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6822", 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6823", 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6820", 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6821", 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 1076897158 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.159:6817/1076897158", 2024-09-10T15:25:40.437 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.159:6819/1076897158", 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.159:6823/1076897158", 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.159:6821/1076897158", 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "uuid": "fd400894-7e05-4aab-8a22-5b2f345ee140", 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "up": 1, 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "in": 1, 2024-09-10T15:25:40.438 INFO:teuthology.orchestra.run.smithi099.stdout: "weight": 1, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_affinity": 1, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_begin": 0, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "last_clean_end": 0, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "up_from": 13, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "up_thru": 33, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "down_at": 0, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "lost_at": 0, 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addrs": { 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6808", 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6809", 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addrs": { 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6810", 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6811", 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addrs": { 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6814", 2024-09-10T15:25:40.441 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6815", 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addrs": { 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "addrvec": [ 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v2", 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6812", 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "v1", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "addr": "172.21.15.159:6813", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "nonce": 989502281 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "public_addr": "172.21.15.159:6809/989502281", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "cluster_addr": "172.21.15.159:6811/989502281", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_back_addr": "172.21.15.159:6815/989502281", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "heartbeat_front_addr": "172.21.15.159:6813/989502281", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "state": [ 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "exists", 2024-09-10T15:25:40.443 INFO:teuthology.orchestra.run.smithi099.stdout: "up" 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "osd_xinfo": [ 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 0, 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.432506+0000", 2024-09-10T15:25:40.444 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 1, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.341537+0000", 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 2, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.717485+0000", 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 3, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.446 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.180863+0000", 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 4, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.655023+0000", 2024-09-10T15:25:40.447 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 5, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.691365+0000", 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.448 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 6, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:54.099394+0000", 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "osd": 7, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "down_stamp": "0.000000", 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_probability": 0, 2024-09-10T15:25:40.449 INFO:teuthology.orchestra.run.smithi099.stdout: "laggy_interval": 0, 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "features": 4540701547738038271, 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "old_weight": 0, 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "last_purged_snaps_scrub": "2024-09-10T15:24:53.913170+0000", 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "dead_epoch": 0 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap": [], 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_items": [], 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_upmap_primaries": [], 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "pg_temp": [], 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "primary_temp": [], 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "blocklist": {}, 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "range_blocklist": {}, 2024-09-10T15:25:40.450 INFO:teuthology.orchestra.run.smithi099.stdout: "erasure_code_profiles": { 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "default": { 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "crush-failure-domain": "osd", 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "k": "2", 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "m": "1", 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "plugin": "jerasure", 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "technique": "reed_sol_van" 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "removed_snaps_queue": [], 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "new_removed_snaps": [], 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "new_purged_snaps": [], 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "crush_node_flags": {}, 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "device_class_flags": {}, 2024-09-10T15:25:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode": { 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_enabled": false, 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_bucket_count": 0, 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout: "degraded_stretch_mode": 0, 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout: "recovering_stretch_mode": 0, 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout: "stretch_mode_bucket": 0 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.452 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:40.454 INFO:tasks.thrashosds.thrasher:j is {'epoch': 43, 'fsid': '4e8f2598-e62a-4186-9762-b22671b00e14', 'created': '2024-09-10T15:24:44.086812+0000', 'modified': '2024-09-10T15:25:39.054714+0000', 'last_up_change': '2024-09-10T15:24:57.289996+0000', 'last_in_change': '2024-09-10T15:24:46.474296+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T15:24:58.987011+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-10T15:25:02.368798+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 21, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-09-10T15:25:10.252625+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-09-10T15:25:12.200720+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-09-10T15:25:14.120064+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '29', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-09-10T15:25:15.995798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-09-10T15:25:17.927911+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-09-10T15:25:20.055058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '81adb850-6bce-4c6a-b91d-d1014dab2114', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6808', 'nonce': 2528983694}, {'type': 'v1', 'addr': '172.21.15.99:6809', 'nonce': 2528983694}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6810', 'nonce': 2528983694}, {'type': 'v1', 'addr': '172.21.15.99:6811', 'nonce': 2528983694}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6814', 'nonce': 2528983694}, {'type': 'v1', 'addr': '172.21.15.99:6815', 'nonce': 2528983694}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6812', 'nonce': 2528983694}, {'type': 'v1', 'addr': '172.21.15.99:6813', 'nonce': 2528983694}]}, 'public_addr': '172.21.15.99:6809/2528983694', 'cluster_addr': '172.21.15.99:6811/2528983694', 'heartbeat_back_addr': '172.21.15.99:6815/2528983694', 'heartbeat_front_addr': '172.21.15.99:6813/2528983694', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '266bd277-c43f-45f2-b407-939f7fe60124', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6800', 'nonce': 3085897297}, {'type': 'v1', 'addr': '172.21.15.99:6801', 'nonce': 3085897297}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6802', 'nonce': 3085897297}, {'type': 'v1', 'addr': '172.21.15.99:6803', 'nonce': 3085897297}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6806', 'nonce': 3085897297}, {'type': 'v1', 'addr': '172.21.15.99:6807', 'nonce': 3085897297}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6804', 'nonce': 3085897297}, {'type': 'v1', 'addr': '172.21.15.99:6805', 'nonce': 3085897297}]}, 'public_addr': '172.21.15.99:6801/3085897297', 'cluster_addr': '172.21.15.99:6803/3085897297', 'heartbeat_back_addr': '172.21.15.99:6807/3085897297', 'heartbeat_front_addr': '172.21.15.99:6805/3085897297', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '8e25e2db-5b96-49e8-84c8-f2c1aec51ca2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6816', 'nonce': 4016938445}, {'type': 'v1', 'addr': '172.21.15.99:6817', 'nonce': 4016938445}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6818', 'nonce': 4016938445}, {'type': 'v1', 'addr': '172.21.15.99:6819', 'nonce': 4016938445}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6822', 'nonce': 4016938445}, {'type': 'v1', 'addr': '172.21.15.99:6823', 'nonce': 4016938445}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6820', 'nonce': 4016938445}, {'type': 'v1', 'addr': '172.21.15.99:6821', 'nonce': 4016938445}]}, 'public_addr': '172.21.15.99:6817/4016938445', 'cluster_addr': '172.21.15.99:6819/4016938445', 'heartbeat_back_addr': '172.21.15.99:6823/4016938445', 'heartbeat_front_addr': '172.21.15.99:6821/4016938445', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '007bc137-a3a2-40a8-8133-e899cdc6b3d8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6824', 'nonce': 1667351160}, {'type': 'v1', 'addr': '172.21.15.99:6825', 'nonce': 1667351160}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6826', 'nonce': 1667351160}, {'type': 'v1', 'addr': '172.21.15.99:6827', 'nonce': 1667351160}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6830', 'nonce': 1667351160}, {'type': 'v1', 'addr': '172.21.15.99:6831', 'nonce': 1667351160}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.99:6828', 'nonce': 1667351160}, {'type': 'v1', 'addr': '172.21.15.99:6829', 'nonce': 1667351160}]}, 'public_addr': '172.21.15.99:6825/1667351160', 'cluster_addr': '172.21.15.99:6827/1667351160', 'heartbeat_back_addr': '172.21.15.99:6831/1667351160', 'heartbeat_front_addr': '172.21.15.99:6829/1667351160', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '7883a376-330f-4123-9d53-b2d16009b55f', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6824', 'nonce': 1728711275}, {'type': 'v1', 'addr': '172.21.15.159:6825', 'nonce': 1728711275}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6826', 'nonce': 1728711275}, {'type': 'v1', 'addr': '172.21.15.159:6827', 'nonce': 1728711275}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6830', 'nonce': 1728711275}, {'type': 'v1', 'addr': '172.21.15.159:6831', 'nonce': 1728711275}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6828', 'nonce': 1728711275}, {'type': 'v1', 'addr': '172.21.15.159:6829', 'nonce': 1728711275}]}, 'public_addr': '172.21.15.159:6825/1728711275', 'cluster_addr': '172.21.15.159:6827/1728711275', 'heartbeat_back_addr': '172.21.15.159:6831/1728711275', 'heartbeat_front_addr': '172.21.15.159:6829/1728711275', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6800', 'nonce': 1301853491}, {'type': 'v1', 'addr': '172.21.15.159:6801', 'nonce': 1301853491}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6802', 'nonce': 1301853491}, {'type': 'v1', 'addr': '172.21.15.159:6803', 'nonce': 1301853491}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6806', 'nonce': 1301853491}, {'type': 'v1', 'addr': '172.21.15.159:6807', 'nonce': 1301853491}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6804', 'nonce': 1301853491}, {'type': 'v1', 'addr': '172.21.15.159:6805', 'nonce': 1301853491}]}, 'public_addr': '172.21.15.159:6801/1301853491', 'cluster_addr': '172.21.15.159:6803/1301853491', 'heartbeat_back_addr': '172.21.15.159:6807/1301853491', 'heartbeat_front_addr': '172.21.15.159:6805/1301853491', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '54a77e0e-03c3-44d4-baed-702a89305ed8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6816', 'nonce': 1076897158}, {'type': 'v1', 'addr': '172.21.15.159:6817', 'nonce': 1076897158}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6818', 'nonce': 1076897158}, {'type': 'v1', 'addr': '172.21.15.159:6819', 'nonce': 1076897158}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6822', 'nonce': 1076897158}, {'type': 'v1', 'addr': '172.21.15.159:6823', 'nonce': 1076897158}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6820', 'nonce': 1076897158}, {'type': 'v1', 'addr': '172.21.15.159:6821', 'nonce': 1076897158}]}, 'public_addr': '172.21.15.159:6817/1076897158', 'cluster_addr': '172.21.15.159:6819/1076897158', 'heartbeat_back_addr': '172.21.15.159:6823/1076897158', 'heartbeat_front_addr': '172.21.15.159:6821/1076897158', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'fd400894-7e05-4aab-8a22-5b2f345ee140', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 33, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6808', 'nonce': 989502281}, {'type': 'v1', 'addr': '172.21.15.159:6809', 'nonce': 989502281}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6810', 'nonce': 989502281}, {'type': 'v1', 'addr': '172.21.15.159:6811', 'nonce': 989502281}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6814', 'nonce': 989502281}, {'type': 'v1', 'addr': '172.21.15.159:6815', 'nonce': 989502281}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6812', 'nonce': 989502281}, {'type': 'v1', 'addr': '172.21.15.159:6813', 'nonce': 989502281}]}, 'public_addr': '172.21.15.159:6809/989502281', 'cluster_addr': '172.21.15.159:6811/989502281', 'heartbeat_back_addr': '172.21.15.159:6815/989502281', 'heartbeat_front_addr': '172.21.15.159:6813/989502281', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.432506+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.341537+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.717485+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.180863+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.655023+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.691365+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:54.099394+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-10T15:24:53.913170+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-10T15:25:40.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:25:40.455 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:40.452+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:40.480 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:40.554 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:40.553+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:40.584 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:40.584 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:40.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:40.584 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:40.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.238950897000002, 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:25:40.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:25:40.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:25:40.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:25:40.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.591 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.871272343999998, 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:25:40.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:25:40.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.871055716000001, 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.598 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:25:40.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:25:40.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.870978442999998, 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:25:40.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:25:40.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.772972770000003, 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.610 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:25:40.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.615 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.600429968, 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.616 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:40.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:25:40.621 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.600315289000001, 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.622 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:25:40.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:25:40.627 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.600030582000002, 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.628 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:25:40.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:25:40.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.633 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.599935494999997, 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.634 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:25:40.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.639 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.599497405999998, 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.640 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:25:40.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.645 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.599433593000001, 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.646 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:25:40.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.651 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.599346449999999, 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.652 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:25:40.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:25:40.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.599139624999999, 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.658 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:25:40.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:25:40.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.599070955999998, 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.664 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:25:40.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:25:40.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:25:40.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.669 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.111480561, 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.670 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:25:40.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.675 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.111430229, 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.676 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:25:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.111228509999997, 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.682 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:25:40.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.111194003999998, 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.688 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:25:40.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:25:40.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:25:40.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.111147037000002, 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.694 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:25:40.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:25:40.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.110893216000001, 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:40.700 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:40.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:25:40.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:40.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:40.706 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:40.707 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:40.708 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:40.708 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:40.709 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:40.709 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:40.709 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:40.709 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:40.710 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:40.710 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:40.710 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:40.704+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:40.710 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:40.711 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:40.731 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:40.731 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:40.752 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:40.753 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:40.774 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:40.774 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:40.808 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:40.809+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:40.827 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:40.828 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:40.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:40.846 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:25:40.859 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:25:40.867 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-10T15:25:39.062234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225516,"kb_used_data":5080,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749204,"statfs":{"total":773094113280,"available":772863184896,"internally_reserved":0,"allocated":5201920,"data_stored":2932848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":225496628},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038392"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830838+0000","last_change":"2024-09-10T15:25:11.842625+0000","last_active":"2024-09-10T15:25:36.830838+0000","last_peered":"2024-09-10T15:25:36.830838+0000","last_clean":"2024-09-10T15:25:36.830838+0000","last_became_active":"2024-09-10T15:25:11.842298+0000","last_became_peered":"2024-09-10T15:25:11.842298+0000","last_unstale":"2024-09-10T15:25:36.830838+0000","last_undegraded":"2024-09-10T15:25:36.830838+0000","last_fullsized":"2024-09-10T15:25:36.830838+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051661+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:25:38.051661+0000","last_peered":"2024-09-10T15:25:38.051661+0000","last_clean":"2024-09-10T15:25:38.051661+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:25:38.051661+0000","last_undegraded":"2024-09-10T15:25:38.051661+0000","last_fullsized":"2024-09-10T15:25:38.051661+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833453+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:25:36.833453+0000","last_peered":"2024-09-10T15:25:36.833453+0000","last_clean":"2024-09-10T15:25:36.833453+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:25:36.833453+0000","last_undegraded":"2024-09-10T15:25:36.833453+0000","last_fullsized":"2024-09-10T15:25:36.833453+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047754+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:25:37.047754+0000","last_peered":"2024-09-10T15:25:37.047754+0000","last_clean":"2024-09-10T15:25:37.047754+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:25:37.047754+0000","last_undegraded":"2024-09-10T15:25:37.047754+0000","last_fullsized":"2024-09-10T15:25:37.047754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832429+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:25:36.832429+0000","last_peered":"2024-09-10T15:25:36.832429+0000","last_clean":"2024-09-10T15:25:36.832429+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:25:36.832429+0000","last_undegraded":"2024-09-10T15:25:36.832429+0000","last_fullsized":"2024-09-10T15:25:36.832429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048164+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:25:37.048164+0000","last_peered":"2024-09-10T15:25:37.048164+0000","last_clean":"2024-09-10T15:25:37.048164+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:25:37.048164+0000","last_undegraded":"2024-09-10T15:25:37.048164+0000","last_fullsized":"2024-09-10T15:25:37.048164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830207+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:25:36.830207+0000","last_peered":"2024-09-10T15:25:36.830207+0000","last_clean":"2024-09-10T15:25:36.830207+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:25:36.830207+0000","last_undegraded":"2024-09-10T15:25:36.830207+0000","last_fullsized":"2024-09-10T15:25:36.830207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051926+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:25:38.051926+0000","last_peered":"2024-09-10T15:25:38.051926+0000","last_clean":"2024-09-10T15:25:38.051926+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:25:38.051926+0000","last_undegraded":"2024-09-10T15:25:38.051926+0000","last_fullsized":"2024-09-10T15:25:38.051926+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830075+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:25:36.830075+0000","last_peered":"2024-09-10T15:25:36.830075+0000","last_clean":"2024-09-10T15:25:36.830075+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:25:36.830075+0000","last_undegraded":"2024-09-10T15:25:36.830075+0000","last_fullsized":"2024-09-10T15:25:36.830075+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828767+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:25:36.828767+0000","last_peered":"2024-09-10T15:25:36.828767+0000","last_clean":"2024-09-10T15:25:36.828767+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:25:36.828767+0000","last_undegraded":"2024-09-10T15:25:36.828767+0000","last_fullsized":"2024-09-10T15:25:36.828767+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828946+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:25:36.828946+0000","last_peered":"2024-09-10T15:25:36.828946+0000","last_clean":"2024-09-10T15:25:36.828946+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:25:36.828946+0000","last_undegraded":"2024-09-10T15:25:36.828946+0000","last_fullsized":"2024-09-10T15:25:36.828946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830278+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:25:36.830278+0000","last_peered":"2024-09-10T15:25:36.830278+0000","last_clean":"2024-09-10T15:25:36.830278+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:25:36.830278+0000","last_undegraded":"2024-09-10T15:25:36.830278+0000","last_fullsized":"2024-09-10T15:25:36.830278+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831240+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:25:36.831240+0000","last_peered":"2024-09-10T15:25:36.831240+0000","last_clean":"2024-09-10T15:25:36.831240+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:25:36.831240+0000","last_undegraded":"2024-09-10T15:25:36.831240+0000","last_fullsized":"2024-09-10T15:25:36.831240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830212+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:25:36.830212+0000","last_peered":"2024-09-10T15:25:36.830212+0000","last_clean":"2024-09-10T15:25:36.830212+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:25:36.830212+0000","last_undegraded":"2024-09-10T15:25:36.830212+0000","last_fullsized":"2024-09-10T15:25:36.830212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830404+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:25:36.830404+0000","last_peered":"2024-09-10T15:25:36.830404+0000","last_clean":"2024-09-10T15:25:36.830404+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:25:36.830404+0000","last_undegraded":"2024-09-10T15:25:36.830404+0000","last_fullsized":"2024-09-10T15:25:36.830404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833031+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:25:36.833031+0000","last_peered":"2024-09-10T15:25:36.833031+0000","last_clean":"2024-09-10T15:25:36.833031+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:25:36.833031+0000","last_undegraded":"2024-09-10T15:25:36.833031+0000","last_fullsized":"2024-09-10T15:25:36.833031+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047192+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:25:37.047192+0000","last_peered":"2024-09-10T15:25:37.047192+0000","last_clean":"2024-09-10T15:25:37.047192+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:25:37.047192+0000","last_undegraded":"2024-09-10T15:25:37.047192+0000","last_fullsized":"2024-09-10T15:25:37.047192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055570+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:25:38.055570+0000","last_peered":"2024-09-10T15:25:38.055570+0000","last_clean":"2024-09-10T15:25:38.055570+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:25:38.055570+0000","last_undegraded":"2024-09-10T15:25:38.055570+0000","last_fullsized":"2024-09-10T15:25:38.055570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830824+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:25:36.830824+0000","last_peered":"2024-09-10T15:25:36.830824+0000","last_clean":"2024-09-10T15:25:36.830824+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:25:36.830824+0000","last_undegraded":"2024-09-10T15:25:36.830824+0000","last_fullsized":"2024-09-10T15:25:36.830824+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830051+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:25:36.830051+0000","last_peered":"2024-09-10T15:25:36.830051+0000","last_clean":"2024-09-10T15:25:36.830051+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:25:36.830051+0000","last_undegraded":"2024-09-10T15:25:36.830051+0000","last_fullsized":"2024-09-10T15:25:36.830051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054234+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:25:38.054234+0000","last_peered":"2024-09-10T15:25:38.054234+0000","last_clean":"2024-09-10T15:25:38.054234+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:25:38.054234+0000","last_undegraded":"2024-09-10T15:25:38.054234+0000","last_fullsized":"2024-09-10T15:25:38.054234+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830460+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:25:36.830460+0000","last_peered":"2024-09-10T15:25:36.830460+0000","last_clean":"2024-09-10T15:25:36.830460+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:25:36.830460+0000","last_undegraded":"2024-09-10T15:25:36.830460+0000","last_fullsized":"2024-09-10T15:25:36.830460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225345+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:25:37.225345+0000","last_peered":"2024-09-10T15:25:37.225345+0000","last_clean":"2024-09-10T15:25:37.225345+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:25:37.225345+0000","last_undegraded":"2024-09-10T15:25:37.225345+0000","last_fullsized":"2024-09-10T15:25:37.225345+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828998+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:25:36.828998+0000","last_peered":"2024-09-10T15:25:36.828998+0000","last_clean":"2024-09-10T15:25:36.828998+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:25:36.828998+0000","last_undegraded":"2024-09-10T15:25:36.828998+0000","last_fullsized":"2024-09-10T15:25:36.828998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831513+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:25:36.831513+0000","last_peered":"2024-09-10T15:25:36.831513+0000","last_clean":"2024-09-10T15:25:36.831513+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:25:36.831513+0000","last_undegraded":"2024-09-10T15:25:36.831513+0000","last_fullsized":"2024-09-10T15:25:36.831513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226198+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:25:37.226198+0000","last_peered":"2024-09-10T15:25:37.226198+0000","last_clean":"2024-09-10T15:25:37.226198+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:25:37.226198+0000","last_undegraded":"2024-09-10T15:25:37.226198+0000","last_fullsized":"2024-09-10T15:25:37.226198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055575+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:25:38.055575+0000","last_peered":"2024-09-10T15:25:38.055575+0000","last_clean":"2024-09-10T15:25:38.055575+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:25:38.055575+0000","last_undegraded":"2024-09-10T15:25:38.055575+0000","last_fullsized":"2024-09-10T15:25:38.055575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225301+0000","last_change":"2024-09-10T15:25:11.843256+0000","last_active":"2024-09-10T15:25:37.225301+0000","last_peered":"2024-09-10T15:25:37.225301+0000","last_clean":"2024-09-10T15:25:37.225301+0000","last_became_active":"2024-09-10T15:25:11.842370+0000","last_became_peered":"2024-09-10T15:25:11.842370+0000","last_unstale":"2024-09-10T15:25:37.225301+0000","last_undegraded":"2024-09-10T15:25:37.225301+0000","last_fullsized":"2024-09-10T15:25:37.225301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.827698+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:25:36.827698+0000","last_peered":"2024-09-10T15:25:36.827698+0000","last_clean":"2024-09-10T15:25:36.827698+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:25:36.827698+0000","last_undegraded":"2024-09-10T15:25:36.827698+0000","last_fullsized":"2024-09-10T15:25:36.827698+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226099+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:25:37.226099+0000","last_peered":"2024-09-10T15:25:37.226099+0000","last_clean":"2024-09-10T15:25:37.226099+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:25:37.226099+0000","last_undegraded":"2024-09-10T15:25:37.226099+0000","last_fullsized":"2024-09-10T15:25:37.226099+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048405+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:25:37.048405+0000","last_peered":"2024-09-10T15:25:37.048405+0000","last_clean":"2024-09-10T15:25:37.048405+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:25:37.048405+0000","last_undegraded":"2024-09-10T15:25:37.048405+0000","last_fullsized":"2024-09-10T15:25:37.048405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049560+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:25:37.049560+0000","last_peered":"2024-09-10T15:25:37.049560+0000","last_clean":"2024-09-10T15:25:37.049560+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:25:37.049560+0000","last_undegraded":"2024-09-10T15:25:37.049560+0000","last_fullsized":"2024-09-10T15:25:37.049560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051916+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:25:38.051916+0000","last_peered":"2024-09-10T15:25:38.051916+0000","last_clean":"2024-09-10T15:25:38.051916+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:25:38.051916+0000","last_undegraded":"2024-09-10T15:25:38.051916+0000","last_fullsized":"2024-09-10T15:25:38.051916+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055087+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:25:38.055087+0000","last_peered":"2024-09-10T15:25:38.055087+0000","last_clean":"2024-09-10T15:25:38.055087+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:25:38.055087+0000","last_undegraded":"2024-09-10T15:25:38.055087+0000","last_fullsized":"2024-09-10T15:25:38.055087+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051975+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:25:38.051975+0000","last_peered":"2024-09-10T15:25:38.051975+0000","last_clean":"2024-09-10T15:25:38.051975+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:25:38.051975+0000","last_undegraded":"2024-09-10T15:25:38.051975+0000","last_fullsized":"2024-09-10T15:25:38.051975+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049374+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:25:37.049374+0000","last_peered":"2024-09-10T15:25:37.049374+0000","last_clean":"2024-09-10T15:25:37.049374+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:25:37.049374+0000","last_undegraded":"2024-09-10T15:25:37.049374+0000","last_fullsized":"2024-09-10T15:25:37.049374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225623+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:25:37.225623+0000","last_peered":"2024-09-10T15:25:37.225623+0000","last_clean":"2024-09-10T15:25:37.225623+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:25:37.225623+0000","last_undegraded":"2024-09-10T15:25:37.225623+0000","last_fullsized":"2024-09-10T15:25:37.225623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052090+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:25:38.052090+0000","last_peered":"2024-09-10T15:25:38.052090+0000","last_clean":"2024-09-10T15:25:38.052090+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:25:38.052090+0000","last_undegraded":"2024-09-10T15:25:38.052090+0000","last_fullsized":"2024-09-10T15:25:38.052090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055130+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:25:38.055130+0000","last_peered":"2024-09-10T15:25:38.055130+0000","last_clean":"2024-09-10T15:25:38.055130+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:25:38.055130+0000","last_undegraded":"2024-09-10T15:25:38.055130+0000","last_fullsized":"2024-09-10T15:25:38.055130+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054806+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:25:38.054806+0000","last_peered":"2024-09-10T15:25:38.054806+0000","last_clean":"2024-09-10T15:25:38.054806+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:25:38.054806+0000","last_undegraded":"2024-09-10T15:25:38.054806+0000","last_fullsized":"2024-09-10T15:25:38.054806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224744+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:25:37.224744+0000","last_peered":"2024-09-10T15:25:37.224744+0000","last_clean":"2024-09-10T15:25:37.224744+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:25:37.224744+0000","last_undegraded":"2024-09-10T15:25:37.224744+0000","last_fullsized":"2024-09-10T15:25:37.224744+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831945+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:25:36.831945+0000","last_peered":"2024-09-10T15:25:36.831945+0000","last_clean":"2024-09-10T15:25:36.831945+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:25:36.831945+0000","last_undegraded":"2024-09-10T15:25:36.831945+0000","last_fullsized":"2024-09-10T15:25:36.831945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047894+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:25:37.047894+0000","last_peered":"2024-09-10T15:25:37.047894+0000","last_clean":"2024-09-10T15:25:37.047894+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:25:37.047894+0000","last_undegraded":"2024-09-10T15:25:37.047894+0000","last_fullsized":"2024-09-10T15:25:37.047894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053275+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:25:38.053275+0000","last_peered":"2024-09-10T15:25:38.053275+0000","last_clean":"2024-09-10T15:25:38.053275+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:25:38.053275+0000","last_undegraded":"2024-09-10T15:25:38.053275+0000","last_fullsized":"2024-09-10T15:25:38.053275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":48,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051676+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:25:38.051676+0000","last_peered":"2024-09-10T15:25:38.051676+0000","last_clean":"2024-09-10T15:25:38.051676+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:25:38.051676+0000","last_undegraded":"2024-09-10T15:25:38.051676+0000","last_fullsized":"2024-09-10T15:25:38.051676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"32'2","reported_seq":34,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049605+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:25:37.049605+0000","last_peered":"2024-09-10T15:25:37.049605+0000","last_clean":"2024-09-10T15:25:37.049605+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:25:37.049605+0000","last_undegraded":"2024-09-10T15:25:37.049605+0000","last_fullsized":"2024-09-10T15:25:37.049605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828628+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:25:36.828628+0000","last_peered":"2024-09-10T15:25:36.828628+0000","last_clean":"2024-09-10T15:25:36.828628+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:25:36.828628+0000","last_undegraded":"2024-09-10T15:25:36.828628+0000","last_fullsized":"2024-09-10T15:25:36.828628+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832622+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:25:36.832622+0000","last_peered":"2024-09-10T15:25:36.832622+0000","last_clean":"2024-09-10T15:25:36.832622+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:25:36.832622+0000","last_undegraded":"2024-09-10T15:25:36.832622+0000","last_fullsized":"2024-09-10T15:25:36.832622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051970+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:25:38.051970+0000","last_peered":"2024-09-10T15:25:38.051970+0000","last_clean":"2024-09-10T15:25:38.051970+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:25:38.051970+0000","last_undegraded":"2024-09-10T15:25:38.051970+0000","last_fullsized":"2024-09-10T15:25:38.051970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048684+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:25:37.048684+0000","last_peered":"2024-09-10T15:25:37.048684+0000","last_clean":"2024-09-10T15:25:37.048684+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:25:37.048684+0000","last_undegraded":"2024-09-10T15:25:37.048684+0000","last_fullsized":"2024-09-10T15:25:37.048684+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"35'9","reported_seq":46,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829673+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:25:36.829673+0000","last_peered":"2024-09-10T15:25:36.829673+0000","last_clean":"2024-09-10T15:25:36.829673+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:25:36.829673+0000","last_undegraded":"2024-09-10T15:25:36.829673+0000","last_fullsized":"2024-09-10T15:25:36.829673+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832170+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:25:36.832170+0000","last_peered":"2024-09-10T15:25:36.832170+0000","last_clean":"2024-09-10T15:25:36.832170+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:25:36.832170+0000","last_undegraded":"2024-09-10T15:25:36.832170+0000","last_fullsized":"2024-09-10T15:25:36.832170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047282+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:25:37.047282+0000","last_peered":"2024-09-10T15:25:37.047282+0000","last_clean":"2024-09-10T15:25:37.047282+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:25:37.047282+0000","last_undegraded":"2024-09-10T15:25:37.047282+0000","last_fullsized":"2024-09-10T15:25:37.047282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830961+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:25:36.830961+0000","last_peered":"2024-09-10T15:25:36.830961+0000","last_clean":"2024-09-10T15:25:36.830961+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:25:36.830961+0000","last_undegraded":"2024-09-10T15:25:36.830961+0000","last_fullsized":"2024-09-10T15:25:36.830961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052911+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:25:38.052911+0000","last_peered":"2024-09-10T15:25:38.052911+0000","last_clean":"2024-09-10T15:25:38.052911+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:25:38.052911+0000","last_undegraded":"2024-09-10T15:25:38.052911+0000","last_fullsized":"2024-09-10T15:25:38.052911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"35'19","reported_seq":60,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828471+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:25:36.828471+0000","last_peered":"2024-09-10T15:25:36.828471+0000","last_clean":"2024-09-10T15:25:36.828471+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:25:36.828471+0000","last_undegraded":"2024-09-10T15:25:36.828471+0000","last_fullsized":"2024-09-10T15:25:36.828471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225038+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:25:37.225038+0000","last_peered":"2024-09-10T15:25:37.225038+0000","last_clean":"2024-09-10T15:25:37.225038+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:25:37.225038+0000","last_undegraded":"2024-09-10T15:25:37.225038+0000","last_fullsized":"2024-09-10T15:25:37.225038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829775+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:25:36.829775+0000","last_peered":"2024-09-10T15:25:36.829775+0000","last_clean":"2024-09-10T15:25:36.829775+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:25:36.829775+0000","last_undegraded":"2024-09-10T15:25:36.829775+0000","last_fullsized":"2024-09-10T15:25:36.829775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053253+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:25:38.053253+0000","last_peered":"2024-09-10T15:25:38.053253+0000","last_clean":"2024-09-10T15:25:38.053253+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:25:38.053253+0000","last_undegraded":"2024-09-10T15:25:38.053253+0000","last_fullsized":"2024-09-10T15:25:38.053253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830561+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:25:36.830561+0000","last_peered":"2024-09-10T15:25:36.830561+0000","last_clean":"2024-09-10T15:25:36.830561+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:25:36.830561+0000","last_undegraded":"2024-09-10T15:25:36.830561+0000","last_fullsized":"2024-09-10T15:25:36.830561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224446+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:25:37.224446+0000","last_peered":"2024-09-10T15:25:37.224446+0000","last_clean":"2024-09-10T15:25:37.224446+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:25:37.224446+0000","last_undegraded":"2024-09-10T15:25:37.224446+0000","last_fullsized":"2024-09-10T15:25:37.224446+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051073+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:25:38.051073+0000","last_peered":"2024-09-10T15:25:38.051073+0000","last_clean":"2024-09-10T15:25:38.051073+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:25:38.051073+0000","last_undegraded":"2024-09-10T15:25:38.051073+0000","last_fullsized":"2024-09-10T15:25:38.051073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050762+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:25:38.050762+0000","last_peered":"2024-09-10T15:25:38.050762+0000","last_clean":"2024-09-10T15:25:38.050762+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:25:38.050762+0000","last_undegraded":"2024-09-10T15:25:38.050762+0000","last_fullsized":"2024-09-10T15:25:38.050762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054796+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:25:38.054796+0000","last_peered":"2024-09-10T15:25:38.054796+0000","last_clean":"2024-09-10T15:25:38.054796+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:25:38.054796+0000","last_undegraded":"2024-09-10T15:25:38.054796+0000","last_fullsized":"2024-09-10T15:25:38.054796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828479+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:25:36.828479+0000","last_peered":"2024-09-10T15:25:36.828479+0000","last_clean":"2024-09-10T15:25:36.828479+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:25:36.828479+0000","last_undegraded":"2024-09-10T15:25:36.828479+0000","last_fullsized":"2024-09-10T15:25:36.828479+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049164+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:25:37.049164+0000","last_peered":"2024-09-10T15:25:37.049164+0000","last_clean":"2024-09-10T15:25:37.049164+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:25:37.049164+0000","last_undegraded":"2024-09-10T15:25:37.049164+0000","last_fullsized":"2024-09-10T15:25:37.049164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830512+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:25:36.830512+0000","last_peered":"2024-09-10T15:25:36.830512+0000","last_clean":"2024-09-10T15:25:36.830512+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:25:36.830512+0000","last_undegraded":"2024-09-10T15:25:36.830512+0000","last_fullsized":"2024-09-10T15:25:36.830512+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047046+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:25:37.047046+0000","last_peered":"2024-09-10T15:25:37.047046+0000","last_clean":"2024-09-10T15:25:37.047046+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:25:37.047046+0000","last_undegraded":"2024-09-10T15:25:37.047046+0000","last_fullsized":"2024-09-10T15:25:37.047046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830360+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:25:36.830360+0000","last_peered":"2024-09-10T15:25:36.830360+0000","last_clean":"2024-09-10T15:25:36.830360+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:25:36.830360+0000","last_undegraded":"2024-09-10T15:25:36.830360+0000","last_fullsized":"2024-09-10T15:25:36.830360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225994+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:25:37.225994+0000","last_peered":"2024-09-10T15:25:37.225994+0000","last_clean":"2024-09-10T15:25:37.225994+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:25:37.225994+0000","last_undegraded":"2024-09-10T15:25:37.225994+0000","last_fullsized":"2024-09-10T15:25:37.225994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832750+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:25:36.832750+0000","last_peered":"2024-09-10T15:25:36.832750+0000","last_clean":"2024-09-10T15:25:36.832750+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:25:36.832750+0000","last_undegraded":"2024-09-10T15:25:36.832750+0000","last_fullsized":"2024-09-10T15:25:36.832750+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829460+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:25:36.829460+0000","last_peered":"2024-09-10T15:25:36.829460+0000","last_clean":"2024-09-10T15:25:36.829460+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:25:36.829460+0000","last_undegraded":"2024-09-10T15:25:36.829460+0000","last_fullsized":"2024-09-10T15:25:36.829460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224939+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:25:37.224939+0000","last_peered":"2024-09-10T15:25:37.224939+0000","last_clean":"2024-09-10T15:25:37.224939+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:25:37.224939+0000","last_undegraded":"2024-09-10T15:25:37.224939+0000","last_fullsized":"2024-09-10T15:25:37.224939+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"35'12","reported_seq":56,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050569+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:25:38.050569+0000","last_peered":"2024-09-10T15:25:38.050569+0000","last_clean":"2024-09-10T15:25:38.050569+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:25:38.050569+0000","last_undegraded":"2024-09-10T15:25:38.050569+0000","last_fullsized":"2024-09-10T15:25:38.050569+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831104+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:25:36.831104+0000","last_peered":"2024-09-10T15:25:36.831104+0000","last_clean":"2024-09-10T15:25:36.831104+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:25:36.831104+0000","last_undegraded":"2024-09-10T15:25:36.831104+0000","last_fullsized":"2024-09-10T15:25:36.831104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049953+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:25:37.049953+0000","last_peered":"2024-09-10T15:25:37.049953+0000","last_clean":"2024-09-10T15:25:37.049953+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:25:37.049953+0000","last_undegraded":"2024-09-10T15:25:37.049953+0000","last_fullsized":"2024-09-10T15:25:37.049953+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829106+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:36.829106+0000","last_peered":"2024-09-10T15:25:36.829106+0000","last_clean":"2024-09-10T15:25:36.829106+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:25:36.829106+0000","last_undegraded":"2024-09-10T15:25:36.829106+0000","last_fullsized":"2024-09-10T15:25:36.829106+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049586+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:25:37.049586+0000","last_peered":"2024-09-10T15:25:37.049586+0000","last_clean":"2024-09-10T15:25:37.049586+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:25:37.049586+0000","last_undegraded":"2024-09-10T15:25:37.049586+0000","last_fullsized":"2024-09-10T15:25:37.049586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049437+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:25:37.049437+0000","last_peered":"2024-09-10T15:25:37.049437+0000","last_clean":"2024-09-10T15:25:37.049437+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:25:37.049437+0000","last_undegraded":"2024-09-10T15:25:37.049437+0000","last_fullsized":"2024-09-10T15:25:37.049437+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"35'11","reported_seq":52,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054970+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:25:38.054970+0000","last_peered":"2024-09-10T15:25:38.054970+0000","last_clean":"2024-09-10T15:25:38.054970+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:25:38.054970+0000","last_undegraded":"2024-09-10T15:25:38.054970+0000","last_fullsized":"2024-09-10T15:25:38.054970+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049775+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:25:37.049775+0000","last_peered":"2024-09-10T15:25:37.049775+0000","last_clean":"2024-09-10T15:25:37.049775+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:25:37.049775+0000","last_undegraded":"2024-09-10T15:25:37.049775+0000","last_fullsized":"2024-09-10T15:25:37.049775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829758+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:25:36.829758+0000","last_peered":"2024-09-10T15:25:36.829758+0000","last_clean":"2024-09-10T15:25:36.829758+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:25:36.829758+0000","last_undegraded":"2024-09-10T15:25:36.829758+0000","last_fullsized":"2024-09-10T15:25:36.829758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049517+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:25:37.049517+0000","last_peered":"2024-09-10T15:25:37.049517+0000","last_clean":"2024-09-10T15:25:37.049517+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:25:37.049517+0000","last_undegraded":"2024-09-10T15:25:37.049517+0000","last_fullsized":"2024-09-10T15:25:37.049517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048405+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:25:37.048405+0000","last_peered":"2024-09-10T15:25:37.048405+0000","last_clean":"2024-09-10T15:25:37.048405+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:25:37.048405+0000","last_undegraded":"2024-09-10T15:25:37.048405+0000","last_fullsized":"2024-09-10T15:25:37.048405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831242+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:25:36.831242+0000","last_peered":"2024-09-10T15:25:36.831242+0000","last_clean":"2024-09-10T15:25:36.831242+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:25:36.831242+0000","last_undegraded":"2024-09-10T15:25:36.831242+0000","last_fullsized":"2024-09-10T15:25:36.831242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832188+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:25:36.832188+0000","last_peered":"2024-09-10T15:25:36.832188+0000","last_clean":"2024-09-10T15:25:36.832188+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:25:36.832188+0000","last_undegraded":"2024-09-10T15:25:36.832188+0000","last_fullsized":"2024-09-10T15:25:36.832188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"32'2","reported_seq":33,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049854+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:25:37.049854+0000","last_peered":"2024-09-10T15:25:37.049854+0000","last_clean":"2024-09-10T15:25:37.049854+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:25:37.049854+0000","last_undegraded":"2024-09-10T15:25:37.049854+0000","last_fullsized":"2024-09-10T15:25:37.049854+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224600+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:25:37.224600+0000","last_peered":"2024-09-10T15:25:37.224600+0000","last_clean":"2024-09-10T15:25:37.224600+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:25:37.224600+0000","last_undegraded":"2024-09-10T15:25:37.224600+0000","last_fullsized":"2024-09-10T15:25:37.224600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829959+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:25:36.829959+0000","last_peered":"2024-09-10T15:25:36.829959+0000","last_clean":"2024-09-10T15:25:36.829959+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:25:36.829959+0000","last_undegraded":"2024-09-10T15:25:36.829959+0000","last_fullsized":"2024-09-10T15:25:36.829959+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047969+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:25:37.047969+0000","last_peered":"2024-09-10T15:25:37.047969+0000","last_clean":"2024-09-10T15:25:37.047969+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:25:37.047969+0000","last_undegraded":"2024-09-10T15:25:37.047969+0000","last_fullsized":"2024-09-10T15:25:37.047969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055334+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:25:38.055334+0000","last_peered":"2024-09-10T15:25:38.055334+0000","last_clean":"2024-09-10T15:25:38.055334+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:25:38.055334+0000","last_undegraded":"2024-09-10T15:25:38.055334+0000","last_fullsized":"2024-09-10T15:25:38.055334+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225440+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:25:37.225440+0000","last_peered":"2024-09-10T15:25:37.225440+0000","last_clean":"2024-09-10T15:25:37.225440+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:25:37.225440+0000","last_undegraded":"2024-09-10T15:25:37.225440+0000","last_fullsized":"2024-09-10T15:25:37.225440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"32'2","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055430+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:25:38.055430+0000","last_peered":"2024-09-10T15:25:38.055430+0000","last_clean":"2024-09-10T15:25:38.055430+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:25:38.055430+0000","last_undegraded":"2024-09-10T15:25:38.055430+0000","last_fullsized":"2024-09-10T15:25:38.055430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828264+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:25:36.828264+0000","last_peered":"2024-09-10T15:25:36.828264+0000","last_clean":"2024-09-10T15:25:36.828264+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:25:36.828264+0000","last_undegraded":"2024-09-10T15:25:36.828264+0000","last_fullsized":"2024-09-10T15:25:36.828264+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050255+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:25:37.050255+0000","last_peered":"2024-09-10T15:25:37.050255+0000","last_clean":"2024-09-10T15:25:37.050255+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:25:37.050255+0000","last_undegraded":"2024-09-10T15:25:37.050255+0000","last_fullsized":"2024-09-10T15:25:37.050255+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050904+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:25:38.050904+0000","last_peered":"2024-09-10T15:25:38.050904+0000","last_clean":"2024-09-10T15:25:38.050904+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:25:38.050904+0000","last_undegraded":"2024-09-10T15:25:38.050904+0000","last_fullsized":"2024-09-10T15:25:38.050904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048790+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:25:37.048790+0000","last_peered":"2024-09-10T15:25:37.048790+0000","last_clean":"2024-09-10T15:25:37.048790+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:25:37.048790+0000","last_undegraded":"2024-09-10T15:25:37.048790+0000","last_fullsized":"2024-09-10T15:25:37.048790+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"35'17","reported_seq":61,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055085+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:25:38.055085+0000","last_peered":"2024-09-10T15:25:38.055085+0000","last_clean":"2024-09-10T15:25:38.055085+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:25:38.055085+0000","last_undegraded":"2024-09-10T15:25:38.055085+0000","last_fullsized":"2024-09-10T15:25:38.055085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830100+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:25:36.830100+0000","last_peered":"2024-09-10T15:25:36.830100+0000","last_clean":"2024-09-10T15:25:36.830100+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:25:36.830100+0000","last_undegraded":"2024-09-10T15:25:36.830100+0000","last_fullsized":"2024-09-10T15:25:36.830100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048732+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:25:37.048732+0000","last_peered":"2024-09-10T15:25:37.048732+0000","last_clean":"2024-09-10T15:25:37.048732+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:25:37.048732+0000","last_undegraded":"2024-09-10T15:25:37.048732+0000","last_fullsized":"2024-09-10T15:25:37.048732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049219+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:25:37.049219+0000","last_peered":"2024-09-10T15:25:37.049219+0000","last_clean":"2024-09-10T15:25:37.049219+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:25:37.049219+0000","last_undegraded":"2024-09-10T15:25:37.049219+0000","last_fullsized":"2024-09-10T15:25:37.049219+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052087+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:25:38.052087+0000","last_peered":"2024-09-10T15:25:38.052087+0000","last_clean":"2024-09-10T15:25:38.052087+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:25:38.052087+0000","last_undegraded":"2024-09-10T15:25:38.052087+0000","last_fullsized":"2024-09-10T15:25:38.052087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":60,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048682+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:25:37.048682+0000","last_peered":"2024-09-10T15:25:37.048682+0000","last_clean":"2024-09-10T15:25:37.048682+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:25:37.048682+0000","last_undegraded":"2024-09-10T15:25:37.048682+0000","last_fullsized":"2024-09-10T15:25:37.048682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051619+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:25:38.051619+0000","last_peered":"2024-09-10T15:25:38.051619+0000","last_clean":"2024-09-10T15:25:38.051619+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:25:38.051619+0000","last_undegraded":"2024-09-10T15:25:38.051619+0000","last_fullsized":"2024-09-10T15:25:38.051619+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828639+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:25:36.828639+0000","last_peered":"2024-09-10T15:25:36.828639+0000","last_clean":"2024-09-10T15:25:36.828639+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:25:36.828639+0000","last_undegraded":"2024-09-10T15:25:36.828639+0000","last_fullsized":"2024-09-10T15:25:36.828639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"35'13","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049264+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:25:37.049264+0000","last_peered":"2024-09-10T15:25:37.049264+0000","last_clean":"2024-09-10T15:25:37.049264+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:25:37.049264+0000","last_undegraded":"2024-09-10T15:25:37.049264+0000","last_fullsized":"2024-09-10T15:25:37.049264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831470+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:25:36.831470+0000","last_peered":"2024-09-10T15:25:36.831470+0000","last_clean":"2024-09-10T15:25:36.831470+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:25:36.831470+0000","last_undegraded":"2024-09-10T15:25:36.831470+0000","last_fullsized":"2024-09-10T15:25:36.831470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828639+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:25:36.828639+0000","last_peered":"2024-09-10T15:25:36.828639+0000","last_clean":"2024-09-10T15:25:36.828639+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:25:36.828639+0000","last_undegraded":"2024-09-10T15:25:36.828639+0000","last_fullsized":"2024-09-10T15:25:36.828639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833446+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:25:36.833446+0000","last_peered":"2024-09-10T15:25:36.833446+0000","last_clean":"2024-09-10T15:25:36.833446+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:25:36.833446+0000","last_undegraded":"2024-09-10T15:25:36.833446+0000","last_fullsized":"2024-09-10T15:25:36.833446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047498+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:25:37.047498+0000","last_peered":"2024-09-10T15:25:37.047498+0000","last_clean":"2024-09-10T15:25:37.047498+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:25:37.047498+0000","last_undegraded":"2024-09-10T15:25:37.047498+0000","last_fullsized":"2024-09-10T15:25:37.047498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225270+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:25:37.225270+0000","last_peered":"2024-09-10T15:25:37.225270+0000","last_clean":"2024-09-10T15:25:37.225270+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:25:37.225270+0000","last_undegraded":"2024-09-10T15:25:37.225270+0000","last_fullsized":"2024-09-10T15:25:37.225270+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048799+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:25:37.048799+0000","last_peered":"2024-09-10T15:25:37.048799+0000","last_clean":"2024-09-10T15:25:37.048799+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:25:37.048799+0000","last_undegraded":"2024-09-10T15:25:37.048799+0000","last_fullsized":"2024-09-10T15:25:37.048799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"35'23","reported_seq":76,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049111+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:25:37.049111+0000","last_peered":"2024-09-10T15:25:37.049111+0000","last_clean":"2024-09-10T15:25:37.049111+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:25:37.049111+0000","last_undegraded":"2024-09-10T15:25:37.049111+0000","last_fullsized":"2024-09-10T15:25:37.049111+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049474+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:25:37.049474+0000","last_peered":"2024-09-10T15:25:37.049474+0000","last_clean":"2024-09-10T15:25:37.049474+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:25:37.049474+0000","last_undegraded":"2024-09-10T15:25:37.049474+0000","last_fullsized":"2024-09-10T15:25:37.049474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830793+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:25:36.830793+0000","last_peered":"2024-09-10T15:25:36.830793+0000","last_clean":"2024-09-10T15:25:36.830793+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:25:36.830793+0000","last_undegraded":"2024-09-10T15:25:36.830793+0000","last_fullsized":"2024-09-10T15:25:36.830793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226260+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:25:37.226260+0000","last_peered":"2024-09-10T15:25:37.226260+0000","last_clean":"2024-09-10T15:25:37.226260+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:25:37.226260+0000","last_undegraded":"2024-09-10T15:25:37.226260+0000","last_fullsized":"2024-09-10T15:25:37.226260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":58,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048603+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:25:37.048603+0000","last_peered":"2024-09-10T15:25:37.048603+0000","last_clean":"2024-09-10T15:25:37.048603+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:25:37.048603+0000","last_undegraded":"2024-09-10T15:25:37.048603+0000","last_fullsized":"2024-09-10T15:25:37.048603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831381+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:25:36.831381+0000","last_peered":"2024-09-10T15:25:36.831381+0000","last_clean":"2024-09-10T15:25:36.831381+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:25:36.831381+0000","last_undegraded":"2024-09-10T15:25:36.831381+0000","last_fullsized":"2024-09-10T15:25:36.831381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050098+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:25:37.050098+0000","last_peered":"2024-09-10T15:25:37.050098+0000","last_clean":"2024-09-10T15:25:37.050098+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:25:37.050098+0000","last_undegraded":"2024-09-10T15:25:37.050098+0000","last_fullsized":"2024-09-10T15:25:37.050098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829739+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:25:36.829739+0000","last_peered":"2024-09-10T15:25:36.829739+0000","last_clean":"2024-09-10T15:25:36.829739+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:25:36.829739+0000","last_undegraded":"2024-09-10T15:25:36.829739+0000","last_fullsized":"2024-09-10T15:25:36.829739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052647+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:25:38.052647+0000","last_peered":"2024-09-10T15:25:38.052647+0000","last_clean":"2024-09-10T15:25:38.052647+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:25:38.052647+0000","last_undegraded":"2024-09-10T15:25:38.052647+0000","last_fullsized":"2024-09-10T15:25:38.052647+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050902+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:25:38.050902+0000","last_peered":"2024-09-10T15:25:38.050902+0000","last_clean":"2024-09-10T15:25:38.050902+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:25:38.050902+0000","last_undegraded":"2024-09-10T15:25:38.050902+0000","last_fullsized":"2024-09-10T15:25:38.050902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226344+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:25:37.226344+0000","last_peered":"2024-09-10T15:25:37.226344+0000","last_clean":"2024-09-10T15:25:37.226344+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:25:37.226344+0000","last_undegraded":"2024-09-10T15:25:37.226344+0000","last_fullsized":"2024-09-10T15:25:37.226344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":61,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048501+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:25:37.048501+0000","last_peered":"2024-09-10T15:25:37.048501+0000","last_clean":"2024-09-10T15:25:37.048501+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:25:37.048501+0000","last_undegraded":"2024-09-10T15:25:37.048501+0000","last_fullsized":"2024-09-10T15:25:37.048501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830085+0000","last_change":"2024-09-10T15:25:11.842227+0000","last_active":"2024-09-10T15:25:36.830085+0000","last_peered":"2024-09-10T15:25:36.830085+0000","last_clean":"2024-09-10T15:25:36.830085+0000","last_became_active":"2024-09-10T15:25:11.841833+0000","last_became_peered":"2024-09-10T15:25:11.841833+0000","last_unstale":"2024-09-10T15:25:36.830085+0000","last_undegraded":"2024-09-10T15:25:36.830085+0000","last_fullsized":"2024-09-10T15:25:36.830085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049426+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:25:37.049426+0000","last_peered":"2024-09-10T15:25:37.049426+0000","last_clean":"2024-09-10T15:25:37.049426+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:25:37.049426+0000","last_undegraded":"2024-09-10T15:25:37.049426+0000","last_fullsized":"2024-09-10T15:25:37.049426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":47,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831549+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:25:36.831549+0000","last_peered":"2024-09-10T15:25:36.831549+0000","last_clean":"2024-09-10T15:25:36.831549+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:25:36.831549+0000","last_undegraded":"2024-09-10T15:25:36.831549+0000","last_fullsized":"2024-09-10T15:25:36.831549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049049+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:25:37.049049+0000","last_peered":"2024-09-10T15:25:37.049049+0000","last_clean":"2024-09-10T15:25:37.049049+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:25:37.049049+0000","last_undegraded":"2024-09-10T15:25:37.049049+0000","last_fullsized":"2024-09-10T15:25:37.049049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051183+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:25:38.051183+0000","last_peered":"2024-09-10T15:25:38.051183+0000","last_clean":"2024-09-10T15:25:38.051183+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:25:38.051183+0000","last_undegraded":"2024-09-10T15:25:38.051183+0000","last_fullsized":"2024-09-10T15:25:38.051183+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225028+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:25:37.225028+0000","last_peered":"2024-09-10T15:25:37.225028+0000","last_clean":"2024-09-10T15:25:37.225028+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:25:37.225028+0000","last_undegraded":"2024-09-10T15:25:37.225028+0000","last_fullsized":"2024-09-10T15:25:37.225028+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829787+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:25:36.829787+0000","last_peered":"2024-09-10T15:25:36.829787+0000","last_clean":"2024-09-10T15:25:36.829787+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:25:36.829787+0000","last_undegraded":"2024-09-10T15:25:36.829787+0000","last_fullsized":"2024-09-10T15:25:36.829787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832447+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:25:36.832447+0000","last_peered":"2024-09-10T15:25:36.832447+0000","last_clean":"2024-09-10T15:25:36.832447+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:25:36.832447+0000","last_undegraded":"2024-09-10T15:25:36.832447+0000","last_fullsized":"2024-09-10T15:25:36.832447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051414+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:25:38.051414+0000","last_peered":"2024-09-10T15:25:38.051414+0000","last_clean":"2024-09-10T15:25:38.051414+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:25:38.051414+0000","last_undegraded":"2024-09-10T15:25:38.051414+0000","last_fullsized":"2024-09-10T15:25:38.051414+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"35'18","reported_seq":63,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048108+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:25:37.048108+0000","last_peered":"2024-09-10T15:25:37.048108+0000","last_clean":"2024-09-10T15:25:37.048108+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:25:37.048108+0000","last_undegraded":"2024-09-10T15:25:37.048108+0000","last_fullsized":"2024-09-10T15:25:37.048108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828153+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:25:36.828153+0000","last_peered":"2024-09-10T15:25:36.828153+0000","last_clean":"2024-09-10T15:25:36.828153+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:25:36.828153+0000","last_undegraded":"2024-09-10T15:25:36.828153+0000","last_fullsized":"2024-09-10T15:25:36.828153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831242+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:25:36.831242+0000","last_peered":"2024-09-10T15:25:36.831242+0000","last_clean":"2024-09-10T15:25:36.831242+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:25:36.831242+0000","last_undegraded":"2024-09-10T15:25:36.831242+0000","last_fullsized":"2024-09-10T15:25:36.831242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225624+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:25:37.225624+0000","last_peered":"2024-09-10T15:25:37.225624+0000","last_clean":"2024-09-10T15:25:37.225624+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:25:37.225624+0000","last_undegraded":"2024-09-10T15:25:37.225624+0000","last_fullsized":"2024-09-10T15:25:37.225624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226569+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:25:37.226569+0000","last_peered":"2024-09-10T15:25:37.226569+0000","last_clean":"2024-09-10T15:25:37.226569+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:25:37.226569+0000","last_undegraded":"2024-09-10T15:25:37.226569+0000","last_fullsized":"2024-09-10T15:25:37.226569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048997+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:25:37.048997+0000","last_peered":"2024-09-10T15:25:37.048997+0000","last_clean":"2024-09-10T15:25:37.048997+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:25:37.048997+0000","last_undegraded":"2024-09-10T15:25:37.048997+0000","last_fullsized":"2024-09-10T15:25:37.048997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":33,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828357+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:25:36.828357+0000","last_peered":"2024-09-10T15:25:36.828357+0000","last_clean":"2024-09-10T15:25:36.828357+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:25:36.828357+0000","last_undegraded":"2024-09-10T15:25:36.828357+0000","last_fullsized":"2024-09-10T15:25:36.828357+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":53,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224942+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:25:37.224942+0000","last_peered":"2024-09-10T15:25:37.224942+0000","last_clean":"2024-09-10T15:25:37.224942+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:25:37.224942+0000","last_undegraded":"2024-09-10T15:25:37.224942+0000","last_fullsized":"2024-09-10T15:25:37.224942+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"32'2","reported_seq":35,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051441+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:25:38.051441+0000","last_peered":"2024-09-10T15:25:38.051441+0000","last_clean":"2024-09-10T15:25:38.051441+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:25:38.051441+0000","last_undegraded":"2024-09-10T15:25:38.051441+0000","last_fullsized":"2024-09-10T15:25:38.051441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049733+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:25:37.049733+0000","last_peered":"2024-09-10T15:25:37.049733+0000","last_clean":"2024-09-10T15:25:37.049733+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:25:37.049733+0000","last_undegraded":"2024-09-10T15:25:37.049733+0000","last_fullsized":"2024-09-10T15:25:37.049733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050852+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:25:38.050852+0000","last_peered":"2024-09-10T15:25:38.050852+0000","last_clean":"2024-09-10T15:25:38.050852+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:25:38.050852+0000","last_undegraded":"2024-09-10T15:25:38.050852+0000","last_fullsized":"2024-09-10T15:25:38.050852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053681+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:25:38.053681+0000","last_peered":"2024-09-10T15:25:38.053681+0000","last_clean":"2024-09-10T15:25:38.053681+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:25:38.053681+0000","last_undegraded":"2024-09-10T15:25:38.053681+0000","last_fullsized":"2024-09-10T15:25:38.053681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":60,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053047+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:25:38.053047+0000","last_peered":"2024-09-10T15:25:38.053047+0000","last_clean":"2024-09-10T15:25:38.053047+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:25:38.053047+0000","last_undegraded":"2024-09-10T15:25:38.053047+0000","last_fullsized":"2024-09-10T15:25:38.053047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047675+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:25:37.047675+0000","last_peered":"2024-09-10T15:25:37.047675+0000","last_clean":"2024-09-10T15:25:37.047675+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:25:37.047675+0000","last_undegraded":"2024-09-10T15:25:37.047675+0000","last_fullsized":"2024-09-10T15:25:37.047675+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048213+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:25:37.048213+0000","last_peered":"2024-09-10T15:25:37.048213+0000","last_clean":"2024-09-10T15:25:37.048213+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:25:37.048213+0000","last_undegraded":"2024-09-10T15:25:37.048213+0000","last_fullsized":"2024-09-10T15:25:37.048213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832983+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:25:36.832983+0000","last_peered":"2024-09-10T15:25:36.832983+0000","last_clean":"2024-09-10T15:25:36.832983+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:25:36.832983+0000","last_undegraded":"2024-09-10T15:25:36.832983+0000","last_fullsized":"2024-09-10T15:25:36.832983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830697+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:25:36.830697+0000","last_peered":"2024-09-10T15:25:36.830697+0000","last_clean":"2024-09-10T15:25:36.830697+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:25:36.830697+0000","last_undegraded":"2024-09-10T15:25:36.830697+0000","last_fullsized":"2024-09-10T15:25:36.830697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828367+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:25:36.828367+0000","last_peered":"2024-09-10T15:25:36.828367+0000","last_clean":"2024-09-10T15:25:36.828367+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:25:36.828367+0000","last_undegraded":"2024-09-10T15:25:36.828367+0000","last_fullsized":"2024-09-10T15:25:36.828367+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052829+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:25:38.052829+0000","last_peered":"2024-09-10T15:25:38.052829+0000","last_clean":"2024-09-10T15:25:38.052829+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:25:38.052829+0000","last_undegraded":"2024-09-10T15:25:38.052829+0000","last_fullsized":"2024-09-10T15:25:38.052829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":59,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049215+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:25:37.049215+0000","last_peered":"2024-09-10T15:25:37.049215+0000","last_clean":"2024-09-10T15:25:37.049215+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:25:37.049215+0000","last_undegraded":"2024-09-10T15:25:37.049215+0000","last_fullsized":"2024-09-10T15:25:37.049215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050594+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:25:38.050594+0000","last_peered":"2024-09-10T15:25:38.050594+0000","last_clean":"2024-09-10T15:25:38.050594+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:25:38.050594+0000","last_undegraded":"2024-09-10T15:25:38.050594+0000","last_fullsized":"2024-09-10T15:25:38.050594+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"35'19","reported_seq":65,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829459+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:25:36.829459+0000","last_peered":"2024-09-10T15:25:36.829459+0000","last_clean":"2024-09-10T15:25:36.829459+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:25:36.829459+0000","last_undegraded":"2024-09-10T15:25:36.829459+0000","last_fullsized":"2024-09-10T15:25:36.829459+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051251+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:25:38.051251+0000","last_peered":"2024-09-10T15:25:38.051251+0000","last_clean":"2024-09-10T15:25:38.051251+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:25:38.051251+0000","last_undegraded":"2024-09-10T15:25:38.051251+0000","last_fullsized":"2024-09-10T15:25:38.051251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829559+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:25:36.829559+0000","last_peered":"2024-09-10T15:25:36.829559+0000","last_clean":"2024-09-10T15:25:36.829559+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:25:36.829559+0000","last_undegraded":"2024-09-10T15:25:36.829559+0000","last_fullsized":"2024-09-10T15:25:36.829559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053086+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:25:38.053086+0000","last_peered":"2024-09-10T15:25:38.053086+0000","last_clean":"2024-09-10T15:25:38.053086+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:25:38.053086+0000","last_undegraded":"2024-09-10T15:25:38.053086+0000","last_fullsized":"2024-09-10T15:25:38.053086+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829286+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:25:36.829286+0000","last_peered":"2024-09-10T15:25:36.829286+0000","last_clean":"2024-09-10T15:25:36.829286+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:25:36.829286+0000","last_undegraded":"2024-09-10T15:25:36.829286+0000","last_fullsized":"2024-09-10T15:25:36.829286+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048799+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:25:37.048799+0000","last_peered":"2024-09-10T15:25:37.048799+0000","last_clean":"2024-09-10T15:25:37.048799+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:25:37.048799+0000","last_undegraded":"2024-09-10T15:25:37.048799+0000","last_fullsized":"2024-09-10T15:25:37.048799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225217+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:25:37.225217+0000","last_peered":"2024-09-10T15:25:37.225217+0000","last_clean":"2024-09-10T15:25:37.225217+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:25:37.225217+0000","last_undegraded":"2024-09-10T15:25:37.225217+0000","last_fullsized":"2024-09-10T15:25:37.225217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.224771+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:25:37.224771+0000","last_peered":"2024-09-10T15:25:37.224771+0000","last_clean":"2024-09-10T15:25:37.224771+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:25:37.224771+0000","last_undegraded":"2024-09-10T15:25:37.224771+0000","last_fullsized":"2024-09-10T15:25:37.224771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048061+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:25:37.048061+0000","last_peered":"2024-09-10T15:25:37.048061+0000","last_clean":"2024-09-10T15:25:37.048061+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:25:37.048061+0000","last_undegraded":"2024-09-10T15:25:37.048061+0000","last_fullsized":"2024-09-10T15:25:37.048061+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":23,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049768+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:25:37.049768+0000","last_peered":"2024-09-10T15:25:37.049768+0000","last_clean":"2024-09-10T15:25:37.049768+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:25:37.049768+0000","last_undegraded":"2024-09-10T15:25:37.049768+0000","last_fullsized":"2024-09-10T15:25:37.049768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051115+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:25:38.051115+0000","last_peered":"2024-09-10T15:25:38.051115+0000","last_clean":"2024-09-10T15:25:38.051115+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:25:38.051115+0000","last_undegraded":"2024-09-10T15:25:38.051115+0000","last_fullsized":"2024-09-10T15:25:38.051115+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830545+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:25:36.830545+0000","last_peered":"2024-09-10T15:25:36.830545+0000","last_clean":"2024-09-10T15:25:36.830545+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:25:36.830545+0000","last_undegraded":"2024-09-10T15:25:36.830545+0000","last_fullsized":"2024-09-10T15:25:36.830545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051178+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:25:38.051178+0000","last_peered":"2024-09-10T15:25:38.051178+0000","last_clean":"2024-09-10T15:25:38.051178+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:25:38.051178+0000","last_undegraded":"2024-09-10T15:25:38.051178+0000","last_fullsized":"2024-09-10T15:25:38.051178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"35'4","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050393+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:25:38.050393+0000","last_peered":"2024-09-10T15:25:38.050393+0000","last_clean":"2024-09-10T15:25:38.050393+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:25:38.050393+0000","last_undegraded":"2024-09-10T15:25:38.050393+0000","last_fullsized":"2024-09-10T15:25:38.050393+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828060+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:25:36.828060+0000","last_peered":"2024-09-10T15:25:36.828060+0000","last_clean":"2024-09-10T15:25:36.828060+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:25:36.828060+0000","last_undegraded":"2024-09-10T15:25:36.828060+0000","last_fullsized":"2024-09-10T15:25:36.828060+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225619+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:25:37.225619+0000","last_peered":"2024-09-10T15:25:37.225619+0000","last_clean":"2024-09-10T15:25:37.225619+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:25:37.225619+0000","last_undegraded":"2024-09-10T15:25:37.225619+0000","last_fullsized":"2024-09-10T15:25:37.225619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051200+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:25:38.051200+0000","last_peered":"2024-09-10T15:25:38.051200+0000","last_clean":"2024-09-10T15:25:38.051200+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:25:38.051200+0000","last_undegraded":"2024-09-10T15:25:38.051200+0000","last_fullsized":"2024-09-10T15:25:38.051200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830482+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:25:36.830482+0000","last_peered":"2024-09-10T15:25:36.830482+0000","last_clean":"2024-09-10T15:25:36.830482+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:25:36.830482+0000","last_undegraded":"2024-09-10T15:25:36.830482+0000","last_fullsized":"2024-09-10T15:25:36.830482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828130+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:25:36.828130+0000","last_peered":"2024-09-10T15:25:36.828130+0000","last_clean":"2024-09-10T15:25:36.828130+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:25:36.828130+0000","last_undegraded":"2024-09-10T15:25:36.828130+0000","last_fullsized":"2024-09-10T15:25:36.828130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"35'11","reported_seq":50,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049314+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:25:37.049314+0000","last_peered":"2024-09-10T15:25:37.049314+0000","last_clean":"2024-09-10T15:25:37.049314+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:25:37.049314+0000","last_undegraded":"2024-09-10T15:25:37.049314+0000","last_fullsized":"2024-09-10T15:25:37.049314+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053856+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:25:38.053856+0000","last_peered":"2024-09-10T15:25:38.053856+0000","last_clean":"2024-09-10T15:25:38.053856+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:25:38.053856+0000","last_undegraded":"2024-09-10T15:25:38.053856+0000","last_fullsized":"2024-09-10T15:25:38.053856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048254+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:25:37.048254+0000","last_peered":"2024-09-10T15:25:37.048254+0000","last_clean":"2024-09-10T15:25:37.048254+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:25:37.048254+0000","last_undegraded":"2024-09-10T15:25:37.048254+0000","last_fullsized":"2024-09-10T15:25:37.048254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048350+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:25:37.048350+0000","last_peered":"2024-09-10T15:25:37.048350+0000","last_clean":"2024-09-10T15:25:37.048350+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:25:37.048350+0000","last_undegraded":"2024-09-10T15:25:37.048350+0000","last_fullsized":"2024-09-10T15:25:37.048350+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833145+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:25:36.833145+0000","last_peered":"2024-09-10T15:25:36.833145+0000","last_clean":"2024-09-10T15:25:36.833145+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:25:36.833145+0000","last_undegraded":"2024-09-10T15:25:36.833145+0000","last_fullsized":"2024-09-10T15:25:36.833145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047462+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:25:37.047462+0000","last_peered":"2024-09-10T15:25:37.047462+0000","last_clean":"2024-09-10T15:25:37.047462+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:25:37.047462+0000","last_undegraded":"2024-09-10T15:25:37.047462+0000","last_fullsized":"2024-09-10T15:25:37.047462+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"35'9","reported_seq":45,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828223+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:25:36.828223+0000","last_peered":"2024-09-10T15:25:36.828223+0000","last_clean":"2024-09-10T15:25:36.828223+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:25:36.828223+0000","last_undegraded":"2024-09-10T15:25:36.828223+0000","last_fullsized":"2024-09-10T15:25:36.828223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048945+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:25:37.048945+0000","last_peered":"2024-09-10T15:25:37.048945+0000","last_clean":"2024-09-10T15:25:37.048945+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:25:37.048945+0000","last_undegraded":"2024-09-10T15:25:37.048945+0000","last_fullsized":"2024-09-10T15:25:37.048945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048929+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:25:37.048929+0000","last_peered":"2024-09-10T15:25:37.048929+0000","last_clean":"2024-09-10T15:25:37.048929+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:25:37.048929+0000","last_undegraded":"2024-09-10T15:25:37.048929+0000","last_fullsized":"2024-09-10T15:25:37.048929+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833433+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:25:36.833433+0000","last_peered":"2024-09-10T15:25:36.833433+0000","last_clean":"2024-09-10T15:25:36.833433+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:25:36.833433+0000","last_undegraded":"2024-09-10T15:25:36.833433+0000","last_fullsized":"2024-09-10T15:25:36.833433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226256+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:25:37.226256+0000","last_peered":"2024-09-10T15:25:37.226256+0000","last_clean":"2024-09-10T15:25:37.226256+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:25:37.226256+0000","last_undegraded":"2024-09-10T15:25:37.226256+0000","last_fullsized":"2024-09-10T15:25:37.226256+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"35'12","reported_seq":55,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225926+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:25:37.225926+0000","last_peered":"2024-09-10T15:25:37.225926+0000","last_clean":"2024-09-10T15:25:37.225926+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:25:37.225926+0000","last_undegraded":"2024-09-10T15:25:37.225926+0000","last_fullsized":"2024-09-10T15:25:37.225926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":26,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828873+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:25:36.828873+0000","last_peered":"2024-09-10T15:25:36.828873+0000","last_clean":"2024-09-10T15:25:36.828873+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:25:36.828873+0000","last_undegraded":"2024-09-10T15:25:36.828873+0000","last_fullsized":"2024-09-10T15:25:36.828873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830272+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:25:36.830272+0000","last_peered":"2024-09-10T15:25:36.830272+0000","last_clean":"2024-09-10T15:25:36.830272+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:25:36.830272+0000","last_undegraded":"2024-09-10T15:25:36.830272+0000","last_fullsized":"2024-09-10T15:25:36.830272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052672+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:25:38.052672+0000","last_peered":"2024-09-10T15:25:38.052672+0000","last_clean":"2024-09-10T15:25:38.052672+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:25:38.052672+0000","last_undegraded":"2024-09-10T15:25:38.052672+0000","last_fullsized":"2024-09-10T15:25:38.052672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051618+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:25:38.051618+0000","last_peered":"2024-09-10T15:25:38.051618+0000","last_clean":"2024-09-10T15:25:38.051618+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:25:38.051618+0000","last_undegraded":"2024-09-10T15:25:38.051618+0000","last_fullsized":"2024-09-10T15:25:38.051618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829529+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:25:36.829529+0000","last_peered":"2024-09-10T15:25:36.829529+0000","last_clean":"2024-09-10T15:25:36.829529+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:25:36.829529+0000","last_undegraded":"2024-09-10T15:25:36.829529+0000","last_fullsized":"2024-09-10T15:25:36.829529+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"35'15","reported_seq":57,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048636+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:25:37.048636+0000","last_peered":"2024-09-10T15:25:37.048636+0000","last_clean":"2024-09-10T15:25:37.048636+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:25:37.048636+0000","last_undegraded":"2024-09-10T15:25:37.048636+0000","last_fullsized":"2024-09-10T15:25:37.048636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830890+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:25:36.830890+0000","last_peered":"2024-09-10T15:25:36.830890+0000","last_clean":"2024-09-10T15:25:36.830890+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:25:36.830890+0000","last_undegraded":"2024-09-10T15:25:36.830890+0000","last_fullsized":"2024-09-10T15:25:36.830890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048418+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:25:37.048418+0000","last_peered":"2024-09-10T15:25:37.048418+0000","last_clean":"2024-09-10T15:25:37.048418+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:25:37.048418+0000","last_undegraded":"2024-09-10T15:25:37.048418+0000","last_fullsized":"2024-09-10T15:25:37.048418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049683+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:25:37.049683+0000","last_peered":"2024-09-10T15:25:37.049683+0000","last_clean":"2024-09-10T15:25:37.049683+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:25:37.049683+0000","last_undegraded":"2024-09-10T15:25:37.049683+0000","last_fullsized":"2024-09-10T15:25:37.049683+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054429+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:25:38.054429+0000","last_peered":"2024-09-10T15:25:38.054429+0000","last_clean":"2024-09-10T15:25:38.054429+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:25:38.054429+0000","last_undegraded":"2024-09-10T15:25:38.054429+0000","last_fullsized":"2024-09-10T15:25:38.054429+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829900+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:25:36.829900+0000","last_peered":"2024-09-10T15:25:36.829900+0000","last_clean":"2024-09-10T15:25:36.829900+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:25:36.829900+0000","last_undegraded":"2024-09-10T15:25:36.829900+0000","last_fullsized":"2024-09-10T15:25:36.829900+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"35'11","reported_seq":51,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225922+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:25:37.225922+0000","last_peered":"2024-09-10T15:25:37.225922+0000","last_clean":"2024-09-10T15:25:37.225922+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:25:37.225922+0000","last_undegraded":"2024-09-10T15:25:37.225922+0000","last_fullsized":"2024-09-10T15:25:37.225922+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049570+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:25:37.049570+0000","last_peered":"2024-09-10T15:25:37.049570+0000","last_clean":"2024-09-10T15:25:37.049570+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:25:37.049570+0000","last_undegraded":"2024-09-10T15:25:37.049570+0000","last_fullsized":"2024-09-10T15:25:37.049570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047163+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:25:37.047163+0000","last_peered":"2024-09-10T15:25:37.047163+0000","last_clean":"2024-09-10T15:25:37.047163+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:25:37.047163+0000","last_undegraded":"2024-09-10T15:25:37.047163+0000","last_fullsized":"2024-09-10T15:25:37.047163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052998+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:25:38.052998+0000","last_peered":"2024-09-10T15:25:38.052998+0000","last_clean":"2024-09-10T15:25:38.052998+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:25:38.052998+0000","last_undegraded":"2024-09-10T15:25:38.052998+0000","last_fullsized":"2024-09-10T15:25:38.052998+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.052041+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:25:38.052041+0000","last_peered":"2024-09-10T15:25:38.052041+0000","last_clean":"2024-09-10T15:25:38.052041+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:25:38.052041+0000","last_undegraded":"2024-09-10T15:25:38.052041+0000","last_fullsized":"2024-09-10T15:25:38.052041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051847+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:25:38.051847+0000","last_peered":"2024-09-10T15:25:38.051847+0000","last_clean":"2024-09-10T15:25:38.051847+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:25:38.051847+0000","last_undegraded":"2024-09-10T15:25:38.051847+0000","last_fullsized":"2024-09-10T15:25:38.051847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":47,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048764+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:25:37.048764+0000","last_peered":"2024-09-10T15:25:37.048764+0000","last_clean":"2024-09-10T15:25:37.048764+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:25:37.048764+0000","last_undegraded":"2024-09-10T15:25:37.048764+0000","last_fullsized":"2024-09-10T15:25:37.048764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'2","reported_seq":31,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830692+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:25:36.830692+0000","last_peered":"2024-09-10T15:25:36.830692+0000","last_clean":"2024-09-10T15:25:36.830692+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:25:36.830692+0000","last_undegraded":"2024-09-10T15:25:36.830692+0000","last_fullsized":"2024-09-10T15:25:36.830692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.046840+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:25:37.046840+0000","last_peered":"2024-09-10T15:25:37.046840+0000","last_clean":"2024-09-10T15:25:37.046840+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:25:37.046840+0000","last_undegraded":"2024-09-10T15:25:37.046840+0000","last_fullsized":"2024-09-10T15:25:37.046840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829186+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:25:36.829186+0000","last_peered":"2024-09-10T15:25:36.829186+0000","last_clean":"2024-09-10T15:25:36.829186+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:25:36.829186+0000","last_undegraded":"2024-09-10T15:25:36.829186+0000","last_fullsized":"2024-09-10T15:25:36.829186+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055186+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:25:38.055186+0000","last_peered":"2024-09-10T15:25:38.055186+0000","last_clean":"2024-09-10T15:25:38.055186+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:25:38.055186+0000","last_undegraded":"2024-09-10T15:25:38.055186+0000","last_fullsized":"2024-09-10T15:25:38.055186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054061+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:25:38.054061+0000","last_peered":"2024-09-10T15:25:38.054061+0000","last_clean":"2024-09-10T15:25:38.054061+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:25:38.054061+0000","last_undegraded":"2024-09-10T15:25:38.054061+0000","last_fullsized":"2024-09-10T15:25:38.054061+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"35'15","reported_seq":54,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828263+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:25:36.828263+0000","last_peered":"2024-09-10T15:25:36.828263+0000","last_clean":"2024-09-10T15:25:36.828263+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:25:36.828263+0000","last_undegraded":"2024-09-10T15:25:36.828263+0000","last_fullsized":"2024-09-10T15:25:36.828263+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050520+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:25:38.050520+0000","last_peered":"2024-09-10T15:25:38.050520+0000","last_clean":"2024-09-10T15:25:38.050520+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:25:38.050520+0000","last_undegraded":"2024-09-10T15:25:38.050520+0000","last_fullsized":"2024-09-10T15:25:38.050520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":25,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054977+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:25:38.054977+0000","last_peered":"2024-09-10T15:25:38.054977+0000","last_clean":"2024-09-10T15:25:38.054977+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:25:38.054977+0000","last_undegraded":"2024-09-10T15:25:38.054977+0000","last_fullsized":"2024-09-10T15:25:38.054977+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828398+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:25:36.828398+0000","last_peered":"2024-09-10T15:25:36.828398+0000","last_clean":"2024-09-10T15:25:36.828398+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:25:36.828398+0000","last_undegraded":"2024-09-10T15:25:36.828398+0000","last_fullsized":"2024-09-10T15:25:36.828398+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049268+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:25:37.049268+0000","last_peered":"2024-09-10T15:25:37.049268+0000","last_clean":"2024-09-10T15:25:37.049268+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:25:37.049268+0000","last_undegraded":"2024-09-10T15:25:37.049268+0000","last_fullsized":"2024-09-10T15:25:37.049268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":34,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829020+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:25:36.829020+0000","last_peered":"2024-09-10T15:25:36.829020+0000","last_clean":"2024-09-10T15:25:36.829020+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:25:36.829020+0000","last_undegraded":"2024-09-10T15:25:36.829020+0000","last_fullsized":"2024-09-10T15:25:36.829020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"35'9","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050790+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:25:38.050790+0000","last_peered":"2024-09-10T15:25:38.050790+0000","last_clean":"2024-09-10T15:25:38.050790+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:25:38.050790+0000","last_undegraded":"2024-09-10T15:25:38.050790+0000","last_fullsized":"2024-09-10T15:25:38.050790+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047573+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:25:37.047573+0000","last_peered":"2024-09-10T15:25:37.047573+0000","last_clean":"2024-09-10T15:25:37.047573+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:25:37.047573+0000","last_undegraded":"2024-09-10T15:25:37.047573+0000","last_fullsized":"2024-09-10T15:25:37.047573+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830706+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:25:36.830706+0000","last_peered":"2024-09-10T15:25:36.830706+0000","last_clean":"2024-09-10T15:25:36.830706+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:25:36.830706+0000","last_undegraded":"2024-09-10T15:25:36.830706+0000","last_fullsized":"2024-09-10T15:25:36.830706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048428+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:25:37.048428+0000","last_peered":"2024-09-10T15:25:37.048428+0000","last_clean":"2024-09-10T15:25:37.048428+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:25:37.048428+0000","last_undegraded":"2024-09-10T15:25:37.048428+0000","last_fullsized":"2024-09-10T15:25:37.048428+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833687+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:25:36.833687+0000","last_peered":"2024-09-10T15:25:36.833687+0000","last_clean":"2024-09-10T15:25:36.833687+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:25:36.833687+0000","last_undegraded":"2024-09-10T15:25:36.833687+0000","last_fullsized":"2024-09-10T15:25:36.833687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":39,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051559+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:25:38.051559+0000","last_peered":"2024-09-10T15:25:38.051559+0000","last_clean":"2024-09-10T15:25:38.051559+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:25:38.051559+0000","last_undegraded":"2024-09-10T15:25:38.051559+0000","last_fullsized":"2024-09-10T15:25:38.051559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"35'5","reported_seq":42,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225292+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:25:37.225292+0000","last_peered":"2024-09-10T15:25:37.225292+0000","last_clean":"2024-09-10T15:25:37.225292+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:25:37.225292+0000","last_undegraded":"2024-09-10T15:25:37.225292+0000","last_fullsized":"2024-09-10T15:25:37.225292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047156+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:25:37.047156+0000","last_peered":"2024-09-10T15:25:37.047156+0000","last_clean":"2024-09-10T15:25:37.047156+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:25:37.047156+0000","last_undegraded":"2024-09-10T15:25:37.047156+0000","last_fullsized":"2024-09-10T15:25:37.047156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":24,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048608+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:25:37.048608+0000","last_peered":"2024-09-10T15:25:37.048608+0000","last_clean":"2024-09-10T15:25:37.048608+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:25:37.048608+0000","last_undegraded":"2024-09-10T15:25:37.048608+0000","last_fullsized":"2024-09-10T15:25:37.048608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":38,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:25:36.828248+0000","last_peered":"2024-09-10T15:25:36.828248+0000","last_clean":"2024-09-10T15:25:36.828248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:25:36.828248+0000","last_undegraded":"2024-09-10T15:25:36.828248+0000","last_fullsized":"2024-09-10T15:25:36.828248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832917+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:25:36.832917+0000","last_peered":"2024-09-10T15:25:36.832917+0000","last_clean":"2024-09-10T15:25:36.832917+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:25:36.832917+0000","last_undegraded":"2024-09-10T15:25:36.832917+0000","last_fullsized":"2024-09-10T15:25:36.832917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":38,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.050857+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:25:38.050857+0000","last_peered":"2024-09-10T15:25:38.050857+0000","last_clean":"2024-09-10T15:25:38.050857+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:25:38.050857+0000","last_undegraded":"2024-09-10T15:25:38.050857+0000","last_fullsized":"2024-09-10T15:25:38.050857+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"35'9","reported_seq":48,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047280+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:25:37.047280+0000","last_peered":"2024-09-10T15:25:37.047280+0000","last_clean":"2024-09-10T15:25:37.047280+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:25:37.047280+0000","last_undegraded":"2024-09-10T15:25:37.047280+0000","last_fullsized":"2024-09-10T15:25:37.047280+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051560+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:25:38.051560+0000","last_peered":"2024-09-10T15:25:38.051560+0000","last_clean":"2024-09-10T15:25:38.051560+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:25:38.051560+0000","last_undegraded":"2024-09-10T15:25:38.051560+0000","last_fullsized":"2024-09-10T15:25:38.051560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829325+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:25:36.829325+0000","last_peered":"2024-09-10T15:25:36.829325+0000","last_clean":"2024-09-10T15:25:36.829325+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:25:36.829325+0000","last_undegraded":"2024-09-10T15:25:36.829325+0000","last_fullsized":"2024-09-10T15:25:36.829325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053535+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:25:38.053535+0000","last_peered":"2024-09-10T15:25:38.053535+0000","last_clean":"2024-09-10T15:25:38.053535+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:25:38.053535+0000","last_undegraded":"2024-09-10T15:25:38.053535+0000","last_fullsized":"2024-09-10T15:25:38.053535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828494+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:25:36.828494+0000","last_peered":"2024-09-10T15:25:36.828494+0000","last_clean":"2024-09-10T15:25:36.828494+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:25:36.828494+0000","last_undegraded":"2024-09-10T15:25:36.828494+0000","last_fullsized":"2024-09-10T15:25:36.828494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050354+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:25:37.050354+0000","last_peered":"2024-09-10T15:25:37.050354+0000","last_clean":"2024-09-10T15:25:37.050354+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:25:37.050354+0000","last_undegraded":"2024-09-10T15:25:37.050354+0000","last_fullsized":"2024-09-10T15:25:37.050354+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048327+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:25:37.048327+0000","last_peered":"2024-09-10T15:25:37.048327+0000","last_clean":"2024-09-10T15:25:37.048327+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:25:37.048327+0000","last_undegraded":"2024-09-10T15:25:37.048327+0000","last_fullsized":"2024-09-10T15:25:37.048327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049083+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:25:37.049083+0000","last_peered":"2024-09-10T15:25:37.049083+0000","last_clean":"2024-09-10T15:25:37.049083+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:25:37.049083+0000","last_undegraded":"2024-09-10T15:25:37.049083+0000","last_fullsized":"2024-09-10T15:25:37.049083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048314+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:25:37.048314+0000","last_peered":"2024-09-10T15:25:37.048314+0000","last_clean":"2024-09-10T15:25:37.048314+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:25:37.048314+0000","last_undegraded":"2024-09-10T15:25:37.048314+0000","last_fullsized":"2024-09-10T15:25:37.048314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832222+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:25:36.832222+0000","last_peered":"2024-09-10T15:25:36.832222+0000","last_clean":"2024-09-10T15:25:36.832222+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:25:36.832222+0000","last_undegraded":"2024-09-10T15:25:36.832222+0000","last_fullsized":"2024-09-10T15:25:36.832222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.833279+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:25:36.833279+0000","last_peered":"2024-09-10T15:25:36.833279+0000","last_clean":"2024-09-10T15:25:36.833279+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:25:36.833279+0000","last_undegraded":"2024-09-10T15:25:36.833279+0000","last_fullsized":"2024-09-10T15:25:36.833279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831113+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:25:36.831113+0000","last_peered":"2024-09-10T15:25:36.831113+0000","last_clean":"2024-09-10T15:25:36.831113+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:25:36.831113+0000","last_undegraded":"2024-09-10T15:25:36.831113+0000","last_fullsized":"2024-09-10T15:25:36.831113+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226497+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:25:37.226497+0000","last_peered":"2024-09-10T15:25:37.226497+0000","last_clean":"2024-09-10T15:25:37.226497+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:25:37.226497+0000","last_undegraded":"2024-09-10T15:25:37.226497+0000","last_fullsized":"2024-09-10T15:25:37.226497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.828521+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:25:36.828521+0000","last_peered":"2024-09-10T15:25:36.828521+0000","last_clean":"2024-09-10T15:25:36.828521+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:25:36.828521+0000","last_undegraded":"2024-09-10T15:25:36.828521+0000","last_fullsized":"2024-09-10T15:25:36.828521+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.226978+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:25:37.226978+0000","last_peered":"2024-09-10T15:25:37.226978+0000","last_clean":"2024-09-10T15:25:37.226978+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:25:37.226978+0000","last_undegraded":"2024-09-10T15:25:37.226978+0000","last_fullsized":"2024-09-10T15:25:37.226978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":40,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.225266+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:25:37.225266+0000","last_peered":"2024-09-10T15:25:37.225266+0000","last_clean":"2024-09-10T15:25:37.225266+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:25:37.225266+0000","last_undegraded":"2024-09-10T15:25:37.225266+0000","last_fullsized":"2024-09-10T15:25:37.225266+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":42,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830405+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:25:36.830405+0000","last_peered":"2024-09-10T15:25:36.830405+0000","last_clean":"2024-09-10T15:25:36.830405+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:25:36.830405+0000","last_undegraded":"2024-09-10T15:25:36.830405+0000","last_fullsized":"2024-09-10T15:25:36.830405+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051885+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:25:38.051885+0000","last_peered":"2024-09-10T15:25:38.051885+0000","last_clean":"2024-09-10T15:25:38.051885+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:25:38.051885+0000","last_undegraded":"2024-09-10T15:25:38.051885+0000","last_fullsized":"2024-09-10T15:25:38.051885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832735+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:25:36.832735+0000","last_peered":"2024-09-10T15:25:36.832735+0000","last_clean":"2024-09-10T15:25:36.832735+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:25:36.832735+0000","last_undegraded":"2024-09-10T15:25:36.832735+0000","last_fullsized":"2024-09-10T15:25:36.832735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050125+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:25:37.050125+0000","last_peered":"2024-09-10T15:25:37.050125+0000","last_clean":"2024-09-10T15:25:37.050125+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:25:37.050125+0000","last_undegraded":"2024-09-10T15:25:37.050125+0000","last_fullsized":"2024-09-10T15:25:37.050125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047414+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:25:37.047414+0000","last_peered":"2024-09-10T15:25:37.047414+0000","last_clean":"2024-09-10T15:25:37.047414+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:25:37.047414+0000","last_undegraded":"2024-09-10T15:25:37.047414+0000","last_fullsized":"2024-09-10T15:25:37.047414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829777+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:25:36.829777+0000","last_peered":"2024-09-10T15:25:36.829777+0000","last_clean":"2024-09-10T15:25:36.829777+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:25:36.829777+0000","last_undegraded":"2024-09-10T15:25:36.829777+0000","last_fullsized":"2024-09-10T15:25:36.829777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.831183+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:25:36.831183+0000","last_peered":"2024-09-10T15:25:36.831183+0000","last_clean":"2024-09-10T15:25:36.831183+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:25:36.831183+0000","last_undegraded":"2024-09-10T15:25:36.831183+0000","last_fullsized":"2024-09-10T15:25:36.831183+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.832163+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:25:36.832163+0000","last_peered":"2024-09-10T15:25:36.832163+0000","last_clean":"2024-09-10T15:25:36.832163+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:25:36.832163+0000","last_undegraded":"2024-09-10T15:25:36.832163+0000","last_fullsized":"2024-09-10T15:25:36.832163+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054267+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:25:38.054267+0000","last_peered":"2024-09-10T15:25:38.054267+0000","last_clean":"2024-09-10T15:25:38.054267+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:25:38.054267+0000","last_undegraded":"2024-09-10T15:25:38.054267+0000","last_fullsized":"2024-09-10T15:25:38.054267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054797+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:25:38.054797+0000","last_peered":"2024-09-10T15:25:38.054797+0000","last_clean":"2024-09-10T15:25:38.054797+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:25:38.054797+0000","last_undegraded":"2024-09-10T15:25:38.054797+0000","last_fullsized":"2024-09-10T15:25:38.054797+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051796+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:25:38.051796+0000","last_peered":"2024-09-10T15:25:38.051796+0000","last_clean":"2024-09-10T15:25:38.051796+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:25:38.051796+0000","last_undegraded":"2024-09-10T15:25:38.051796+0000","last_fullsized":"2024-09-10T15:25:38.051796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.054517+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:25:38.054517+0000","last_peered":"2024-09-10T15:25:38.054517+0000","last_clean":"2024-09-10T15:25:38.054517+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:25:38.054517+0000","last_undegraded":"2024-09-10T15:25:38.054517+0000","last_fullsized":"2024-09-10T15:25:38.054517+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.829215+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:25:36.829215+0000","last_peered":"2024-09-10T15:25:36.829215+0000","last_clean":"2024-09-10T15:25:36.829215+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:25:36.829215+0000","last_undegraded":"2024-09-10T15:25:36.829215+0000","last_fullsized":"2024-09-10T15:25:36.829215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":39,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.048749+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:25:37.048749+0000","last_peered":"2024-09-10T15:25:37.048749+0000","last_clean":"2024-09-10T15:25:37.048749+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:25:37.048749+0000","last_undegraded":"2024-09-10T15:25:37.048749+0000","last_fullsized":"2024-09-10T15:25:37.048749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049328+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:25:37.049328+0000","last_peered":"2024-09-10T15:25:37.049328+0000","last_clean":"2024-09-10T15:25:37.049328+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:25:37.049328+0000","last_undegraded":"2024-09-10T15:25:37.049328+0000","last_fullsized":"2024-09-10T15:25:37.049328+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051384+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:25:38.051384+0000","last_peered":"2024-09-10T15:25:38.051384+0000","last_clean":"2024-09-10T15:25:38.051384+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:25:38.051384+0000","last_undegraded":"2024-09-10T15:25:38.051384+0000","last_fullsized":"2024-09-10T15:25:38.051384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":43,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.050522+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:25:37.050522+0000","last_peered":"2024-09-10T15:25:37.050522+0000","last_clean":"2024-09-10T15:25:37.050522+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:25:37.050522+0000","last_undegraded":"2024-09-10T15:25:37.050522+0000","last_fullsized":"2024-09-10T15:25:37.050522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.051854+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:25:38.051854+0000","last_peered":"2024-09-10T15:25:38.051854+0000","last_clean":"2024-09-10T15:25:38.051854+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:25:38.051854+0000","last_undegraded":"2024-09-10T15:25:38.051854+0000","last_fullsized":"2024-09-10T15:25:38.051854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.049137+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:25:37.049137+0000","last_peered":"2024-09-10T15:25:37.049137+0000","last_clean":"2024-09-10T15:25:37.049137+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:25:37.049137+0000","last_undegraded":"2024-09-10T15:25:37.049137+0000","last_fullsized":"2024-09-10T15:25:37.049137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":44,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-09-10T15:25:37.047329+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:25:37.047329+0000","last_peered":"2024-09-10T15:25:37.047329+0000","last_clean":"2024-09-10T15:25:37.047329+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:25:37.047329+0000","last_undegraded":"2024-09-10T15:25:37.047329+0000","last_fullsized":"2024-09-10T15:25:37.047329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.053463+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:25:38.053463+0000","last_peered":"2024-09-10T15:25:38.053463+0000","last_clean":"2024-09-10T15:25:38.053463+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:25:38.053463+0000","last_undegraded":"2024-09-10T15:25:38.053463+0000","last_fullsized":"2024-09-10T15:25:38.053463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-10T15:25:36.830894+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:25:36.830894+0000","last_peered":"2024-09-10T15:25:36.830894+0000","last_clean":"2024-09-10T15:25:36.830894+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:25:36.830894+0000","last_undegraded":"2024-09-10T15:25:36.830894+0000","last_fullsized":"2024-09-10T15:25:36.830894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-09-10T15:25:38.055250+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:25:38.055250+0000","last_peered":"2024-09-10T15:25:38.055250+0000","last_clean":"2024-09-10T15:25:38.055250+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:25:38.055250+0000","last_undegraded":"2024-09-10T15:25:38.055250+0000","last_fullsized":"2024-09-10T15:25:38.055250+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":499712,"data_stored":220435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27528,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344312,"statfs":{"total":96636764160,"available":96608575488,"internally_reserved":0,"allocated":503808,"data_stored":221483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1081344,"data_stored":803307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":507904,"data_stored":221620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27524,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344316,"statfs":{"total":96636764160,"available":96608579584,"internally_reserved":0,"allocated":495616,"data_stored":220316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":462848,"data_stored":212279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1134592,"data_stored":819521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":213887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:25:40.878 INFO:tasks.thrashosds.thrasher:Setting 3.32 to [0, 1] 2024-09-10T15:25:40.878 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.32', '0', '1'] 2024-09-10T15:25:40.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.32 0 1 2024-09-10T15:25:40.909 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:40.909+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:40.963 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:40.963 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:40.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:41.025 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:41.024+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:41.082 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:25:41.111 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:41.109+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:41.131 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:41.131 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:41.149 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:41.212 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:41.209+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:41.305 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:41.306 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:41.312 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:41.313+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:41.319 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:41.414 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:41.413+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:41.440 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:41.440 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:41.454 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:41.515 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:41.513+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:41.570 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:41.571 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:41.583 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:41.628 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:41.629+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:41.714 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:41.714 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:41.716 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:41.712+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:41.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:41.817 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:41.817+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:41.909 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:25:41.918 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:41.916+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:42.019 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:42.017+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:42.084 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:42.084 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:42.085 INFO:teuthology.orchestra.run.smithi099.stderr:set 3.32 pg_upmap mapping to [0,1] 2024-09-10T15:25:42.101 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:25:42.144 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:42.145+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:42.221 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:42.220+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:42.267 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:42.267 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:42.282 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:25:42.328 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:42.329+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:42.420 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:25:42.464 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:42.465+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:42.524 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:42.521+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:42.589 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:42.589 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:42.603 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:25:42.644 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:42.645+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:42.726 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:42.724+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:42.763 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:42.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:25:42.791 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:25:42.837 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:42.836+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:42.893 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:42.894 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:42.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:25:42.939 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:42.939 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:42.955 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:42.956 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:42.956 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:42.957+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:42.972 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:42.972 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:42.988 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:42.988 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:43.007 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:43.007 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:43.027 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:43.027 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:43.028 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:43.028 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:43.028 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:43.029+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:43.042 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:25:43.045 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:43.045 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:43.064 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:43.065 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:43.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:25:43.169 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:43.168+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:43.208 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:43.208 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:43.208 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:25:43.208 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:43.222 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:25:43.230 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:43.228+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:43.331 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:43.328+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:43.348 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:43.348 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:25:43.348 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:25:43.349 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:25:43.349 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:43.363 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:25:43.432 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:43.433+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:43.489 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.594170254000002, 2024-09-10T15:25:43.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003695229, 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 208 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:43.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892426+0000", 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2030000000000002e-06 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892445+0000", 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8284e-05 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892489+0000", 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3955999999999997e-05 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892519+0000", 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0108999999999999e-05 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892691+0000", 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017201599999999999 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892998+0000", 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030683400000000002 2024-09-10T15:25:43.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.893664+0000", 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066628100000000001 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895375+0000", 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017113969999999999 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895964+0000", 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00058865999999999996 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896051+0000", 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7515000000000005e-05 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896117+0000", 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5974000000000002e-05 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.496 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.553808646, 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003242516, 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.497 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 216 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932787+0000", 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.807e-06 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932799+0000", 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2785999999999999e-05 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932831+0000", 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1350000000000003e-05 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932846+0000", 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5696999999999999e-05 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933030+0000", 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018387500000000001 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933261+0000", 2024-09-10T15:25:43.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230442 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933673+0000", 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041251299999999999 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935414+0000", 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017412930000000001 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935865+0000", 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000450941 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935952+0000", 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6971999999999993e-05 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.936026+0000", 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3839999999999998e-05 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.504 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.546937717999999, 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003146182, 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 218 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.505 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939657+0000", 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3070000000000001e-06 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939668+0000", 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1345999999999999e-05 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939700+0000", 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1579999999999999e-05 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939715+0000", 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5302999999999999e-05 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939842+0000", 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126389 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940077+0000", 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000235398 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940494+0000", 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041655000000000001 2024-09-10T15:25:43.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942043+0000", 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001549538 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942655+0000", 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061185199999999997 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942740+0000", 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4580000000000007e-05 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942801+0000", 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1339000000000003e-05 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.543569281, 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003134179, 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.512 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 219 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:43.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943025+0000", 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943034+0000", 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1260000000000004e-06 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943059+0000", 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4559999999999999e-05 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943078+0000", 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9545999999999999e-05 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943199+0000", 2024-09-10T15:25:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120766 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943448+0000", 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000248605 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943859+0000", 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041157299999999998 2024-09-10T15:25:43.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.945324+0000", 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014649159999999999 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946012+0000", 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00068786100000000001 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946091+0000", 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9072999999999993e-05 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946157+0000", 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6255999999999997e-05 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.518 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.525293296000001, 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032517259999999999, 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 224 2024-09-10T15:25:43.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961301+0000", 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2699999999999999e-06 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961314+0000", 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2830000000000001e-05 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961344+0000", 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0307e-05 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961393+0000", 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8668999999999998e-05 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961519+0000", 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012537599999999999 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961726+0000", 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020736800000000001 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.962170+0000", 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044366400000000003 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.963687+0000", 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001517731 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964402+0000", 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071518899999999997 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964490+0000", 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7134999999999998e-05 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964551+0000", 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1186999999999995e-05 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.525 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.485554751999999, 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032143179999999999, 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 235 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.526 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001040+0000", 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001052+0000", 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1686e-05 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001083+0000", 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001110+0000", 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6899000000000001e-05 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001259+0000", 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148539 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001495+0000", 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023620499999999999 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001955+0000", 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046031300000000001 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.003374+0000", 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001418683 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004098+0000", 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00072427099999999996 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004188+0000", 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9739000000000003e-05 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004252+0000", 2024-09-10T15:25:43.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3856000000000007e-05 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:351 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.439345381999999, 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031767259999999999, 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.532 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 351 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047250+0000", 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2160000000000002e-06 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047265+0000", 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4443999999999999e-05 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047310+0000", 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5435999999999997e-05 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047359+0000", 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8863000000000003e-05 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047541+0000", 2024-09-10T15:25:43.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182332 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047953+0000", 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000412194 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.048423+0000", 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046960600000000002 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.049909+0000", 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014863249999999999 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050169+0000", 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025944199999999997 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050312+0000", 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014267500000000001 2024-09-10T15:25:43.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050424+0000", 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112193 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:368 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.538 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.43527594, 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041994140000000003, 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 368 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051318+0000", 2024-09-10T15:25:43.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4330000000000001e-06 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051326+0000", 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4270000000000008e-06 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051342+0000", 2024-09-10T15:25:43.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5569999999999998e-05 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051356+0000", 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4402e-05 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051765+0000", 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040867799999999999 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052006+0000", 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240678 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052449+0000", 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044326000000000001 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053565+0000", 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001116384 2024-09-10T15:25:43.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055273+0000", 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00170733 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055412+0000", 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000139393 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055516+0000", 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103859 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:378 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.431417013000001, 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028653440000000001, 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.545 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 378 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055178+0000", 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.79e-06 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055192+0000", 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4096e-05 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055223+0000", 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0323000000000001e-05 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055242+0000", 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9513000000000001e-05 2024-09-10T15:25:43.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055624+0000", 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038226500000000001 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055809+0000", 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000184489 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056219+0000", 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040993900000000001 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057655+0000", 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001436622 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057704+0000", 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8285999999999998e-05 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057868+0000", 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164129 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058041+0000", 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017289200000000001 2024-09-10T15:25:43.551 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:401 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.424880050999999, 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004220583, 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.552 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 401 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061715+0000", 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7269999999999999e-06 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061732+0000", 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6696000000000001e-05 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061764+0000", 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2184000000000002e-05 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061786+0000", 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1676e-05 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061935+0000", 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014901500000000001 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062062+0000", 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000127317 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062269+0000", 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000206744 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.063459+0000", 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001190226 2024-09-10T15:25:43.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065746+0000", 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022868900000000002 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065870+0000", 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124129 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065933+0000", 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2978999999999995e-05 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:442 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.406150438000001, 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028624620000000001, 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.560 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 442 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080444+0000", 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.916e-06 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080455+0000", 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.076e-05 2024-09-10T15:25:43.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080478+0000", 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3269999999999999e-05 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080495+0000", 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6764000000000001e-05 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080598+0000", 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103502 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080752+0000", 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000153914 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.081097+0000", 2024-09-10T15:25:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034484899999999999 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.082189+0000", 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001092045 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083095+0000", 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090592799999999996 2024-09-10T15:25:43.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083210+0000", 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115253 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083304+0000", 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4260999999999998e-05 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:514 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.371970476000001, 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002949002, 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.567 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 514 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:43.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114624+0000", 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114633+0000", 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:25:43.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114654+0000", 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1287000000000001e-05 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114671+0000", 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7099999999999999e-05 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114747+0000", 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6309000000000004e-05 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114841+0000", 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3691999999999997e-05 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115037+0000", 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019563100000000001 2024-09-10T15:25:43.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115920+0000", 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088357799999999999 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117412+0000", 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001491746 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117495+0000", 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2465000000000004e-05 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117571+0000", 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6344e-05 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:577 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.330172333, 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002869932, 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.574 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 577 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156422+0000", 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2639999999999998e-06 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156434+0000", 2024-09-10T15:25:43.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1206000000000001e-05 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156462+0000", 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8294e-05 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156476+0000", 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4667999999999999e-05 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156581+0000", 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010480399999999999 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156756+0000", 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174694 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:43.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157050+0000", 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00029385499999999998 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157899+0000", 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00084936799999999998 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159140+0000", 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012406470000000001 2024-09-10T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159228+0000", 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7696999999999997e-05 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159290+0000", 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2434999999999994e-05 2024-09-10T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:587 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.323130713000001, 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042266669999999999, 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.581 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 587 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163464+0000", 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163475+0000", 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1070000000000001e-05 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163503+0000", 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8062999999999999e-05 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163518+0000", 2024-09-10T15:25:43.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4627000000000001e-05 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163646+0000", 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012872099999999999 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163827+0000", 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018048399999999999 2024-09-10T15:25:43.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.164224+0000", 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039711999999999999 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165380+0000", 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011557990000000001 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167476+0000", 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020961119999999998 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167595+0000", 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118585 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167688+0000", 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3789000000000006e-05 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:43.588 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.142854239999998, 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028733140000000001, 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 751 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343740+0000", 2024-09-10T15:25:43.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3259999999999998e-06 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343752+0000", 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1590000000000001e-05 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343783+0000", 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343799+0000", 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343980+0000", 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018106200000000001 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344186+0000", 2024-09-10T15:25:43.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020671099999999999 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344505+0000", 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031894099999999999 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.345596+0000", 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001090925 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346462+0000", 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086563700000000005 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346548+0000", 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5971999999999996e-05 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346611+0000", 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3700000000000003e-05 2024-09-10T15:25:43.594 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.066465409999999, 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029293980000000002, 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.595 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 787 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420130+0000", 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8729999999999999e-06 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420142+0000", 2024-09-10T15:25:43.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2106999999999999e-05 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420172+0000", 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0456000000000001e-05 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420188+0000", 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5359999999999999e-05 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420313+0000", 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125253 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420534+0000", 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220974 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:43.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420856+0000", 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032206200000000002 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.421932+0000", 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010764380000000001 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422868+0000", 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00093595899999999999 2024-09-10T15:25:43.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422950+0000", 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2039999999999994e-05 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.423056+0000", 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000105876 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.601 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.023557391000001, 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00345248, 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.602 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 805 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463037+0000", 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463049+0000", 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1620000000000001e-05 2024-09-10T15:25:43.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463079+0000", 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9876e-05 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463094+0000", 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4766999999999999e-05 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463256+0000", 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016214499999999999 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463625+0000", 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036956700000000001 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.464163+0000", 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053810299999999995 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.465401+0000", 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012375940000000001 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466225+0000", 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000824277 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466379+0000", 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000154172 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466487+0000", 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108006 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.608 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.018677526000001, 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030487999999999999, 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 807 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:43.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467917+0000", 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1239999999999999e-06 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467928+0000", 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0966e-05 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467961+0000", 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2762999999999998e-05 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467980+0000", 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8960000000000001e-05 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468104+0000", 2024-09-10T15:25:43.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012481600000000001 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468336+0000", 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231055 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468793+0000", 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045788699999999998 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470004+0000", 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012103859999999999 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470810+0000", 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00080637799999999996 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470900+0000", 2024-09-10T15:25:43.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9412000000000004e-05 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470964+0000", 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4053000000000005e-05 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.615 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.824343912, 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030323030000000001, 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 889 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662252+0000", 2024-09-10T15:25:43.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0570000000000001e-06 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662268+0000", 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6093e-05 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662299+0000", 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1795999999999998e-05 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662315+0000", 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.524e-05 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662441+0000", 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012639199999999999 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662672+0000", 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023079200000000001 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.663000+0000", 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032838099999999999 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.664150+0000", 2024-09-10T15:25:43.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011496639999999999 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665089+0000", 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000939203 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665174+0000", 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4886e-05 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665281+0000", 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679900000000001 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.810474519, 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030863430000000001, 2024-09-10T15:25:43.622 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 895 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676120+0000", 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.216e-06 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676131+0000", 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1243999999999999e-05 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676162+0000", 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0692999999999999e-05 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676177+0000", 2024-09-10T15:25:43.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5366000000000002e-05 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676353+0000", 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017565899999999999 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676575+0000", 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000222208 2024-09-10T15:25:43.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676894+0000", 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031855099999999998 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.677954+0000", 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010597919999999999 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679048+0000", 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010947719999999999 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679140+0000", 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1911999999999997e-05 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679204+0000", 2024-09-10T15:25:43.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3930000000000006e-05 2024-09-10T15:25:43.629 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.629 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.629 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.629 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:43.629 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:43.629 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:43.631 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:43.631 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:43.628+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:43.731 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:43.729+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:43.754 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:43.754 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:43.755 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:43.755 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:43.768 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:43.832 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:43.828+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:43.889 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:43.890 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:43.890 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:43.903 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:43.945 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:43.944+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:44.034 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:44.032+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.195970182, 2024-09-10T15:25:44.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:25:44.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:25:44.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.162334891, 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.072 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:44.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:25:44.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.080 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.056680926999999, 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:25:44.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.180940571000001, 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:25:44.086 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:25:44.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:44.092 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.165073564, 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:44.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.145593883, 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.098 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:25:44.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.132787619999998, 2024-09-10T15:25:44.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:25:44.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.110883432000001, 2024-09-10T15:25:44.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:25:44.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.092317155, 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.116 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:25:44.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.038800988999999, 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:44.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.033596955, 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:25:44.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.021051838000002, 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:44.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.139 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.020351601000002, 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:25:44.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:25:44.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:44.145 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.013143571000001, 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:25:44.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:25:44.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.841328795999999, 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:25:44.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:25:44.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:25:44.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.155 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.725058896, 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:44.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:25:44.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:25:44.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.688019265000001, 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.166 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.680824447999999, 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.167 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:25:44.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:25:44.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:44.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:44.172 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.676374872, 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:44.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:25:44.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:25:44.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.477109989999999, 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.178 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:44.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.180 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.183 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.184 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.184 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.184 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:44.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:44.186 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:25:44.186 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:44.184+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:44.286 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:44.285+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:44.351 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:44.351 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:44.351 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:44.351 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:44.366 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:44.409 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:44.408+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:44.482 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:44.482 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:44.482 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:44.482 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:44.483 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:44.487 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:44.485+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:44.495 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:44.588 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:44.584+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.665 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.318362645000001, 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.666 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:25:44.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.950684092000003, 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.674 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:25:44.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:25:44.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.950467463999999, 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.682 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:25:44.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:25:44.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.950390190999997, 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:25:44.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:25:44.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:25:44.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:25:44.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.697 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.852384518000001, 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:44.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:25:44.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.679841715999999, 2024-09-10T15:25:44.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:25:44.706 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:44.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:25:44.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:25:44.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:25:44.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:25:44.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:25:44.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:25:44.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.679727036999999, 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:25:44.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:25:44.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:25:44.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.679442330000001, 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:44.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:25:44.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:25:44.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:25:44.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.729 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.679347243000002, 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:25:44.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.678909154000003, 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:25:44.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.678845340999999, 2024-09-10T15:25:44.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:25:44.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:25:44.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.678758197999997, 2024-09-10T15:25:44.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:44.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:25:44.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.758 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.678551372999998, 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:25:44.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:44.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:25:44.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:25:44.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:44.766 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.678482703999997, 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:25:44.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:25:44.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.190892308999999, 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.774 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:25:44.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:25:44.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.780 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.190841976999998, 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.781 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:25:44.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:25:44.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:25:44.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.190640258000002, 2024-09-10T15:25:44.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:25:44.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:25:44.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.795 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.190605752000003, 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.796 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:25:44.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.190558785, 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:25:44.803 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:44.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:25:44.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.190304963999999, 2024-09-10T15:25:44.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:44.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:44.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:25:44.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:44.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:25:44.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:44.817 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:44.819 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:44.820 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:44.816+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:44.920 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:44.916+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:44.992 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:44.992 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:44.992 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:44.992 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:45.006 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:45.049 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:45.048+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:45.083 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:45.137 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:45.136+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:45.183 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:45.183 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:45.183 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:45.183 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:45.183 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:45.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:45.229 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:45.229 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:45.230 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:45.228+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:45.246 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:45.247 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:45.267 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:45.267 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:45.285 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:45.285 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:45.307 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:45.307 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:45.324 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:45.324+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:45.328 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:45.329 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:45.346 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:45.346 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:45.352 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:45.352 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:45.360 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:45.371 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:45.372 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:45.437 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:45.436+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:45.484 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:45.484 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:45.498 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:45.545 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:45.544+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:45.627 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:45.628+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:45.663 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:45.663 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:45.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:45.728 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:45.728+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:45.791 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:45.791 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:45.805 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:45.853 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:45.852+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:45.929 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:45.928+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:45.938 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:45.938 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:45.952 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:46.030 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:46.028+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:46.123 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:46.123 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:46.131 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:46.128+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:46.138 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:25:46.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:25:46.233 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:46.232+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:46.255 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:46.269 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:25:46.333 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:46.332+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:46.391 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:46.391 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:46.404 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:25:46.434 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:46.432+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:46.535 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:46.532+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:46.566 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:46.566 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:46.579 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:25:46.668 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:46.668+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:46.737 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:46.736+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:46.743 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:46.743 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:46.758 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:25:46.844 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:46.844+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:46.923 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:46.924 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:46.937 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:25:46.980 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:46.980+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:47.040 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:47.036+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:47.105 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:47.105 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:47.119 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:25:47.120 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:25:47.164 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:47.164+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:47.238 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:47.238 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:47.242 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:47.240+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:47.252 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:25:47.342 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:47.340+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:47.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:25:47.421 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:47.422 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:47.436 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:25:47.480 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:47.480+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:47.540 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:47.540 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:47.543 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:47.540+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:47.553 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:47.553 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:47.557 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:47.557 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:47.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:25:47.574 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:47.575 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:47.592 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:47.592 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:47.610 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:47.610 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:47.628 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:47.628 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:47.644 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:47.640+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:47.645 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:47.645 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:47.663 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:47.663 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:47.737 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:25:47.737 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:25:47.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:25:47.737 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:25:47.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.737 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.841319510000002, 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003695229, 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 208 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892426+0000", 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2030000000000002e-06 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892445+0000", 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8284e-05 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892489+0000", 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3955999999999997e-05 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892519+0000", 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0108999999999999e-05 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892691+0000", 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017201599999999999 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892998+0000", 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030683400000000002 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.893664+0000", 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066628100000000001 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895375+0000", 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017113969999999999 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895964+0000", 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00058865999999999996 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896051+0000", 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7515000000000005e-05 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896117+0000", 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5974000000000002e-05 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.800957902, 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003242516, 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.743 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 216 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:25:47.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932787+0000", 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.807e-06 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932799+0000", 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2785999999999999e-05 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932831+0000", 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1350000000000003e-05 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932846+0000", 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5696999999999999e-05 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933030+0000", 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018387500000000001 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.746 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933261+0000", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230442 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933673+0000", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041251299999999999 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935414+0000", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017412930000000001 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935865+0000", 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000450941 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935952+0000", 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6971999999999993e-05 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.936026+0000", 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3839999999999998e-05 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.794086973999999, 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003146182, 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 218 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939655+0000", 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939657+0000", 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3070000000000001e-06 2024-09-10T15:25:47.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939668+0000", 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1345999999999999e-05 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939700+0000", 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1579999999999999e-05 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939715+0000", 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5302999999999999e-05 2024-09-10T15:25:47.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.939842+0000", 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126389 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940077+0000", 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000235398 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.940494+0000", 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041655000000000001 2024-09-10T15:25:47.752 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942043+0000", 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001549538 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942655+0000", 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061185199999999997 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942740+0000", 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4580000000000007e-05 2024-09-10T15:25:47.753 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.942801+0000", 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1339000000000003e-05 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.790718537, 2024-09-10T15:25:47.754 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003134179, 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 219 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.755 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943023+0000", 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943025+0000", 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943034+0000", 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1260000000000004e-06 2024-09-10T15:25:47.756 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943059+0000", 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4559999999999999e-05 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943078+0000", 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9545999999999999e-05 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943199+0000", 2024-09-10T15:25:47.757 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120766 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943448+0000", 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000248605 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.943859+0000", 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041157299999999998 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.758 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.945324+0000", 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014649159999999999 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946012+0000", 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00068786100000000001 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946091+0000", 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9072999999999993e-05 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.759 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.946157+0000", 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6255999999999997e-05 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.772442552000001, 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032517259999999999, 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.760 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 224 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:25:47.761 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961301+0000", 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2699999999999999e-06 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961314+0000", 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2830000000000001e-05 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961344+0000", 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0307e-05 2024-09-10T15:25:47.762 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961393+0000", 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8668999999999998e-05 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961519+0000", 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012537599999999999 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.763 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961726+0000", 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020736800000000001 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.962170+0000", 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044366400000000003 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.963687+0000", 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001517731 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.764 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964402+0000", 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071518899999999997 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964490+0000", 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7134999999999998e-05 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964551+0000", 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1186999999999995e-05 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.765 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:235 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.732704007999999, 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032143179999999999, 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.766 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 235 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001038+0000", 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.767 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001040+0000", 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001052+0000", 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1686e-05 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001083+0000", 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:25:47.768 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001110+0000", 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6899000000000001e-05 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001259+0000", 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148539 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001495+0000", 2024-09-10T15:25:47.769 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023620499999999999 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.001955+0000", 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046031300000000001 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.003374+0000", 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001418683 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.770 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004098+0000", 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00072427099999999996 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004188+0000", 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9739000000000003e-05 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.004252+0000", 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3856000000000007e-05 2024-09-10T15:25:47.771 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:351 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.686494637999999, 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031767259999999999, 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.772 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 351 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047247+0000", 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.773 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047250+0000", 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2160000000000002e-06 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047265+0000", 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4443999999999999e-05 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047310+0000", 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5435999999999997e-05 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047359+0000", 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8863000000000003e-05 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047541+0000", 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182332 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.775 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047953+0000", 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000412194 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.048423+0000", 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046960600000000002 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.049909+0000", 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014863249999999999 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050169+0000", 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025944199999999997 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050312+0000", 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014267500000000001 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.050424+0000", 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112193 2024-09-10T15:25:47.777 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:368 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.682425196000001, 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041994140000000003, 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.778 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 368 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051318+0000", 2024-09-10T15:25:47.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4330000000000001e-06 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051326+0000", 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4270000000000008e-06 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051342+0000", 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5569999999999998e-05 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051356+0000", 2024-09-10T15:25:47.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4402e-05 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051765+0000", 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040867799999999999 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052006+0000", 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240678 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052449+0000", 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044326000000000001 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053565+0000", 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001116384 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055273+0000", 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00170733 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055412+0000", 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000139393 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055516+0000", 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103859 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:378 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.678566269000001, 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028653440000000001, 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 378 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055175+0000", 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055178+0000", 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.79e-06 2024-09-10T15:25:47.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055192+0000", 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4096e-05 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055223+0000", 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0323000000000001e-05 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055242+0000", 2024-09-10T15:25:47.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9513000000000001e-05 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055624+0000", 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038226500000000001 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055809+0000", 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000184489 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056219+0000", 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040993900000000001 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057655+0000", 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001436622 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057704+0000", 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8285999999999998e-05 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057868+0000", 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164129 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058041+0000", 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017289200000000001 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:401 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.789 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.672029306999999, 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004220583, 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 401 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061715+0000", 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7269999999999999e-06 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061732+0000", 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6696000000000001e-05 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061764+0000", 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2184000000000002e-05 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061786+0000", 2024-09-10T15:25:47.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1676e-05 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061935+0000", 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014901500000000001 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062062+0000", 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000127317 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062269+0000", 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000206744 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.063459+0000", 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001190226 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065746+0000", 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022868900000000002 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065870+0000", 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124129 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065933+0000", 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2978999999999995e-05 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:442 6.0 6:02683654:reshard::reshard.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.795 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.653299694000001, 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028624620000000001, 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 442 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080442+0000", 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080444+0000", 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.916e-06 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080455+0000", 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.076e-05 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080478+0000", 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3269999999999999e-05 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080495+0000", 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6764000000000001e-05 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080598+0000", 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103502 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.080752+0000", 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000153914 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.081097+0000", 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034484899999999999 2024-09-10T15:25:47.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.082189+0000", 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001092045 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083095+0000", 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090592799999999996 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083210+0000", 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115253 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.083304+0000", 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4260999999999998e-05 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:514 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.801 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.619119732000001, 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002949002, 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 514 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114622+0000", 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114624+0000", 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114633+0000", 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114654+0000", 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1287000000000001e-05 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114671+0000", 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7099999999999999e-05 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114747+0000", 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6309000000000004e-05 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.114841+0000", 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3691999999999997e-05 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115037+0000", 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019563100000000001 2024-09-10T15:25:47.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.115920+0000", 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088357799999999999 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117412+0000", 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001491746 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117495+0000", 2024-09-10T15:25:47.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2465000000000004e-05 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.117571+0000", 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6344e-05 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:577 6.0 6:03bbb29a:::obj_delete_at_hint.0000000026:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:47.807 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.577321589, 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002869932, 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 577 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:47.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156420+0000", 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156422+0000", 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2639999999999998e-06 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156434+0000", 2024-09-10T15:25:47.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1206000000000001e-05 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156462+0000", 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8294e-05 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156476+0000", 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4667999999999999e-05 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156581+0000", 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010480399999999999 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.156756+0000", 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174694 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157050+0000", 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00029385499999999998 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.157899+0000", 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00084936799999999998 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159140+0000", 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012406470000000001 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159228+0000", 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7696999999999997e-05 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.159290+0000", 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2434999999999994e-05 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:587 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.570279969000001, 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042266669999999999, 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.813 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 587 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163464+0000", 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163475+0000", 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1070000000000001e-05 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163503+0000", 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8062999999999999e-05 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163518+0000", 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4627000000000001e-05 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163646+0000", 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012872099999999999 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163827+0000", 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018048399999999999 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.164224+0000", 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039711999999999999 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165380+0000", 2024-09-10T15:25:47.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011557990000000001 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167476+0000", 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020961119999999998 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167595+0000", 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118585 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167688+0000", 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3789000000000006e-05 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.390003495999999, 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028733140000000001, 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.819 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 751 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343738+0000", 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343740+0000", 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3259999999999998e-06 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343752+0000", 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1590000000000001e-05 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343783+0000", 2024-09-10T15:25:47.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343799+0000", 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.343980+0000", 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018106200000000001 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344186+0000", 2024-09-10T15:25:47.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020671099999999999 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.344505+0000", 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031894099999999999 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.345596+0000", 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001090925 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346462+0000", 2024-09-10T15:25:47.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086563700000000005 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346548+0000", 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5971999999999996e-05 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.346611+0000", 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3700000000000003e-05 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:787 6.0 6:0216b5b6:::obj_delete_at_hint.0000000070:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.313614665999999, 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029293980000000002, 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 787 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.825 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420127+0000", 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420130+0000", 2024-09-10T15:25:47.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8729999999999999e-06 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420142+0000", 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2106999999999999e-05 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420172+0000", 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0456000000000001e-05 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420188+0000", 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5359999999999999e-05 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420313+0000", 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125253 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420534+0000", 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220974 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.420856+0000", 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032206200000000002 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.421932+0000", 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010764380000000001 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422868+0000", 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00093595899999999999 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.422950+0000", 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2039999999999994e-05 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.423056+0000", 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000105876 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.830 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.270706647000001, 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00345248, 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 805 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463037+0000", 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:25:47.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463049+0000", 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1620000000000001e-05 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463079+0000", 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9876e-05 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463094+0000", 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4766999999999999e-05 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463256+0000", 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016214499999999999 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463625+0000", 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036956700000000001 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.464163+0000", 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053810299999999995 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.465401+0000", 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012375940000000001 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466225+0000", 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000824277 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466379+0000", 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000154172 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466487+0000", 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108006 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.265826782000001, 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030487999999999999, 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 807 2024-09-10T15:25:47.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467915+0000", 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467917+0000", 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1239999999999999e-06 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467928+0000", 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0966e-05 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467961+0000", 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2762999999999998e-05 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.467980+0000", 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8960000000000001e-05 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468104+0000", 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012481600000000001 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468336+0000", 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231055 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.468793+0000", 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045788699999999998 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470004+0000", 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012103859999999999 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470810+0000", 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00080637799999999996 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470900+0000", 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9412000000000004e-05 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.470964+0000", 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4053000000000005e-05 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.842 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:889 6.0 6:0255b7ba:::obj_delete_at_hint.0000000104:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.071493168, 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030323030000000001, 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 889 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662248+0000", 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662252+0000", 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0570000000000001e-06 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662268+0000", 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6093e-05 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662299+0000", 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1795999999999998e-05 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662315+0000", 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.524e-05 2024-09-10T15:25:47.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662441+0000", 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012639199999999999 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662672+0000", 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023079200000000001 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.663000+0000", 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032838099999999999 2024-09-10T15:25:47.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.664150+0000", 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011496639999999999 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665089+0000", 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000939203 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665174+0000", 2024-09-10T15:25:47.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4886e-05 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.665281+0000", 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679900000000001 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.057623775, 2024-09-10T15:25:47.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030863430000000001, 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 895 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:47.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676118+0000", 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676120+0000", 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.216e-06 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676131+0000", 2024-09-10T15:25:47.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1243999999999999e-05 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676162+0000", 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0692999999999999e-05 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676177+0000", 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5366000000000002e-05 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:25:47.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676353+0000", 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017565899999999999 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676575+0000", 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000222208 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.676894+0000", 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031855099999999998 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:25:47.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.677954+0000", 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010597919999999999 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679048+0000", 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010947719999999999 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679140+0000", 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1911999999999997e-05 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:25:47.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.679204+0000", 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3930000000000006e-05 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:25:47.854 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:25:47.855 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:47.856 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:47.852+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:47.956 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:47.956+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:47.979 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:47.979 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:47.980 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:47.980 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:47.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:48.058 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:48.056+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:48.107 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:48.107 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:48.108 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:48.108 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:48.108 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:48.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:48.165 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:48.164+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.381617857999998, 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:25:48.248 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:25:48.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:25:48.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:48.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:25:48.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.347982566999999, 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.256 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:25:48.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:25:48.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.242328603000001, 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:25:48.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:25:48.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:25:48.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.366588246999999, 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.268 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:25:48.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:25:48.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.350721239999999, 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.274 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:25:48.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.331241558999999, 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:25:48.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:25:48.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:25:48.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:48.286 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.318435296000001, 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:48.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.296531108, 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.293 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:25:48.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:25:48.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.277964830999998, 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:25:48.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:25:48.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.224448665000001, 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:25:48.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.310 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.219244630999999, 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.311 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:25:48.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:25:48.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.206699514, 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:25:48.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:25:48.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:25:48.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.205999277, 2024-09-10T15:25:48.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:25:48.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:25:48.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.198791246999999, 2024-09-10T15:25:48.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:25:48.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:25:48.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.026976472000001, 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.910706571999999, 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:25:48.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:25:48.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.873666941, 2024-09-10T15:25:48.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:25:48.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:25:48.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:48.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.866472124000001, 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:48.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:25:48.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.862022547999999, 2024-09-10T15:25:48.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:48.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:25:48.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:25:48.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.662757666000001, 2024-09-10T15:25:48.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:48.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:25:48.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.369 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:48.371 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:48.371 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:48.368+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:48.471 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:48.468+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:48.537 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:48.538 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:48.538 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:48.538 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:48.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:48.572 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:48.568+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:48.672 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:48.667+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:48.679 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:48.679 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:48.680 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:48.695 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:48.773 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:48.772+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.508470627000001, 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:25:48.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:25:48.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.140792073999997, 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:25:48.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.140575446, 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:25:48.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.140498172999997, 2024-09-10T15:25:48.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:25:48.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:25:48.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.042492500000002, 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:48.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:25:48.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:25:48.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.869949697999999, 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.886 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:25:48.891 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.869835019, 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.892 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:25:48.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:25:48.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.897 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.869550312000001, 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.898 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:25:48.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:25:48.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.869455225000003, 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:25:48.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:25:48.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:25:48.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.869017135999997, 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:25:48.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:25:48.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.915 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.868953323, 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:25:48.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:25:48.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.868866179999998, 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.922 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:25:48.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:25:48.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.927 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.868659354999998, 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.928 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:25:48.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.933 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.868590685999997, 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:25:48.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:25:48.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.381000290999999, 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.940 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:25:48.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:25:48.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.380949958999999, 2024-09-10T15:25:48.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:25:48.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:25:48.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.380748240000003, 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:25:48.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.956 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.380713733999997, 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:25:48.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:48.962 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.380666767000001, 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:25:48.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 47.380412946, 2024-09-10T15:25:48.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:48.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:25:48.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:25:48.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:48.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:48.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:48.974 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:48.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:48.976 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:48.972+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:49.077 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:49.075+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:49.099 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:49.100 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:49.100 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:49.100 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:49.113 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:49.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:25:49.178 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:49.176+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:49.275 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:49.275 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:49.275 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:49.275 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:49.275 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:49.279 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:49.275+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:49.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:49.381 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:49.375+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:49.449 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.716903162999998, 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:25:49.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.522071960000002, 2024-09-10T15:25:49.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:25:49.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.511992751000001, 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:25:49.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:25:49.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:25:49.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.467601290000001, 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:49.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.327956904000001, 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.469 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:25:49.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:25:49.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.321121464000001, 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.475 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:49.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:25:49.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.311380519, 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.481 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:49.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:25:49.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:25:49.485 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.18787614, 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:25:49.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.167553998999999, 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.490 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:25:49.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:25:49.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:25:49.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.162536348, 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.496 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:49.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:25:49.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.042717176, 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.502 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:25:49.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:25:49.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.962169683999999, 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:49.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.958226491000001, 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:25:49.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.893725672999999, 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:25:49.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.890135750999999, 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.520 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.869363657000001, 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:25:49.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.865688359, 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.529 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.533 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.737537207999999, 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:25:49.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:25:49.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.733634724000002, 2024-09-10T15:25:49.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:25:49.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:25:49.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:49.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 25.695457589, 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:49.545 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:25:49.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:25:49.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:49.549 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:49.551 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:49.551 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:49.548+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:49.651 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:49.647+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:49.679 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:49.714 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:49.715 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:49.715 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:49.728 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:49.773 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:49.771+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:49.854 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:49.852+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:49.878 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:49.878 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:49.899 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:49.899 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:49.899 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:49.899 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:49.900 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:49.910 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:49.916 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:49.931 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:49.931 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:49.954 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:49.951+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:49.959 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:49.959 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:49.979 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:49.980 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:50.011 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:50.011 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:50.031 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:50.088 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:50.089 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:50.089 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:50.090 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:50.090 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:50.092 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:50.088+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:50.093 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:50.135 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:25:50.205 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:50.203+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:50.229 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:50.229 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:50.243 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:50.293 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:50.291+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:50.367 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:50.367 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:50.382 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:25:50.394 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:50.391+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:50.495 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:50.492+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:50.505 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:50.505 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:50.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:25:50.595 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:50.591+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:50.686 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:50.687 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:50.696 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:50.691+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:50.701 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:25:50.797 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:50.796+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:50.822 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:50.823 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:50.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:25:50.898 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:50.895+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:50.999 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:50.996+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:51.003 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:51.003 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:51.017 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:25:51.105 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:51.104+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:51.185 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:51.185 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:51.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:25:51.201 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:51.195+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:51.302 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:51.300+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:51.361 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:51.361 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:51.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:25:51.417 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:51.416+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:51.503 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:51.500+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:51.534 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:51.534 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:51.548 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:25:51.603 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:51.599+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:51.704 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:51.704+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:51.731 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:25:51.816 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:51.816+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:51.901 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:51.901 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:51.906 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:51.903+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:51.913 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:25:52.007 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:52.003+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:52.077 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:52.077 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:52.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:52.092 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:25:52.108 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:52.104+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:52.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:25:52.209 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:52.207+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:52.265 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:52.265 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:52.285 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:52.293 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:52.293 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:52.310 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:52.308+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:52.324 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:52.324 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:52.354 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:52.355 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:52.385 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:52.385 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:52.412 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:52.408+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:52.418 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:52.418 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:52.451 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:52.451 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:52.464 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:52.464 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:52.464 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:52.465 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:52.465 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:52.484 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:52.485 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:52.485 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:52.517 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:52.517 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:52.518 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:52.515+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:52.613 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:52.612+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.821417707000002, 2024-09-10T15:25:52.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:52.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:25:52.696 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.787782415999999, 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.697 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:25:52.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.682128452000001, 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.703 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:25:52.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:25:52.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.806388095999999, 2024-09-10T15:25:52.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:52.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:52.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.790521088999999, 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:25:52.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:25:52.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:25:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.771041407999999, 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:25:52.721 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:25:52.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:25:52.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.758235145, 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.727 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:25:52.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:25:52.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.736330957, 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.733 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.717764679999998, 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.738 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:25:52.743 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.664248514000001, 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.744 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:25:52.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.659044479999999, 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.750 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:25:52.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:25:52.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.646499363, 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:25:52.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:25:52.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.645799126, 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:25:52.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:25:52.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:25:52.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.638591095999999, 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:25:52.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:25:52.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.466776321000001, 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:52.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:25:52.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.350506420999999, 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:25:52.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:25:52.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:25:52.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.31346679, 2024-09-10T15:25:52.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:52.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:25:52.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:52.790 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.306271973000001, 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:25:52.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.795 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.796 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.301822396999999, 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:25:52.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:25:52.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:25:52.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.102557515000001, 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:52.803 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:25:52.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:52.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:52.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:52.809 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:52.810 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:52.811 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:52.808+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:52.911 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:52.908+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:52.980 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:52.980 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:52.980 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:52.980 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:52.998 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:53.012 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:53.012+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:53.113 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:53.112+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:53.159 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:25:53.166 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:53.166 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:53.166 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:53.190 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:53.234 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:53.231+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:53.316 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:53.312+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:53.400 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.055220745, 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.401 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:25:53.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:25:53.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:53.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.687542192000002, 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:53.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:25:53.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:25:53.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:25:53.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.687325563999998, 2024-09-10T15:25:53.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:53.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:25:53.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.687248291000003, 2024-09-10T15:25:53.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:25:53.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:25:53.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:25:53.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:25:53.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.589242618, 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.425 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:25:53.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:25:53.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:25:53.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.416699815999998, 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.431 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:25:53.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.416585136999998, 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.437 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:25:53.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:25:53.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:25:53.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.41630043, 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.443 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:25:53.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:25:53.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.416205343000001, 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:25:53.449 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:25:53.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.415767254000002, 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.455 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:25:53.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:25:53.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.415703440999998, 2024-09-10T15:25:53.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:53.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:25:53.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:25:53.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.415616298000003, 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:25:53.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.415409472999997, 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.473 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.478 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 52.415340804000003, 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:25:53.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:25:53.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:25:53.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.927750408999998, 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.485 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:25:53.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.927700076999997, 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.491 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:25:53.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:25:53.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.927498358000001, 2024-09-10T15:25:53.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:53.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:25:53.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:25:53.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.927463852000002, 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:25:53.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:25:53.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.927416885, 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.510 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:53.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:25:53.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.515 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 51.927163063999998, 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:25:53.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:25:53.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:25:53.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:53.521 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:53.523 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:53.523 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:53.519+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:53.624 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:53.619+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:53.726 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:53.724+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:53.733 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:53.733 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:53.734 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:53.751 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:53.827 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:53.824+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:53.928 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:53.923+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:53.961 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:53.961 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:53.962 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:53.962 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:53.978 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:54.029 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:54.028+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:54.129 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:54.127+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:25:54.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.458112294000003, 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:25:54.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:25:54.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:54.196 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.263281091, 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:25:54.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:25:54.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:25:54.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.253201881999999, 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.203 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:25:54.208 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.208810420999999, 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.209 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.069166034999999, 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:25:54.213 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.062330594999999, 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.219 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:25:54.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:25:54.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:25:54.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 31.052589650000002, 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.225 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:25:54.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:25:54.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.929085271000002, 2024-09-10T15:25:54.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.908763130000001, 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.234 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:25:54.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:54.239 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.903745479000001, 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:25:54.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.783926307000002, 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:25:54.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.703378815000001, 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:25:54.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.699435621999999, 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:25:54.253 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:25:54.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.634934804, 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:25:54.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:25:54.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:25:54.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.631344882, 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:25:54.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:25:54.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:25:54.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.610572787999999, 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:25:54.267 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:25:54.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.606897490000001, 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:25:54.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:25:54.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:54.276 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.478746339000001, 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.474843855, 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.282 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:25:54.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:25:54.287 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 30.436666720000002, 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:54.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:54.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:54.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:54.292 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:54.293 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:54.294 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:54.292+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:54.394 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:54.391+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:54.494 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:54.491+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:54.506 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:54.506 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:54.506 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:54.524 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:54.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:54.609 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:54.607+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:54.696 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:54.691+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:54.734 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:54.734 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:54.734 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:54.753 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:54.762 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:54.762 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:54.793 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:54.793 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:54.797 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:54.796+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:54.823 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:54.823 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:54.854 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:54.854 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:54.886 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:54.887 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:54.897 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:54.895+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:54.919 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:54.919 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:54.931 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:54.931 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:54.950 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:54.952 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:54.953 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:54.984 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:54.984 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:54.998 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:54.995+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:55.083 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.084 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:55.099 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:55.095+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:55.192 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:25:55.217 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.217 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.233 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:25:55.237 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:55.235+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:55.301 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:55.295+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:55.354 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.354 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.370 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:25:55.402 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:55.399+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:55.493 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.493 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.502 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:55.499+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:55.507 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:25:55.604 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:55.599+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:55.630 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.630 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:25:55.705 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:55.703+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:55.767 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.767 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:25:55.806 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:55.803+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:55.901 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:55.901 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:55.907 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:55.904+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:55.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:25:56.008 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:56.003+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:56.078 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:56.078 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:56.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:25:56.137 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:56.136+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:56.176 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:25:56.218 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:56.218 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:56.233 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:25:56.241 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:25:56.239+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:25:56.325 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:56.324+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:56.407 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:56.407 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:56.410 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:56.408+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:56.421 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:25:56.511 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:56.507+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:56.586 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:56.586 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:56.600 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:25:56.649 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:56.648+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:56.713 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:56.712+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:56.721 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:56.722 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:56.736 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:25:56.814 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:56.811+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:56.906 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:56.906 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:56.915 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:56.911+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:56.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:25:57.007 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:25:57.016 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:57.012+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:57.116 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:57.116+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:57.140 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:57.140 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:57.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:25:57.217 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:57.215+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:57.218 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:57.218 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:57.248 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:57.248 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:57.278 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:57.279 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:57.309 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:57.309 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:57.319 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:57.316+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:57.338 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.470735294999997, 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:25:57.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:25:57.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.437100004000001, 2024-09-10T15:25:57.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:57.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:25:57.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:57.352 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.331446040000003, 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:25:57.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:25:57.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:25:57.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.455705684000002, 2024-09-10T15:25:57.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:25:57.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:25:57.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.439838676999997, 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:25:57.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.420358995999997, 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.370 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:25:57.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:25:57.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:25:57.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.407552733000003, 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.376 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:25:57.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:25:57.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:25:57.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.385648545000002, 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:25:57.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.387 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.367082267999997, 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.313566102000003, 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.393 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:25:57.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.398 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.308362068000001, 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.399 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.404 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.295816950999999, 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:25:57.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.295116714000002, 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:57.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:25:57.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.287908684000001, 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.416 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:25:57.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:25:57.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:25:57.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.116093909, 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:25:57.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:25:57.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.426 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.999824009000001, 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.427 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:25:57.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:25:57.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.962784378000002, 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:25:57.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:25:57.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.438 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.955589560999996, 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:25:57.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:25:57.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:57.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.951139984999998, 2024-09-10T15:25:57.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:25:57.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:25:57.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:25:57.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.751875103000003, 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:25:57.450 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:57.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:25:57.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:57.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:57.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:57.456 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:57.457 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:57.457 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:57.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:25:57.459 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:57.459 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:57.459 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:57.459 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:57.460 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:57.460 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:57.460 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:57.456+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:57.558 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:57.555+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:57.659 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:57.656+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:57.672 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:57.672 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:57.672 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:57.672 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:57.689 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:25:57.781 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:57.779+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:57.861 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:25:57.860+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:25:57.900 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:57.900 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:57.901 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:57.901 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:57.901 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:57.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:25:57.962 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:57.960+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:58.063 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:58.060+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:58.137 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:58.137 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:58.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:58.137 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:58.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.791613554999998, 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:25:58.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:25:58.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.423935002, 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.145 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:25:58.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.423718374000003, 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.151 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:25:58.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:25:58.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.156 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.423641101000001, 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.157 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:25:58.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.325635427999998, 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:25:58.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:25:58.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:25:58.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.153092626000003, 2024-09-10T15:25:58.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:25:58.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:25:58.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:25:58.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.173 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.152977946999997, 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.174 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:25:58.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.179 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.152693239999998, 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.180 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.181 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.182 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.183 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:25:58.184 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.152598153, 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:25:58.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:25:58.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:25:58.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:25:58.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.152160064, 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:25:58.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:25:58.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:25:58.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.152096251000003, 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.197 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:25:58.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:25:58.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:25:58.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.152009108000001, 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.203 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:25:58.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:25:58.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.151802283000002, 2024-09-10T15:25:58.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:25:58.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:25:58.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.151733614000001, 2024-09-10T15:25:58.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:25:58.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:25:58.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:25:58.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.664143219000003, 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:25:58.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:25:58.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:25:58.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.664092887000002, 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.227 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:58.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:25:58.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.663891167999999, 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.233 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.234 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:25:58.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.234 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:25:58.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:25:58.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:58.240 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.663856662000001, 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.663809694999998, 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.246 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:25:58.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.663555873999996, 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:25:58.252 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:25:58.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:25:58.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:25:58.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.258 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:58.259 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:25:58.260 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:25:58.260+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:25:58.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:25:58.361 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:58.355+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:58.462 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:25:58.460+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:25:58.475 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:58.475 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:58.475 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:58.475 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:58.493 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:25:58.581 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:58.579+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:58.663 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:58.659+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:58.705 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:58.705 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:58.723 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:25:58.765 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:58.763+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:58.865 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:58.864+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:58.935 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:58.935 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.202663969, 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:25:58.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:25:58.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:58.940 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.007832766, 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:25:58.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.944 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.997753557000003, 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:25:58.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:25:58.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.953362095999999, 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:25:58.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:25:58.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.813717709999999, 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.955 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.956 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:25:58.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.806882270000003, 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:25:58.961 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:25:58.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:25:58.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:25:58.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.797141324999998, 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:25:58.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:25:58.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:25:58.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:58.971 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.673636946000002, 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:25:58.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.975 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.653314805000001, 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:58.976 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:25:58.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:25:58.981 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.648297153999998, 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:58.982 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:25:58.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:25:58.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:25:58.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:25:58.987 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.528477981999998, 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:25:58.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:25:58.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:25:58.991 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.447930489999997, 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.443987297, 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:58.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:58.999 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.379486479000001, 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:25:59.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.375896556999997, 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.004 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:25:59.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.008 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.355124463000003, 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:25:59.012 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.351449164999998, 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:25:59.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:25:59.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.017 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.223298014000001, 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:59.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.21939553, 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.023 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:25:59.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.181218395000002, 2024-09-10T15:25:59.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.032 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.033 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:59.035 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:25:59.035 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:59.031+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:59.136 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:25:59.131+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:25:59.190 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:25:59.250 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:59.250 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:59.251 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:25:59.251 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:59.251 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:25:59.247+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:25:59.269 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:25:59.353 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:59.351+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:59.419 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:59.419 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:25:59.419 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:25:59.419 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:25:59.419 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:59.432 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:25:59.437 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:59.436+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:59.462 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:25:59.538 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:59.536+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:25:59.622 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 56.098219147999998, 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:25:59.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:25:59.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.882827669000001, 2024-09-10T15:25:59.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:25:59.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:25:59.632 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:25:59.633 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.634 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.091846384, 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.635 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:25:59.636 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.637 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:25:59.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:25:59.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.083387254999998, 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.642 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:25:59.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.774853763000003, 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:25:59.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:25:59.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.718784962000001, 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:25:59.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:25:59.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.659 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.701726014999998, 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:25:59.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:25:59.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.674579547999997, 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.668 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:25:59.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:25:59.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:25:59.674 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.656183454000001, 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:25:59.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:25:59.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:25:59.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.631096694, 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:25:59.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.623767717, 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:25:59.686 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:25:59.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:25:59.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:25:59.692 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.484341079000004, 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:25:59.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.401347696999999, 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:25:59.698 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:25:59.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:25:59.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:25:59.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:25:59.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.398744166999997, 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:25:59.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.395844752999999, 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.709 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:25:59.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.176923963, 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:25:59.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.718 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.067835000999999, 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:25:59.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:25:59.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.724 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.047396753000001, 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.022598330999998, 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:25:59.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:25:59.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 35.858265695, 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:25:59.735 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:25:59.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:25:59.741 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:25:59.742 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:25:59.742 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:25:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:25:59.743 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:25:59.743 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:25:59.743 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:25:59.744 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:25:59.744 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:59.735+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:59.764 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:25:59.765 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:25:59.795 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:25:59.795 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:25:59.825 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:25:59.825 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:25:59.838 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:25:59.835+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:25:59.857 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:25:59.857 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:25:59.879 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:25:59.880 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:25:59.891 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:25:59.891 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:25:59.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:25:59.941 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:25:59.940+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:00.014 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:00.014 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:00.029 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:00.040 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:00.035+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:00.142 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:00.140+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:00.198 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:00.199 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:00.213 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:00.242 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:00.239+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:00.343 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:00.340+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:00.374 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:00.374 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:00.388 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:00.444 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:00.439+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:00.545 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:00.544+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:00.547 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:00.547 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:00.562 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:00.653 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:00.652+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:00.727 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:00.727 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:00.741 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:00.746 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:00.743+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:00.847 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:00.843+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:00.904 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:00.904 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:00.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:00.948 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:00.943+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:01.032 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:01.032 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:01.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:01.049 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:01.048+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:01.150 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:01.148+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:01.165 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:01.165 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:01.179 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:01.218 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:26:01.261 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:01.259+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:01.347 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:01.347 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:01.351 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:01.347+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:01.362 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:01.452 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:01.448+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:01.479 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:01.479 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:01.493 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:01.553 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:01.547+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:01.653 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:01.651+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:01.662 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:01.662 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:01.677 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:01.754 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:01.751+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:01.846 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:01.846 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:01.854 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:01.851+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:01.864 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:01.913 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:01.994 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:01.991+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:02.057 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:02.055+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:02.073 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:02.073 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:02.091 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:02.141 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:02.141 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:02.158 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:02.155+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:02.172 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:02.172 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:02.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:02.203 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:02.203 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:26:02.235 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:02.235 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:02.258 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:02.255+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:02.260 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:02.260 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.393349120000003, 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.261 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:26:02.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:26:02.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:26:02.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:26:02.267 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94293658805248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.359713829, 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032992310000000001, 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.268 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 47 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899411+0000", 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899413+0000", 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899440+0000", 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6937e-05 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899462+0000", 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2005e-05 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899483+0000", 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0766000000000001e-05 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899629+0000", 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014655899999999999 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899879+0000", 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024972500000000001 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.900305+0000", 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042541299999999997 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902042+0000", 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017374140000000001 2024-09-10T15:26:02.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902443+0000", 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000401314 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902540+0000", 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7082000000000003e-05 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902710+0000", 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016963899999999999 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:191 6.5 6:a2ace8b3:::data_log.0:head [call fifo.create_meta in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.254059865000002, 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030872289999999999, 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.274 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 191 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005065+0000", 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005067+0000", 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.503e-06 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005101+0000", 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3716e-05 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005133+0000", 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1999999999999999e-05 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005149+0000", 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5832999999999999e-05 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005296+0000", 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014676899999999999 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.005617+0000", 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032122100000000001 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.006069+0000", 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045195100000000002 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007805+0000", 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001736366 2024-09-10T15:26:02.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.007936+0000", 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013107900000000001 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008031+0000", 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4745000000000002e-05 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:20.008152+0000", 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012104600000000001 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.378319509000001, 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003452517, 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.280 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 205 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880805+0000", 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880809+0000", 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6899999999999998e-06 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880831+0000", 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1909999999999999e-05 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880868+0000", 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7395999999999999e-05 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.880888+0000", 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0072999999999999e-05 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881037+0000", 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014864899999999999 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881278+0000", 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000241375 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.881709+0000", 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043041999999999999 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883647+0000", 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019381050000000001 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.883981+0000", 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033401699999999998 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884131+0000", 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000150409 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.884258+0000", 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012647299999999999 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:209 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.362452501999996, 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044043329999999999, 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.286 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 209 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896672+0000", 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896675+0000", 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9500000000000001e-06 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896687+0000", 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896722+0000", 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4579000000000002e-05 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896740+0000", 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8326999999999999e-05 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.896974+0000", 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023349500000000001 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897234+0000", 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026055799999999998 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.897630+0000", 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039599299999999997 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.899054+0000", 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014237659999999999 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900900+0000", 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018464760000000001 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.900989+0000", 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8405999999999993e-05 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.901076+0000", 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7635999999999999e-05 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:213 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.342972820999996, 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032263779999999998, 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.292 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 213 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916152+0000", 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916154+0000", 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6929999999999999e-06 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916166+0000", 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1996e-05 2024-09-10T15:26:02.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916199+0000", 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2073000000000003e-05 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916214+0000", 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5466999999999999e-05 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916341+0000", 2024-09-10T15:26:02.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012687199999999999 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916578+0000", 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000237328 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.916999+0000", 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042096700000000001 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.918423+0000", 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014233990000000001 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919183+0000", 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00076040400000000001 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919265+0000", 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2332999999999999e-05 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919378+0000", 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112846 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:215 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.330166558000002, 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035653159999999998, 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.298 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 215 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928958+0000", 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928961+0000", 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928974+0000", 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3370000000000001e-05 2024-09-10T15:26:02.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929008+0000", 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3359999999999999e-05 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929024+0000", 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6263e-05 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929164+0000", 2024-09-10T15:26:02.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013994300000000001 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929404+0000", 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024016799999999999 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.929874+0000", 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047045000000000002 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.931395+0000", 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001520928 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932268+0000", 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087286600000000003 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932421+0000", 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152719 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.932523+0000", 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010239900000000001 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:221 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.308262370000001, 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033286570000000001, 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.304 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 221 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950862+0000", 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950865+0000", 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.486e-06 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950876+0000", 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1484000000000001e-05 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950907+0000", 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1269999999999997e-05 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950941+0000", 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3869999999999999e-05 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951099+0000", 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015789499999999999 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951335+0000", 2024-09-10T15:26:02.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023613799999999999 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.951784+0000", 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044851299999999999 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953115+0000", 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013315270000000001 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.953980+0000", 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086435899999999998 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954075+0000", 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5142999999999994e-05 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.954191+0000", 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011597199999999999 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.309 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.289696093000003, 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030448369999999999, 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 226 2024-09-10T15:26:02.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969428+0000", 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969431+0000", 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3659999999999999e-06 2024-09-10T15:26:02.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969443+0000", 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1960000000000001e-05 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969474+0000", 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1226999999999998e-05 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969489+0000", 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5407e-05 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969601+0000", 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112069 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969828+0000", 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022677400000000001 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:02.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.970247+0000", 2024-09-10T15:26:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041849699999999999 2024-09-10T15:26:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.971969+0000", 2024-09-10T15:26:02.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017223469999999999 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972322+0000", 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035308099999999999 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972409+0000", 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7151999999999995e-05 2024-09-10T15:26:02.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.972473+0000", 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3956999999999998e-05 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:295 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:26:02.317 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.236179927000002, 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035863620000000001, 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 295 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:26:02.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022945+0000", 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022946+0000", 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.344e-06 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022953+0000", 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6030000000000001e-06 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022969+0000", 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6684000000000002e-05 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.022980+0000", 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0339e-05 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023093+0000", 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113886 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023234+0000", 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014053199999999999 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.023537+0000", 2024-09-10T15:26:02.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030331299999999999 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.024251+0000", 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071354199999999995 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026463+0000", 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022118329999999999 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026499+0000", 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6633e-05 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.026531+0000", 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1652999999999997e-05 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:321 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.230975893, 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039310600000000001, 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 321 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028149+0000", 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028150+0000", 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.145e-06 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028156+0000", 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.246e-06 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028183+0000", 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6661000000000001e-05 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028191+0000", 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8529999999999992e-06 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028252+0000", 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1017999999999998e-05 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028307+0000", 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5652000000000002e-05 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028419+0000", 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111822 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.028990+0000", 2024-09-10T15:26:02.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057050299999999998 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.031999+0000", 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030094700000000002 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032038+0000", 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9381000000000001e-05 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.032080+0000", 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1309e-05 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:344 6.19 6:9ed7f5b7:::obj_delete_at_hint.0000000004:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.218430775999998, 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033174039999999999, 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.330 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 344 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040694+0000", 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040695+0000", 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040703+0000", 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6550000000000004e-06 2024-09-10T15:26:02.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040722+0000", 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.927e-05 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040730+0000", 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5490000000000006e-06 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040785+0000", 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5000000000000002e-05 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.040919+0000", 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134031 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041086+0000", 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016650599999999999 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041659+0000", 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057306600000000001 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043941+0000", 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022821080000000001 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043981+0000", 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9709999999999998e-05 2024-09-10T15:26:02.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044011+0000", 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0315e-05 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:346 6.3 6:c3a682d4:reshard::reshard.0000000004:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.217730539000001, 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031508030000000002, 2024-09-10T15:26:02.336 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 346 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041394+0000", 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041395+0000", 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.063e-06 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041402+0000", 2024-09-10T15:26:02.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.584e-06 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041415+0000", 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2873e-05 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041421+0000", 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3369999999999996e-06 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041471+0000", 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9962e-05 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041523+0000", 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2336999999999997e-05 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.041630+0000", 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010692399999999999 2024-09-10T15:26:02.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.043952+0000", 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023222590000000001 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044452+0000", 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00049976600000000001 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044503+0000", 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1359000000000001e-05 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.044545+0000", 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1338999999999998e-05 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.342 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:356 6.5 6:a60f9269:lc::lua_package_allowlist:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.210522509, 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038401199999999998, 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 356 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048602+0000", 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048604+0000", 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.455e-06 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048611+0000", 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.165e-06 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048632+0000", 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1495e-05 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048643+0000", 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1260999999999999e-05 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048700+0000", 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6106000000000001e-05 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048800+0000", 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100592 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.048896+0000", 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5754000000000005e-05 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.049804+0000", 2024-09-10T15:26:02.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00090843399999999996 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052376+0000", 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025715500000000001 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052412+0000", 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6103000000000003e-05 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.052442+0000", 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0205e-05 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:667 6.1a e35/29 6:5909e671:gc::gc.27:head v 35'6, mlcod=35'4)", 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.038707733999999, 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033239810000000002, 2024-09-10T15:26:02.349 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220417+0000", 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220418+0000", 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3090000000000001e-06 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220429+0000", 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0974e-05 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220450+0000", 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0999999999999999e-05 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220463+0000", 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2847000000000001e-05 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220535+0000", 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1892999999999998e-05 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220556+0000", 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1625e-05 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223694+0000", 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031370999999999999 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223741+0000", 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7233e-05 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.353 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:748 6.19 6:9fecf831:::obj_delete_at_hint.0000000057:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.922437834, 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031794449999999999, 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.354 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 748 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336687+0000", 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336689+0000", 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4660000000000002e-06 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336703+0000", 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.341e-05 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336733+0000", 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0803000000000003e-05 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336749+0000", 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5307000000000001e-05 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.336868+0000", 2024-09-10T15:26:02.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119042 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337096+0000", 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022811500000000001 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.337412+0000", 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031602399999999998 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.338485+0000", 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010729419999999999 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339591+0000", 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011062909999999999 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339756+0000", 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016521600000000001 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.339866+0000", 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010982899999999999 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.885398203000001, 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003135105, 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.360 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 766 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373726+0000", 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373729+0000", 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4200000000000001e-06 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373740+0000", 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1382999999999999e-05 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373772+0000", 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1872999999999998e-05 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373787+0000", 2024-09-10T15:26:02.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4939999999999999e-05 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.373934+0000", 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147362 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374286+0000", 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035165700000000001 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.374831+0000", 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054459300000000001 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376098+0000", 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001267427 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376660+0000", 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00056157500000000003 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376744+0000", 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4746000000000005e-05 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.376861+0000", 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117129 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.366 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:769 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.878203386000003, 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036106519999999998, 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.367 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 769 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380921+0000", 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380923+0000", 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7630000000000001e-06 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380936+0000", 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3524e-05 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380960+0000", 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.357e-05 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.380973+0000", 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381100+0000", 2024-09-10T15:26:02.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012734899999999999 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.381468+0000", 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036784399999999998 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.382044+0000", 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00057572799999999996 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.383294+0000", 2024-09-10T15:26:02.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012507709999999999 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384260+0000", 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096558199999999999 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384421+0000", 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016134600000000001 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.384532+0000", 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011058899999999999 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:771 6.12 6:48f827b1:::obj_delete_at_hint.0000000064:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.873753809999997, 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032065520000000001, 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.373 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 771 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385371+0000", 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385373+0000", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.097e-06 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385384+0000", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0936e-05 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385416+0000", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1829999999999998e-05 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385434+0000", 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8680000000000001e-05 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385565+0000", 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130679 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.385803+0000", 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023778800000000001 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.386276+0000", 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00047344999999999999 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.387537+0000", 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012603270000000001 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388316+0000", 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00077915700000000005 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388468+0000", 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000152569 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.388577+0000", 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109039 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:856 6.19 6:9c5cb460:::obj_delete_at_hint.0000000093:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.674488928000002, 2024-09-10T15:26:02.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033370510000000002, 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 856 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584636+0000", 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584638+0000", 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6170000000000001e-06 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584651+0000", 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2585999999999999e-05 2024-09-10T15:26:02.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584682+0000", 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1347000000000003e-05 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584697+0000", 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5313000000000001e-05 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584825+0000", 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012719200000000001 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585048+0000", 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022346200000000001 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.585367+0000", 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031844700000000002 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.586409+0000", 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001042362 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587702+0000", 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129291 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587859+0000", 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015752600000000001 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.587973+0000", 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011328900000000001 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:02.384 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:02.384 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:02.385 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:02.385 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:02.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:02.386 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:02.386 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:02.387 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:02.387 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:02.387 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:02.387 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:02.388 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:02.379+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:02.487 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:02.483+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:02.588 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:02.583+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:02.598 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:02.598 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:02.598 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:02.598 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:02.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:02.688 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:02.687+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:02.789 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:02.783+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:02.824 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:02.825 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:02.825 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:02.842 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:02.890 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:02.887+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:02.991 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:02.991+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:03.056 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:03.056 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.710668577, 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.057 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:26:03.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.342990024000002, 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:26:03.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.342773395999998, 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.070 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.342696123000003, 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:26:03.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:26:03.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.24469045, 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.072147647999998, 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:26:03.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:26:03.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.072032968999999, 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:26:03.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:26:03.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.071748262, 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.101 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:26:03.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:26:03.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.106 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.071653175000002, 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:26:03.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.112 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.071215086000002, 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:26:03.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:26:03.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.118 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.071151272999998, 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:26:03.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.124 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.071064130000003, 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:26:03.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.130 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.070857304999997, 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:26:03.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:26:03.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:26:03.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:26:03.137 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.070788636000003, 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:26:03.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:26:03.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.583198240999998, 2024-09-10T15:26:03.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:26:03.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:26:03.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.583147908999997, 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:26:03.149 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:03.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:26:03.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.582946190000001, 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.155 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:26:03.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:26:03.159 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.160 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.582911684000003, 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.161 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:03.162 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.163 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.164 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:26:03.165 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:26:03.166 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.582864717, 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.167 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.168 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.169 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.170 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.171 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:26:03.172 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 61.582610895999998, 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:03.173 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.174 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:26:03.175 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:26:03.176 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:26:03.177 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.178 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.179 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.179 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:03.180 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:03.181 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:03.175+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:03.281 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:03.275+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:03.351 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:03.351 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:03.351 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:03.351 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:03.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:03.382 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:03.379+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:03.482 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:03.479+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:03.523 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:03.523 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:03.523 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:03.523 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:03.523 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:03.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:03.583 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:03.579+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:03.648 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.916050505999998, 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:03.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:26:03.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.721219302999998, 2024-09-10T15:26:03.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:26:03.655 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:26:03.657 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.711140094000001, 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.658 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:26:03.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:26:03.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:26:03.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.663 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.666748632999997, 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.527104246999997, 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:26:03.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.520268807000001, 2024-09-10T15:26:03.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:26:03.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:26:03.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:26:03.678 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.510527862000004, 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.387023483, 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.683 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.366701341999999, 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.687 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:26:03.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:26:03.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.361683691000003, 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.693 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:03.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.241864519000003, 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.699 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:26:03.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:26:03.703 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.161317027000003, 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:26:03.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:26:03.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.157373833999998, 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:26:03.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:26:03.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.092873015999999, 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.089283094000002, 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.068511000000001, 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:26:03.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:26:03.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.064835702000003, 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:26:03.725 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.729 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.936684550999999, 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:26:03.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:26:03.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.932782066999998, 2024-09-10T15:26:03.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:03.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 39.894604932, 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:03.741 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:03.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:26:03.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:03.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:03.746 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:03.746 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:03.747 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:03.747 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:03.743+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:03.848 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:03.843+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:03.949 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:03.943+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:03.962 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:03.962 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:03.962 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:03.962 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:03.981 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:04.049 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:04.047+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:04.150 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:04.147+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:04.189 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:04.189 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:04.189 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:04.189 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:04.189 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:04.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:04.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:26:04.254 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:04.251+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:04.352 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:04.347+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:04.378 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:04.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.853410529000001, 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:04.379 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:04.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.385 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.638019049999997, 2024-09-10T15:26:04.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:04.387 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:04.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:04.393 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.847037765000003, 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:04.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:04.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:04.400 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.838578636000001, 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:04.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:04.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 46.530045143999999, 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:04.407 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:04.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.473976342999997, 2024-09-10T15:26:04.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:04.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:04.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:04.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.456917396000001, 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:04.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:04.426 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.429770929, 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.427 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:26:04.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.430 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.411374834999997, 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:26:04.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:26:04.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:26:04.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.440 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.386288075000003, 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:26:04.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:26:04.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:26:04.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.378959098000003, 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:26:04.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.23953246, 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:26:04.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.156539078000002, 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.460 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:26:04.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.153935548, 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:26:04.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.151036134000002, 2024-09-10T15:26:04.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.472 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:26:04.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.932115344000003, 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:26:04.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:26:04.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.823026382000002, 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:26:04.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:26:04.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:04.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:26:04.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.802588133999997, 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:26:04.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:26:04.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.777789712000001, 2024-09-10T15:26:04.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:26:04.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:26:04.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.613457076000003, 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:26:04.501 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:26:04.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:04.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:04.506 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:04.506 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:04.508 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:04.508 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:04.503+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:04.609 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:04.603+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:04.639 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:04.640 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:04.640 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:04.640 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:04.654 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:04.709 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:04.707+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:04.747 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:04.747 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:04.773 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:04.773 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:04.773 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:04.773 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:04.773 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:04.778 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:04.778 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:04.787 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:04.809 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:26:04.833 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:04.831+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:04.840 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:04.840 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:04.870 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:04.903 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:04.903 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:04.911 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:04.907+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:04.912 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:04.912 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:04.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:04.934 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:04.965 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:04.965 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:05.013 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:05.011+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:05.091 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:05.092 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:05.105 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:05.113 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:05.107+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:05.214 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:05.211+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:05.271 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:05.271 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:05.286 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:05.315 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:05.311+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:05.416 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:05.411+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:05.455 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:05.455 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:05.469 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:05.517 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:05.515+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:05.618 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:05.615+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:05.637 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:05.637 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:05.652 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:05.719 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:05.715+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:05.777 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:05.778 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:05.792 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:05.819 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:05.815+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:05.921 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:05.915+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:05.959 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:05.959 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:05.973 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:06.025 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:06.023+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:06.098 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.099 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.113 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:06.157 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:06.155+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:06.223 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:06.219+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:06.279 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.280 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:06.324 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:06.319+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:06.419 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.419 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.425 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:06.419+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:06.433 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:06.526 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:06.523+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:06.587 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.587 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.600 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:06.627 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:06.623+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:06.713 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.713 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:06.727 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:06.723+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:06.829 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:06.823+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:06.834 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.834 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.847 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:06.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:26:06.929 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:06.927+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:06.957 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:06.958 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:06.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:06.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:07.030 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:07.027+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:07.131 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:07.127+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:07.149 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:07.150 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:07.152 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:07.152 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:07.166 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:07.166 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:07.171 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:07.192 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:07.192 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:07.225 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:07.225 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:07.232 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:07.227+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:07.256 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:07.256 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:07.276 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:07.276 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:07.297 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:07.297 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.307 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.961635443000006, 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:26:07.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:26:07.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:35 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.593956890000001, 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011886505, 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 35 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.315 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711770+0000", 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.316 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711772+0000", 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.22e-06 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711910+0000", 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013863499999999999 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711930+0000", 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0166999999999999e-05 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711962+0000", 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1402999999999997e-05 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717229+0000", 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0052674460000000003 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717357+0000", 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012755199999999999 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.717557+0000", 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020033799999999999 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721254+0000", 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036971719999999999 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723495+0000", 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022401560000000001 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723594+0000", 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9205999999999999e-05 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723657+0000", 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.321e-05 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.320 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.593740261999997, 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011869971999999999, 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 36 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711987+0000", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711988+0000", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2440000000000001e-06 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.711999+0000", 2024-09-10T15:26:07.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1012999999999999e-05 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712023+0000", 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3336000000000002e-05 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712037+0000", 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.401e-05 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719255+0000", 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072182000000000001 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719399+0000", 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143993 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.719603+0000", 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204138 2024-09-10T15:26:07.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.721889+0000", 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022864830000000002 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723677+0000", 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017876700000000001 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723743+0000", 2024-09-10T15:26:07.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6025999999999994e-05 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.723857+0000", 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113859 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.593662988999995, 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012102386999999999, 2024-09-10T15:26:07.326 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 37 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712064+0000", 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712065+0000", 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.093e-06 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712076+0000", 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0332999999999999e-05 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712115+0000", 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9236999999999997e-05 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.712131+0000", 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6345999999999999e-05 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720210+0000", 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080791079999999998 2024-09-10T15:26:07.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720372+0000", 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161402 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.720577+0000", 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204921 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.722400+0000", 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018234200000000001 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724033+0000", 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016324480000000001 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724116+0000", 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3374999999999994e-05 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.724167+0000", 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0704000000000001e-05 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.495657316000006, 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012459578000000001, 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 88 2024-09-10T15:26:07.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810070+0000", 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810071+0000", 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3200000000000001e-06 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810083+0000", 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.154e-05 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810104+0000", 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1087e-05 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.810124+0000", 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0143e-05 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817774+0000", 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0076497470000000001 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.817935+0000", 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016076299999999999 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.818134+0000", 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019959200000000001 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.819430+0000", 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001295523 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822382+0000", 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029526909999999999 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822469+0000", 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6192000000000004e-05 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.822530+0000", 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0980000000000002e-05 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.337 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.323114513999997, 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012104504, 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 108 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.338 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982613+0000", 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982615+0000", 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8560000000000001e-06 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982628+0000", 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2917e-05 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982651+0000", 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3543000000000001e-05 2024-09-10T15:26:07.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982668+0000", 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6656000000000001e-05 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983736+0000", 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001068329 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983782+0000", 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6350999999999997e-05 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983854+0000", 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1135000000000002e-05 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985982+0000", 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002128291 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994661+0000", 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086795480000000005 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994697+0000", 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5590999999999999e-05 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994717+0000", 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0287000000000001e-05 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.322999835000005, 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012069613, 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.344 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 109 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982727+0000", 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982729+0000", 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.666e-06 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982949+0000", 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021959900000000001 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982971+0000", 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1973000000000001e-05 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.982986+0000", 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5116000000000001e-05 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984107+0000", 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001121012 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984154+0000", 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7274999999999997e-05 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984234+0000", 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0249999999999999e-05 2024-09-10T15:26:07.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986003+0000", 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017683499999999999 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994743+0000", 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087402390000000003 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994769+0000", 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6503999999999999e-05 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994797+0000", 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7628999999999999e-05 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.350 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.322715127999999, 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011864487999999999, 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 110 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983012+0000", 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983014+0000", 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.347e-06 2024-09-10T15:26:07.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983023+0000", 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4099999999999997e-06 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983061+0000", 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8396000000000003e-05 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983075+0000", 2024-09-10T15:26:07.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4017e-05 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984642+0000", 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015665989999999999 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984689+0000", 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7134e-05 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984775+0000", 2024-09-10T15:26:07.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5779999999999995e-05 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986753+0000", 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019777200000000001 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994823+0000", 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080702829999999993 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994857+0000", 2024-09-10T15:26:07.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4075999999999997e-05 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994877+0000", 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9726000000000001e-05 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.322620040999993, 2024-09-10T15:26:07.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011857184, 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 111 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983107+0000", 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983109+0000", 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.336e-06 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983120+0000", 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.137e-05 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983147+0000", 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6933000000000001e-05 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983162+0000", 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4696e-05 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985046+0000", 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0018842970000000001 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985115+0000", 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.985196+0000", 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1280999999999996e-05 2024-09-10T15:26:07.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987363+0000", 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021670489999999999 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994902+0000", 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0075392059999999997 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994945+0000", 2024-09-10T15:26:07.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2342999999999998e-05 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.994964+0000", 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9945999999999998e-05 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.322181951999994, 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012355029999999999, 2024-09-10T15:26:07.362 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 113 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983545+0000", 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983547+0000", 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3430000000000001e-06 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983556+0000", 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6900000000000004e-06 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983574+0000", 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7864e-05 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983588+0000", 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3793e-05 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986034+0000", 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024455810000000001 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986078+0000", 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4119999999999998e-05 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986153+0000", 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4762e-05 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.989240+0000", 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030873060000000002 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995848+0000", 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006608035 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995875+0000", 2024-09-10T15:26:07.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6795999999999999e-05 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995900+0000", 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5740000000000001e-05 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.322118138999997, 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012373947, 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.368 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 114 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983609+0000", 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983610+0000", 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1170000000000001e-06 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983620+0000", 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2070000000000001e-06 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983639+0000", 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9502999999999999e-05 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983651+0000", 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2480000000000001e-05 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986417+0000", 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027654139999999999 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5946999999999999e-05 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986538+0000", 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4723999999999998e-05 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991958+0000", 2024-09-10T15:26:07.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054207140000000001 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995931+0000", 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039729869999999999 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995957+0000", 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6186999999999998e-05 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.995983+0000", 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5667e-05 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.322030995999995, 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012363897, 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.374 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 115 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983696+0000", 2024-09-10T15:26:07.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983698+0000", 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3599999999999999e-06 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983842+0000", 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000143955 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983864+0000", 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2546999999999999e-05 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983879+0000", 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4443e-05 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986788+0000", 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029092509999999999 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986833+0000", 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4861000000000003e-05 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.986906+0000", 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3491999999999994e-05 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991963+0000", 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050569880000000001 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996011+0000", 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040474899999999999 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996037+0000", 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6312000000000002e-05 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996060+0000", 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3198e-05 2024-09-10T15:26:07.379 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.321824171000003, 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013003545, 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.380 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 116 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983903+0000", 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983904+0000", 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.254e-06 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983914+0000", 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5030000000000003e-06 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983931+0000", 2024-09-10T15:26:07.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7176e-05 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983951+0000", 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9453000000000002e-05 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987388+0000", 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003437491 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.383 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987432+0000", 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4261000000000002e-05 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987505+0000", 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2503999999999996e-05 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991966+0000", 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0044611850000000003 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996861+0000", 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048953060000000003 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996888+0000", 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6754000000000002e-05 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.996907+0000", 2024-09-10T15:26:07.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8658e-05 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.321755502000002, 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015334919000000001, 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.386 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 117 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983972+0000", 2024-09-10T15:26:07.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983973+0000", 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.11e-06 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.983983+0000", 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5969999999999998e-06 2024-09-10T15:26:07.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984004+0000", 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1489999999999999e-05 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.984019+0000", 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5316999999999999e-05 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.389 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987745+0000", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037254749999999998 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987791+0000", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5735000000000002e-05 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.987862+0000", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1787999999999998e-05 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.991968+0000", 2024-09-10T15:26:07.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004106106 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999259+0000", 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0072906029999999997 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999287+0000", 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8319000000000001e-05 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.999307+0000", 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9378999999999999e-05 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:136 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.834165107000004, 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012907137000000001, 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.392 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 136 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471562+0000", 2024-09-10T15:26:07.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471563+0000", 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3e-07 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471568+0000", 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0599999999999998e-06 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471578+0000", 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6930000000000002e-06 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471584+0000", 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.63e-06 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480313+0000", 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087291590000000002 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480439+0000", 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012556199999999999 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.480623+0000", 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018441599999999999 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483337+0000", 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002714026 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484335+0000", 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0009971750000000001 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484410+0000", 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5185999999999995e-05 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484469+0000", 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9500000000000003e-05 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:137 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.834114775000003, 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014143200999999999, 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 137 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.398 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471613+0000", 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9400000000000004e-07 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471770+0000", 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471789+0000", 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9504000000000002e-05 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471798+0000", 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1929999999999999e-06 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481517+0000", 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0097182950000000001 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481644+0000", 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012694900000000001 2024-09-10T15:26:07.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.481839+0000", 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019510099999999999 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484600+0000", 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027609459999999998 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485619+0000", 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010190749999999999 2024-09-10T15:26:07.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485696+0000", 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7680000000000002e-05 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485756+0000", 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9289000000000001e-05 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.833913056, 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015875970999999999, 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 138 2024-09-10T15:26:07.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471814+0000", 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471815+0000", 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0070000000000001e-06 2024-09-10T15:26:07.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471821+0000", 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7699999999999998e-06 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471831+0000", 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5929999999999995e-06 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471838+0000", 2024-09-10T15:26:07.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4529999999999996e-06 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483420+0000", 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011582390999999999 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483545+0000", 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012433499999999999 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.483735+0000", 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018978300000000001 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487507+0000", 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0037723430000000001 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487548+0000", 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0620000000000001e-05 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487625+0000", 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7163000000000006e-05 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487690+0000", 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:07.409 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.833878549999994, 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:07.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:26:07.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:26:07.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:26:07.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.833831583000006, 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.415 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:26:07.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:26:07.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:26:07.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:26:07.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.420 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.420 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:26:07.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:26:07.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:26:07.423 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.833577762000004, 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:26:07.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:07.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:26:07.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:07.429 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:07.430 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:07.430 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:07.431 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:07.432 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:07.427+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:07.532 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:07.527+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:07.584 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:07.584 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:07.585 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:07.585 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:07.597 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:07.633 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:07.631+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:07.734 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:07.731+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:07.809 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:07.809 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:07.810 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:07.810 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:07.828 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:07.835 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:07.831+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:07.937 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:07.931+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:07.985 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:26:08.041 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:08.039+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:08.042 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:08.042 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:08.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:08.042 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:08.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.042 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.309388440000006, 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:26:08.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:08.047 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.114557237, 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:26:08.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:26:08.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.104478028000003, 2024-09-10T15:26:08.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:26:08.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:26:08.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.060086566999999, 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:26:08.058 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:26:08.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:26:08.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.920442180999999, 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:08.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:26:08.068 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.913606741000002, 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.069 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:26:08.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:26:08.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.903865795999998, 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.075 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:08.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.780361417000002, 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:26:08.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:26:08.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:26:08.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.760039276000001, 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.084 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:08.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:26:08.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.755021624999998, 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.090 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:08.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:26:08.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:26:08.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.635202452999998, 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.096 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:26:08.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:26:08.100 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.554654960999997, 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:26:08.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.550711767999999, 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.105 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:26:08.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.109 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.48621095, 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:26:08.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.482621027999997, 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.114 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:26:08.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.461848934000002, 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:26:08.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:26:08.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.458173635999998, 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.123 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:08.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.330022485000001, 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:26:08.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:26:08.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.326120001, 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.134 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:08.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:26:08.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:26:08.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.287942866000002, 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:26:08.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.144 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:08.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:08.146 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:08.143+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:08.246 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:08.243+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:08.347 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:08.343+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:08.356 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:08.356 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:08.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:08.465 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:08.463+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:08.550 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:08.547+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:08.584 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:08.584 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:08.585 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:08.585 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:08.585 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:08.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:08.690 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:08.687+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:08.752 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:08.747+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:08.757 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.233286317999998, 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:08.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:08.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 65.017894838999993, 2024-09-10T15:26:08.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:08.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.226913554000006, 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:08.769 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:08.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:08.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:08.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.218454424999997, 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.776 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:08.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:08.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.782 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.909920933000002, 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:08.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:08.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.788 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.853852132, 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:08.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:08.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:08.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.793 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.794 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.836793184999998, 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.795 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:08.796 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.797 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.798 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.799 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:08.800 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:08.801 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.809646718000003, 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:08.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:26:08.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:08.807 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.791250624, 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:26:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.766163863999999, 2024-09-10T15:26:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:26:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:26:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:26:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.758834886999999, 2024-09-10T15:26:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:26:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.619408249000003, 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:26:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:26:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.536414866999998, 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:26:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:26:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.533811337000003, 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:26:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:26:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.530911922999998, 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:26:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:26:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.311991132999999, 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.202902170999998, 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:26:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:26:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.182463923, 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:26:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:26:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 45.157665500999997, 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:26:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:26:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 44.993332864999999, 2024-09-10T15:26:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:26:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:08.874 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:08.875 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:08.876 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:08.871+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:08.976 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:08.971+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:09.009 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:09.009 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:09.009 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:09.009 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:09.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:09.077 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:09.075+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:09.146 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:09.146 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:09.146 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:09.146 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:09.146 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:09.161 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:09.205 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:09.203+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:09.279 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:09.275+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:09.333 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:09.334 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:09.334 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:09.334 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:09.334 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.334 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 51.463850813000001, 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055234610000000003, 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 44 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.335 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864941+0000", 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7670000000000001e-06 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864967+0000", 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5925999999999999e-05 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864994+0000", 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7327000000000001e-05 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865035+0000", 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0386999999999998e-05 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865189+0000", 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015459800000000001 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865211+0000", 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1569999999999998e-05 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870207+0000", 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049961210000000001 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870461+0000", 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025376499999999998 2024-09-10T15:26:09.339 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.444527784999998, 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034111469999999998, 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 206 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.341 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884264+0000", 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3560000000000001e-06 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884283+0000", 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-05 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884318+0000", 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5516999999999999e-05 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884341+0000", 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2616000000000002e-05 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884497+0000", 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884741+0000", 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243842 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.885152+0000", 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041088000000000002 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887012+0000", 2024-09-10T15:26:09.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0018603129999999999 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887519+0000", 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050694599999999998 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887603+0000", 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.3968999999999995e-05 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887671+0000", 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8362999999999996e-05 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.440839826999998, 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040867880000000001, 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.346 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 207 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887950+0000", 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8700000000000001e-06 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887959+0000", 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3870000000000001e-06 2024-09-10T15:26:09.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887982+0000", 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2589e-05 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887995+0000", 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2907e-05 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888086+0000", 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1593000000000002e-05 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888328+0000", 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024150500000000001 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888738+0000", 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040969299999999998 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891834+0000", 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030965419999999999 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891891+0000", 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7173000000000003e-05 2024-09-10T15:26:09.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891976+0000", 2024-09-10T15:26:09.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5060000000000002e-05 2024-09-10T15:26:09.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892035+0000", 2024-09-10T15:26:09.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8468999999999999e-05 2024-09-10T15:26:09.353 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.353 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.354 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.354 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.354 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.427739494000001, 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003650174, 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.355 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 210 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:09.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901052+0000", 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.179e-06 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901068+0000", 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6793e-05 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901111+0000", 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.244e-05 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901133+0000", 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2419999999999999e-05 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901301+0000", 2024-09-10T15:26:09.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016767900000000001 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901644+0000", 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034309999999999999 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.902345+0000", 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000700462 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.903718+0000", 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013736690000000001 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904545+0000", 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00082700999999999998 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904636+0000", 2024-09-10T15:26:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0863000000000001e-05 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904699+0000", 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2558999999999995e-05 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.374608823999999, 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033557069999999999, 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 222 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954182+0000", 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7460000000000001e-06 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954194+0000", 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1922999999999999e-05 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954226+0000", 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2302999999999999e-05 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954247+0000", 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1347000000000001e-05 2024-09-10T15:26:09.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954445+0000", 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019739200000000001 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954661+0000", 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021628500000000001 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.955094+0000", 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043296300000000002 2024-09-10T15:26:09.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.956711+0000", 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001616644 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957380+0000", 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066963199999999997 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957470+0000", 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9369000000000004e-05 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957535+0000", 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5103000000000003e-05 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.368 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.345781074000001, 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003230208, 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 230 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983009+0000", 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.537e-06 2024-09-10T15:26:09.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983021+0000", 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2033e-05 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983053+0000", 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983078+0000", 2024-09-10T15:26:09.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4876e-05 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983211+0000", 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133189 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983435+0000", 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022390499999999999 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983857+0000", 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042188000000000002 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.985345+0000", 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014883520000000001 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986080+0000", 2024-09-10T15:26:09.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00073420400000000002 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986174+0000", 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4662999999999998e-05 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986237+0000", 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2722e-05 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.374 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.320506966000004, 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055684239999999998, 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.375 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 238 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008283+0000", 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008297+0000", 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3933e-05 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008333+0000", 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6096999999999997e-05 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008356+0000", 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2942000000000002e-05 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008504+0000", 2024-09-10T15:26:09.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014746299999999999 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008719+0000", 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021527199999999999 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009020+0000", 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030114399999999999 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010376+0000", 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001355633 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013584+0000", 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032078879999999999 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013738+0000", 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015396299999999999 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013849+0000", 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111632 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:237 6.f e35/29 6:f24cb4a8:gc::gc.31:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.319464146999998, 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036952579999999999, 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.381 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009326+0000", 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009369+0000", 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2823e-05 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009395+0000", 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6095999999999999e-05 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009412+0000", 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7765999999999999e-05 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009543+0000", 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013065599999999999 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009592+0000", 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.867e-05 2024-09-10T15:26:09.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.012924+0000", 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003331924 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013019+0000", 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5415999999999996e-05 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:266 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.313838248000003, 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051958239999999999, 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 266 2024-09-10T15:26:09.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014952+0000", 2024-09-10T15:26:09.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4940000000000002e-06 2024-09-10T15:26:09.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014964+0000", 2024-09-10T15:26:09.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1646e-05 2024-09-10T15:26:09.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015000+0000", 2024-09-10T15:26:09.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5719999999999997e-05 2024-09-10T15:26:09.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015019+0000", 2024-09-10T15:26:09.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9524000000000001e-05 2024-09-10T15:26:09.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015160+0000", 2024-09-10T15:26:09.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:09.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015383+0000", 2024-09-10T15:26:09.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022293500000000001 2024-09-10T15:26:09.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:09.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015753+0000", 2024-09-10T15:26:09.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036921000000000002 2024-09-10T15:26:09.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.018680+0000", 2024-09-10T15:26:09.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002926948 2024-09-10T15:26:09.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019892+0000", 2024-09-10T15:26:09.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001212114 2024-09-10T15:26:09.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020041+0000", 2024-09-10T15:26:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014964899999999999 2024-09-10T15:26:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020146+0000", 2024-09-10T15:26:09.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010417900000000001 2024-09-10T15:26:09.396 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.396 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.397 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.397 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.397 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:09.397 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.312017361999999, 2024-09-10T15:26:09.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032349560000000002, 2024-09-10T15:26:09.398 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.398 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.398 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.399 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.399 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 271 2024-09-10T15:26:09.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.399 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016773+0000", 2024-09-10T15:26:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016787+0000", 2024-09-10T15:26:09.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3696999999999999e-05 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016825+0000", 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8036e-05 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016846+0000", 2024-09-10T15:26:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0846999999999999e-05 2024-09-10T15:26:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.404 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017021+0000", 2024-09-10T15:26:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017525799999999999 2024-09-10T15:26:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017343+0000", 2024-09-10T15:26:09.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032234800000000002 2024-09-10T15:26:09.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:09.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017890+0000", 2024-09-10T15:26:09.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054723900000000004 2024-09-10T15:26:09.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019263+0000", 2024-09-10T15:26:09.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013724029999999999 2024-09-10T15:26:09.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.408 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019734+0000", 2024-09-10T15:26:09.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047077600000000001 2024-09-10T15:26:09.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.409 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.409 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.409 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019896+0000", 2024-09-10T15:26:09.409 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016226899999999999 2024-09-10T15:26:09.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020006+0000", 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109626 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.410 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:288 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.307327510999997, 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049465189999999999, 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 288 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.411 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021463+0000", 2024-09-10T15:26:09.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.244e-06 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021492+0000", 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9193e-05 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021529+0000", 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7045999999999997e-05 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021551+0000", 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.162e-05 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021684+0000", 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013378899999999999 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021892+0000", 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020753500000000001 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.414 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.022406+0000", 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00051442899999999995 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.023735+0000", 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001328894 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026196+0000", 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002460931 2024-09-10T15:26:09.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026340+0000", 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000143478 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026407+0000", 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7360000000000006e-05 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:329 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.296832158999997, 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032556690000000001, 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 329 2024-09-10T15:26:09.417 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031958+0000", 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.61e-06 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031988+0000", 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9614000000000001e-05 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032017+0000", 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459e-05 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032032+0000", 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4643e-05 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032182+0000", 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015022599999999999 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032430+0000", 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024767399999999997 2024-09-10T15:26:09.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032939+0000", 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050894999999999998 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034259+0000", 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013200200000000001 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034952+0000", 2024-09-10T15:26:09.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069333100000000005 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035101+0000", 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148913 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035211+0000", 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110229 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:343 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.290531657000002, 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050411639999999999, 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 343 2024-09-10T15:26:09.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.424 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038258+0000", 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038269+0000", 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.023e-05 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038299+0000", 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0579e-05 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038321+0000", 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1497000000000001e-05 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038426+0000", 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104732 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038633+0000", 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020711899999999999 2024-09-10T15:26:09.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038882+0000", 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249225 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.040030+0000", 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011478669999999999 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043027+0000", 2024-09-10T15:26:09.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029972900000000001 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043184+0000", 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015672900000000001 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043297+0000", 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113699 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.428 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:347 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.285328200999999, 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040146030000000003, 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.429 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 347 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043462+0000", 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3130000000000001e-06 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043474+0000", 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1596999999999999e-05 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043501+0000", 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7267000000000002e-05 2024-09-10T15:26:09.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043515+0000", 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3653e-05 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043636+0000", 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121842 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043777+0000", 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014075900000000001 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.044059+0000", 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028201499999999999 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.045090+0000", 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010304050000000001 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047188+0000", 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020984670000000001 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047356+0000", 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016759199999999999 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047474+0000", 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118693 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.434 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:367 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.277559046999997, 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037150709999999999, 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.435 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 367 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051232+0000", 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7199999999999998e-06 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051245+0000", 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3463e-05 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051285+0000", 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0142999999999998e-05 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051308+0000", 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2402999999999999e-05 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051430+0000", 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012228299999999999 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051564+0000", 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013370499999999999 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051947+0000", 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038371100000000001 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053415+0000", 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001467512 2024-09-10T15:26:09.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054793+0000", 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013784019999999999 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054880+0000", 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7188999999999995e-05 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054944+0000", 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3540000000000005e-05 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:371 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.276106501999998, 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052951489999999999, 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.441 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 371 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052683+0000", 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.883e-06 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052693+0000", 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7769999999999997e-06 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.443 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052716+0000", 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663e-05 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052729+0000", 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3144e-05 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052870+0000", 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:09.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053183+0000", 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031270700000000001 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053663+0000", 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047959100000000002 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055240+0000", 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001577097 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057660+0000", 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002420008 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057818+0000", 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015781899999999999 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057977+0000", 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015905499999999999 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:408 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.264203147000003, 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041063569999999997, 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.447 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 408 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.448 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064587+0000", 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8029999999999999e-06 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064596+0000", 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2259999999999994e-06 2024-09-10T15:26:09.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064620+0000", 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4136000000000001e-05 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064634+0000", 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3821e-05 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064735+0000", 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101005 2024-09-10T15:26:09.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064867+0000", 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013217599999999999 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065108+0000", 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240781 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066676+0000", 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001568287 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068521+0000", 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001844516 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068640+0000", 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119239 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068691+0000", 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1366999999999998e-05 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:589 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.162893793000002, 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00439215, 2024-09-10T15:26:09.453 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 589 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165896+0000", 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.778e-06 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165906+0000", 2024-09-10T15:26:09.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0448999999999999e-05 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165937+0000", 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0295e-05 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165953+0000", 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6189999999999999e-05 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166090+0000", 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013686699999999999 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166312+0000", 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221862 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166744+0000", 2024-09-10T15:26:09.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043218999999999999 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.168018+0000", 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00127389 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170092+0000", 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020744140000000001 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170176+0000", 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4172000000000007e-05 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170286+0000", 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110043 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:09.459 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 46.060604038000001, 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032686149999999999, 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 715 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268186+0000", 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9929999999999998e-06 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268197+0000", 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1207e-05 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268228+0000", 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1316000000000003e-05 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268243+0000", 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4610000000000001e-05 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268393+0000", 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150416 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268773+0000", 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037973 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.269332+0000", 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000558819 2024-09-10T15:26:09.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.270636+0000", 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013042259999999999 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271181+0000", 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054502999999999995 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.464 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271339+0000", 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015786500000000001 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271453+0000", 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113403 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:09.465 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 45.768562641999999, 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032738950000000002, 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 847 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:09.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560228+0000", 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.283e-06 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:09.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560239+0000", 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1377e-05 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560270+0000", 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1375999999999999e-05 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560285+0000", 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4703e-05 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560428+0000", 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014316599999999999 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560779+0000", 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035106699999999999 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.561337+0000", 2024-09-10T15:26:09.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000557896 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.562655+0000", 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013175159999999999 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563245+0000", 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000590363 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563390+0000", 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000145255 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563499+0000", 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108893 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:09.471 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:09.472 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:09.472 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:09.473 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:09.467+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:09.474 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:09.574 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:09.571+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:09.603 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:09.603 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:09.603 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:09.603 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:09.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:09.667 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:09.668 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:09.675 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:09.671+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:09.698 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:09.698 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:09.728 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:09.758 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:09.758 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:09.776 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:09.771+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:09.784 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:09.784 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:09.784 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:09.784 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:09.784 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:09.790 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:09.790 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:09.798 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:09.822 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:09.822 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:09.852 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:09.852 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:09.876 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:09.871+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:09.882 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:09.883 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:09.926 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:09.926 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:09.940 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:09.985 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:09.983+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:10.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:26:10.064 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:10.064 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:10.080 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:10.075+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:10.081 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:10.179 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:10.175+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:10.249 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:10.249 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:10.263 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:10.309 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:10.307+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:10.380 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:10.375+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:10.433 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:10.433 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:10.447 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:10.489 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:10.487+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:10.582 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:10.579+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:10.605 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:10.606 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:10.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:10.705 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:10.703+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:10.780 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:10.780 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:10.784 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:10.783+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:10.794 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:10.885 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:10.883+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:10.962 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:10.962 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:10.976 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:11.018 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:26:11.019 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:11.019+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:11.087 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:11.083+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:11.149 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:11.149 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:11.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:11.187 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:11.183+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:11.289 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:11.283+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:11.316 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:11.317 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:11.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:11.390 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:11.390+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:11.486 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:11.486 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:11.490 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:11.490+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:11.499 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:11.591 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:11.590+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:11.685 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:11.686 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:11.692 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:11.687+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:11.698 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:11.793 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:11.791+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:11.866 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:11.866 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:11.880 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:11.905 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:11.926 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:11.926+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:11.995 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:11.991+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:12.032 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:12.032 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:12.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:12.098 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:12.098+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:12.103 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:12.104 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:12.108 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T15:26:12.108 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T15:26:12.109 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-10T15:26:12.109 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-10T15:26:12.109 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-10T15:26:12.109 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-10T15:26:12.121 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:12.121 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:12.137 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:12.138 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:12.155 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:12.155 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:12.174 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:12.175 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:12.198 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:12.195+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:12.206 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:12.206 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:12.225 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:12.225 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:12.225 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:12.225 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:12.238 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:12.238 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:12.244 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:12.244 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:12.244 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-10T15:26:12.244 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:12.270 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:12.271 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:12.337 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:12.338+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:12.399 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:12.395+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:12.439 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:12.440 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:12.440 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:12.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:12.502 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:12.502+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:12.601 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:12.598+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:12.638 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:12.638 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:12.638 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:12.638 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.904697911, 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:12.639 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.640 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.641 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:26:12.642 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:12.643 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.709866708, 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.644 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:26:12.645 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:26:12.646 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.647 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.699787499000003, 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.648 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:12.649 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:26:12.650 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.651 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:26:12.653 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:26:12.654 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.654 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.654 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.654 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:26:12.654 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:12.655 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.655396037999999, 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.656 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:12.657 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.659 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.660 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.515751651999999, 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.661 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.662 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:26:12.663 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:26:12.666 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.508916212000003, 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.667 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:26:12.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.499175266999998, 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:26:12.673 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:26:12.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:26:12.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:26:12.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.375670888000002, 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:12.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:12.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:26:12.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.355348747000001, 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.685 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:12.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:26:12.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:26:12.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.691 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.350331095999998, 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:26:12.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.697 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.230511923999998, 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:26:12.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:26:12.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:26:12.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:12.703 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.149964431999997, 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:12.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:26:12.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:26:12.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:26:12.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.709 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.146021239, 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:26:12.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:26:12.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:26:12.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.081520421, 2024-09-10T15:26:12.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.720 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.077930498999997, 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:26:12.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.725 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.057158405000003, 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.053483106999998, 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.731 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:12.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:26:12.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:26:12.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.925331956000001, 2024-09-10T15:26:12.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:26:12.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:26:12.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.743 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.921429472, 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:12.744 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:26:12.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:26:12.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:26:12.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:12.751 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 48.883252337000002, 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:12.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:26:12.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:12.757 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:12.757 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:12.758 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:12.759 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:12.758+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:12.858 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:12.858+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:12.960 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:12.955+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:12.968 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:12.968 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:12.968 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:12.985 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:13.037 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:26:13.082 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:13.082+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:13.161 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:13.159+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:13.190 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:13.190 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:13.190 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:13.190 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:13.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:13.263 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:13.259+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.800196303000007, 2024-09-10T15:26:13.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 69.584804824000003, 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:13.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:13.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:13.336 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.793823539000002, 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:13.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:13.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.340 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.342 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 67.78536441, 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:13.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.345 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:13.349 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 55.476830917999997, 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:13.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:13.353 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.354 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.420762117000002, 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:13.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:13.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.363 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.40370317, 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.364 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:13.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.368 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:13.369 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.370 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.376556702999999, 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.371 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.372 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.373 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:26:13.374 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.375 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.376 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.358160609000002, 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:26:13.377 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.378 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:26:13.379 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:26:13.380 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:26:13.381 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:26:13.382 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.333073849000002, 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.383 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.384 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:26:13.385 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:26:13.386 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:26:13.387 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:26:13.388 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.325744872000001, 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.389 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.390 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:26:13.391 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:26:13.392 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:26:13.393 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.394 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.186318233999998, 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:13.395 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:26:13.396 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.397 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.398 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.399 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.103324852, 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.400 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.401 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.402 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.403 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:26:13.404 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.405 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.100721321999998, 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.406 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:26:13.407 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:26:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.409 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 50.097821908, 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.410 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:26:13.412 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:26:13.413 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.414 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:13.415 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.878901118000002, 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.416 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:26:13.417 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.418 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.419 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.769812156, 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.420 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:26:13.421 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:26:13.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:26:13.423 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:26:13.424 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:13.425 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.749373908000003, 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.426 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.427 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.428 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:26:13.429 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.724575485999999, 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:13.430 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.431 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.432 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.433 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:26:13.435 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 49.560242850000002, 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:13.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:26:13.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:13.440 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:13.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:13.442 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:13.442+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:13.543 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:13.539+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:13.574 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:13.575 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:13.575 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:13.575 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:13.589 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:13.644 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:13.642+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:13.746 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:13.743+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:13.753 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:13.753 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:13.754 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:13.754 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:13.754 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:13.768 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:13.847 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:13.846+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:13.935 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:13.935 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 56.066983692000001, 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055234610000000003, 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.936 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 44 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:13.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864941+0000", 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7670000000000001e-06 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864967+0000", 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5925999999999999e-05 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864994+0000", 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7327000000000001e-05 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865035+0000", 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0386999999999998e-05 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865189+0000", 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015459800000000001 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865211+0000", 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1569999999999998e-05 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870207+0000", 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049961210000000001 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870461+0000", 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025376499999999998 2024-09-10T15:26:13.940 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 51.047660663999999, 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034111469999999998, 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.941 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 206 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884264+0000", 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3560000000000001e-06 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884283+0000", 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-05 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884318+0000", 2024-09-10T15:26:13.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5516999999999999e-05 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884341+0000", 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2616000000000002e-05 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884497+0000", 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884741+0000", 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243842 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.885152+0000", 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041088000000000002 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887012+0000", 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0018603129999999999 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887519+0000", 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050694599999999998 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887603+0000", 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.3968999999999995e-05 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887671+0000", 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8362999999999996e-05 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.946 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 51.043972705999998, 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040867880000000001, 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.947 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 207 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887950+0000", 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8700000000000001e-06 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887959+0000", 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3870000000000001e-06 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887982+0000", 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2589e-05 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887995+0000", 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2907e-05 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888086+0000", 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1593000000000002e-05 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888328+0000", 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024150500000000001 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888738+0000", 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040969299999999998 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891834+0000", 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030965419999999999 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891891+0000", 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7173000000000003e-05 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891976+0000", 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5060000000000002e-05 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892035+0000", 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8468999999999999e-05 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.952 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 51.030872373000001, 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003650174, 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.953 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 210 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901052+0000", 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.179e-06 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901068+0000", 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6793e-05 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901111+0000", 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.244e-05 2024-09-10T15:26:13.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901133+0000", 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2419999999999999e-05 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901301+0000", 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016767900000000001 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901644+0000", 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034309999999999999 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.902345+0000", 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000700462 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.903718+0000", 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013736690000000001 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904545+0000", 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00082700999999999998 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904636+0000", 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0863000000000001e-05 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904699+0000", 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2558999999999995e-05 2024-09-10T15:26:13.958 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.977741703, 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033557069999999999, 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.959 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 222 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954182+0000", 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7460000000000001e-06 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954194+0000", 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1922999999999999e-05 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954226+0000", 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2302999999999999e-05 2024-09-10T15:26:13.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954247+0000", 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1347000000000001e-05 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954445+0000", 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019739200000000001 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954661+0000", 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021628500000000001 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.955094+0000", 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043296300000000002 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.956711+0000", 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001616644 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957380+0000", 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066963199999999997 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957470+0000", 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9369000000000004e-05 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957535+0000", 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5103000000000003e-05 2024-09-10T15:26:13.964 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.948913953000002, 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003230208, 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.965 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 230 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:13.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983009+0000", 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.537e-06 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983021+0000", 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2033e-05 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983053+0000", 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983078+0000", 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4876e-05 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983211+0000", 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133189 2024-09-10T15:26:13.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983435+0000", 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022390499999999999 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983857+0000", 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042188000000000002 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.985345+0000", 2024-09-10T15:26:13.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014883520000000001 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986080+0000", 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00073420400000000002 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986174+0000", 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4662999999999998e-05 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986237+0000", 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2722e-05 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.923639844999997, 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055684239999999998, 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.971 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 238 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008283+0000", 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:13.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008297+0000", 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3933e-05 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008333+0000", 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6096999999999997e-05 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008356+0000", 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2942000000000002e-05 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008504+0000", 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014746299999999999 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008719+0000", 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021527199999999999 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009020+0000", 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030114399999999999 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010376+0000", 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001355633 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013584+0000", 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032078879999999999 2024-09-10T15:26:13.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013738+0000", 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015396299999999999 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013849+0000", 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111632 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:237 6.f e35/29 6:f24cb4a8:gc::gc.31:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.922597025999998, 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036952579999999999, 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009326+0000", 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009369+0000", 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2823e-05 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009395+0000", 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6095999999999999e-05 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009412+0000", 2024-09-10T15:26:13.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7765999999999999e-05 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009543+0000", 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013065599999999999 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009592+0000", 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.867e-05 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.012924+0000", 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003331924 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013019+0000", 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5415999999999996e-05 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:266 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.916971126999996, 2024-09-10T15:26:13.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051958239999999999, 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 266 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014952+0000", 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4940000000000002e-06 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014964+0000", 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1646e-05 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015000+0000", 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5719999999999997e-05 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015019+0000", 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9524000000000001e-05 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015160+0000", 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015383+0000", 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022293500000000001 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015753+0000", 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036921000000000002 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.018680+0000", 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002926948 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019892+0000", 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001212114 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020041+0000", 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014964899999999999 2024-09-10T15:26:13.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020146+0000", 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010417900000000001 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.915150240999999, 2024-09-10T15:26:13.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032349560000000002, 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 271 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016773+0000", 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016787+0000", 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3696999999999999e-05 2024-09-10T15:26:13.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016825+0000", 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8036e-05 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016846+0000", 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0846999999999999e-05 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017021+0000", 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017525799999999999 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017343+0000", 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032234800000000002 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017890+0000", 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054723900000000004 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019263+0000", 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013724029999999999 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019734+0000", 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047077600000000001 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019896+0000", 2024-09-10T15:26:13.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016226899999999999 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020006+0000", 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109626 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:288 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.910460389999997, 2024-09-10T15:26:13.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049465189999999999, 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 288 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021463+0000", 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.244e-06 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021492+0000", 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9193e-05 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021529+0000", 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7045999999999997e-05 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021551+0000", 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.162e-05 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021684+0000", 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013378899999999999 2024-09-10T15:26:13.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021892+0000", 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020753500000000001 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.022406+0000", 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00051442899999999995 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.023735+0000", 2024-09-10T15:26:13.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001328894 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026196+0000", 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002460931 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026340+0000", 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000143478 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026407+0000", 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7360000000000006e-05 2024-09-10T15:26:13.999 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:329 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.899965037999998, 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032556690000000001, 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.000 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 329 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031958+0000", 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.61e-06 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031988+0000", 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9614000000000001e-05 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032017+0000", 2024-09-10T15:26:14.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459e-05 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032032+0000", 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4643e-05 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032182+0000", 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015022599999999999 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032430+0000", 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024767399999999997 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032939+0000", 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050894999999999998 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034259+0000", 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013200200000000001 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034952+0000", 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069333100000000005 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035101+0000", 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148913 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035211+0000", 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110229 2024-09-10T15:26:14.005 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:343 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.893664536000003, 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050411639999999999, 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 343 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038258+0000", 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038269+0000", 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.023e-05 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038299+0000", 2024-09-10T15:26:14.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0579e-05 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038321+0000", 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1497000000000001e-05 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038426+0000", 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104732 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038633+0000", 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020711899999999999 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038882+0000", 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249225 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.040030+0000", 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011478669999999999 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043027+0000", 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029972900000000001 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043184+0000", 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015672900000000001 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043297+0000", 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113699 2024-09-10T15:26:14.011 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:347 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.888461079999999, 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040146030000000003, 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 347 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043462+0000", 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3130000000000001e-06 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043474+0000", 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1596999999999999e-05 2024-09-10T15:26:14.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043501+0000", 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7267000000000002e-05 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043515+0000", 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3653e-05 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043636+0000", 2024-09-10T15:26:14.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121842 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043777+0000", 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014075900000000001 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.044059+0000", 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028201499999999999 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.045090+0000", 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010304050000000001 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047188+0000", 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020984670000000001 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047356+0000", 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016759199999999999 2024-09-10T15:26:14.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047474+0000", 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118693 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:367 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.880691925999997, 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037150709999999999, 2024-09-10T15:26:14.018 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 367 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051232+0000", 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7199999999999998e-06 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051245+0000", 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3463e-05 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051285+0000", 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0142999999999998e-05 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051308+0000", 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2402999999999999e-05 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051430+0000", 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012228299999999999 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051564+0000", 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013370499999999999 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051947+0000", 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038371100000000001 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053415+0000", 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001467512 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054793+0000", 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013784019999999999 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054880+0000", 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7188999999999995e-05 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054944+0000", 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3540000000000005e-05 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:371 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.879239380999998, 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052951489999999999, 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.024 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 371 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.025 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052683+0000", 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.883e-06 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052693+0000", 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7769999999999997e-06 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052716+0000", 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663e-05 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052729+0000", 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3144e-05 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052870+0000", 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:14.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053183+0000", 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031270700000000001 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053663+0000", 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047959100000000002 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055240+0000", 2024-09-10T15:26:14.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001577097 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057660+0000", 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002420008 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057818+0000", 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015781899999999999 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057977+0000", 2024-09-10T15:26:14.029 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015905499999999999 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:408 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.867336025999997, 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041063569999999997, 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.030 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 408 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064587+0000", 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8029999999999999e-06 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064596+0000", 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2259999999999994e-06 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064620+0000", 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4136000000000001e-05 2024-09-10T15:26:14.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064634+0000", 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3821e-05 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064735+0000", 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101005 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064867+0000", 2024-09-10T15:26:14.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013217599999999999 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065108+0000", 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240781 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066676+0000", 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001568287 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068521+0000", 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001844516 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068640+0000", 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119239 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068691+0000", 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1366999999999998e-05 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.035 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:589 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.766026672000002, 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00439215, 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.036 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 589 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165896+0000", 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.778e-06 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165906+0000", 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0448999999999999e-05 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165937+0000", 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0295e-05 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165953+0000", 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6189999999999999e-05 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166090+0000", 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013686699999999999 2024-09-10T15:26:14.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166312+0000", 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221862 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166744+0000", 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043218999999999999 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.168018+0000", 2024-09-10T15:26:14.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00127389 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170092+0000", 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020744140000000001 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170176+0000", 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4172000000000007e-05 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170286+0000", 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110043 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.663736917000001, 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032686149999999999, 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.042 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 715 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:14.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268186+0000", 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9929999999999998e-06 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268197+0000", 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1207e-05 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268228+0000", 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1316000000000003e-05 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268243+0000", 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4610000000000001e-05 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268393+0000", 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150416 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268773+0000", 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037973 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.269332+0000", 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000558819 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.270636+0000", 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013042259999999999 2024-09-10T15:26:14.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271181+0000", 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054502999999999995 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271339+0000", 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015786500000000001 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271453+0000", 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113403 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.047 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 50.371695520999999, 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032738950000000002, 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:14.048 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 847 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:14.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560228+0000", 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.283e-06 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560239+0000", 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1377e-05 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560270+0000", 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1375999999999999e-05 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560285+0000", 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4703e-05 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560428+0000", 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014316599999999999 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560779+0000", 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035106699999999999 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.561337+0000", 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000557896 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.562655+0000", 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013175159999999999 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563245+0000", 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000590363 2024-09-10T15:26:14.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563390+0000", 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000145255 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563499+0000", 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108893 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:14.053 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:14.054 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:14.055 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:26:14.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:14.056 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:14.051+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:14.156 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:14.151+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:14.229 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:14.230 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:14.230 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:14.230 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:14.243 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:14.256 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:14.254+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:14.295 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:14.357 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:14.358+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:14.412 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:14.412 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:14.412 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:14.413 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:14.413 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:14.424 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:14.424 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:14.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:14.440 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:14.440 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:14.456 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:14.456 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:14.472 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:14.472 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:14.473 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:14.471+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:14.490 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:14.490 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:14.509 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:14.509 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:14.529 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:14.529 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:14.549 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:14.549 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:14.559 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:14.558+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:14.560 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:14.561 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:14.564 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:14.660 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:14.655+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:14.733 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:14.733 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:14.747 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:14.789 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:14.787+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:14.863 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:14.862+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:14.912 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:14.912 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:14.928 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:14.973 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:14.971+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:15.049 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:15.049 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:15.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:15.064 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:15.062+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:15.165 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:15.162+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:15.227 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:15.228 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:15.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:15.289 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:15.287+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:15.360 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:15.360 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:15.367 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:15.366+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:15.373 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:15.468 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:15.463+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:15.542 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:15.542 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:15.556 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:15.606 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:15.606+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:15.669 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:15.670+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:15.725 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:15.725 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:15.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:15.786 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:15.786+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:15.872 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:15.867+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:15.936 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:15.936 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:15.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:16.002 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:16.002+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:16.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:26:16.102 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:16.102+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:16.110 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:16.110 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:16.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:16.174 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:16.174+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:16.275 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:16.271+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:16.344 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:16.345 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:16.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:16.406 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:16.406+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:16.477 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:16.478+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:16.530 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:16.530 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:16.548 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:16.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:16.590 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:16.590+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:16.679 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:16.675+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:16.755 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:16.755 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:16.766 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:16.766 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:16.772 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:16.796 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:16.797 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:16.797 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:16.794+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:16.827 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:16.827 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:16.857 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:16.858 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:16.881 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:16.878+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:16.890 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:16.891 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:16.897 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:16.897 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:16.897 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:16.914 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:16.922 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:16.922 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:16.954 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:16.955 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:16.982 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:16.982+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:16.986 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:16.987 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:17.049 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:26:17.058 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:17.058 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:17.058 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:17.058 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:17.058 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:17.078 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:17.083 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:17.079+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:17.184 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:17.182+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:17.237 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4272.0:1 2.3 e19/18 2:c4c92e5a:::rbd_trash:head v 19'1, mlcod=0'0)", 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.504955996999996, 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013070499999999999, 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.238 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731642+0000", 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731643+0000", 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0999999999999997e-07 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731654+0000", 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1185999999999999e-05 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731688+0000", 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.447e-05 2024-09-10T15:26:17.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731711+0000", 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2727000000000001e-05 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731837+0000", 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126255 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731883+0000", 2024-09-10T15:26:17.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5970000000000002e-05 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732844+0000", 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00096043599999999995 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732949+0000", 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105196 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:214 6.1c e35/29 6:3e426232:gc::gc.9:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.310124793999996, 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001832146, 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926473+0000", 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926474+0000", 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5000000000000001e-07 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926483+0000", 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1859999999999998e-06 2024-09-10T15:26:17.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926509+0000", 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5539999999999999e-05 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926529+0000", 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0550000000000001e-05 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926695+0000", 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016547299999999999 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926741+0000", 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6745000000000001e-05 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928228+0000", 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014866860000000001 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928305+0000", 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7115999999999998e-05 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:217 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.300045584999999, 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003141703, 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.247 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 217 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936552+0000", 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936555+0000", 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936568+0000", 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3176999999999999e-05 2024-09-10T15:26:17.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936596+0000", 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7705999999999999e-05 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936610+0000", 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4473e-05 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936727+0000", 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011668899999999999 2024-09-10T15:26:17.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.936957+0000", 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022951199999999999 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.937416+0000", 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000458873 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.938951+0000", 2024-09-10T15:26:17.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015352810000000001 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939543+0000", 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059179299999999996 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939630+0000", 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6991999999999997e-05 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.939694+0000", 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4367000000000002e-05 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:229 6.1b e35/29 6:db9d130d:gc::gc.24:head v 35'1, mlcod=0'0)", 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.255654124000003, 2024-09-10T15:26:17.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014949710000000001, 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980944+0000", 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2600000000000002e-07 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980951+0000", 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1439999999999997e-06 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980979+0000", 2024-09-10T15:26:17.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7302999999999999e-05 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.980992+0000", 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3497e-05 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981086+0000", 2024-09-10T15:26:17.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4184999999999994e-05 2024-09-10T15:26:17.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.981134+0000", 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7549999999999997e-05 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982362+0000", 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012282040000000001 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.982439+0000", 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6562000000000003e-05 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.258 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:523 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.116009738000002, 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001424586, 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.259 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 523 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.260 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120588+0000", 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120589+0000", 2024-09-10T15:26:17.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.147e-06 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120595+0000", 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1330000000000004e-06 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120610+0000", 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4929000000000001e-05 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120617+0000", 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6730000000000003e-06 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120671+0000", 2024-09-10T15:26:17.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3550000000000001e-05 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120756+0000", 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5580000000000004e-05 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.120942+0000", 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000185396 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121529+0000", 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058782699999999997 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121948+0000", 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000419066 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.121981+0000", 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999997e-05 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.122013+0000", 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1995000000000001e-05 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:534 6.15 6:ae95b544:::obj_delete_at_hint.0000000020:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:17.266 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.109174297999999, 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012296029999999999, 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 534 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:17.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127424+0000", 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127426+0000", 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2340000000000001e-06 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127437+0000", 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1163e-05 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127481+0000", 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4113000000000003e-05 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127487+0000", 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2689999999999996e-06 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127544+0000", 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6205000000000001e-05 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127631+0000", 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7538000000000001e-05 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.127758+0000", 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000127365 2024-09-10T15:26:17.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128301+0000", 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00054209600000000005 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128597+0000", 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000296676 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128629+0000", 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1387000000000003e-05 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.128653+0000", 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4556999999999999e-05 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:549 6.1c e35/29 6:388bc67b:::obj_delete_at_hint.0000000022:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:17.272 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.099433353000002, 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001693763, 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:17.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137165+0000", 2024-09-10T15:26:17.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4e-07 2024-09-10T15:26:17.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137172+0000", 2024-09-10T15:26:17.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.156e-06 2024-09-10T15:26:17.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137185+0000", 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3481e-05 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137192+0000", 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2629999999999997e-06 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137248+0000", 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6192e-05 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137263+0000", 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4620000000000001e-05 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138809+0000", 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001545568 2024-09-10T15:26:17.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138858+0000", 2024-09-10T15:26:17.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9642999999999999e-05 2024-09-10T15:26:17.279 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:711 6.1e e35/29 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:17.280 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.975928973999999, 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001590752, 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260669+0000", 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260670+0000", 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.023e-06 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260679+0000", 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3070000000000008e-06 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260696+0000", 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6960999999999999e-05 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260705+0000", 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7220000000000005e-06 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260761+0000", 2024-09-10T15:26:17.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5902000000000001e-05 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.260775+0000", 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262168+0000", 2024-09-10T15:26:17.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013930780000000001 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.262260+0000", 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1686000000000003e-05 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:721 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.955606832999997, 2024-09-10T15:26:17.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00407464, 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 721 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280991+0000", 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.280994+0000", 2024-09-10T15:26:17.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9859999999999999e-06 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281025+0000", 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1143000000000003e-05 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281057+0000", 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1943999999999998e-05 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281072+0000", 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4966e-05 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281158+0000", 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.6076999999999996e-05 2024-09-10T15:26:17.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281317+0000", 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015876700000000001 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.281548+0000", 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023113100000000001 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.282616+0000", 2024-09-10T15:26:17.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010678090000000001 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.284955+0000", 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023387799999999999 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285018+0000", 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3187000000000003e-05 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.285066+0000", 2024-09-10T15:26:17.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7849999999999998e-05 2024-09-10T15:26:17.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.292 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.292 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:723 6.15 6:ad7a3a02:::obj_delete_at_hint.0000000048:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.950589182000002, 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00159577, 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.293 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 723 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286009+0000", 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286013+0000", 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8240000000000001e-06 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286026+0000", 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3283e-05 2024-09-10T15:26:17.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286057+0000", 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.112e-05 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286075+0000", 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7813e-05 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286146+0000", 2024-09-10T15:26:17.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452999999999995e-05 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286239+0000", 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2719000000000005e-05 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.286429+0000", 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000189719 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287344+0000", 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091503299999999999 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287528+0000", 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018485499999999999 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287563+0000", 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4925999999999997e-05 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.287604+0000", 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1025000000000001e-05 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.299 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:780 6.1b e35/29 6:dc490aaa:::obj_delete_at_hint.0000000067:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:17.300 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:17.300 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.830770010000002, 2024-09-10T15:26:17.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001286452, 2024-09-10T15:26:17.300 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:17.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405828+0000", 2024-09-10T15:26:17.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405830+0000", 2024-09-10T15:26:17.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9999999999999999e-06 2024-09-10T15:26:17.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405843+0000", 2024-09-10T15:26:17.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.328e-05 2024-09-10T15:26:17.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405872+0000", 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8606e-05 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.405885+0000", 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.313e-05 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406037+0000", 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000151755 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.406100+0000", 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3087000000000001e-05 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407081+0000", 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00098133199999999991 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.306 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.407114+0000", 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3262000000000001e-05 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:814 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'7, mlcod=35'5)", 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.750222518000001, 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001624721, 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.307 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486375+0000", 2024-09-10T15:26:17.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486378+0000", 2024-09-10T15:26:17.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2029999999999999e-06 2024-09-10T15:26:17.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486391+0000", 2024-09-10T15:26:17.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3926e-05 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486428+0000", 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6149999999999998e-05 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486444+0000", 2024-09-10T15:26:17.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6167e-05 2024-09-10T15:26:17.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486581+0000", 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137076 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.486635+0000", 2024-09-10T15:26:17.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4555999999999997e-05 2024-09-10T15:26:17.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.487889+0000", 2024-09-10T15:26:17.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00125391 2024-09-10T15:26:17.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.488000+0000", 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000110733 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.315 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.316 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:816 6.1e e35/29 6:7a480f67:::obj_delete_at_hint.0000000079:head v 35'8, mlcod=35'6)", 2024-09-10T15:26:17.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:17.316 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.746279325000003, 2024-09-10T15:26:17.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013087330000000001, 2024-09-10T15:26:17.317 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.317 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:17.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490319+0000", 2024-09-10T15:26:17.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490320+0000", 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.443e-06 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490330+0000", 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9729999999999992e-06 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490354+0000", 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3733000000000001e-05 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490366+0000", 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.255e-05 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490495+0000", 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128532 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.490551+0000", 2024-09-10T15:26:17.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6097000000000002e-05 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491525+0000", 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097401900000000001 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.491627+0000", 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010238600000000001 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:844 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.681778506999997, 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013965889999999999, 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.323 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554819+0000", 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554821+0000", 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9700000000000002e-06 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554833+0000", 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554864+0000", 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0923000000000002e-05 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554877+0000", 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3607e-05 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554999+0000", 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000121265 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555052+0000", 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3282999999999998e-05 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556135+0000", 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001082962 2024-09-10T15:26:17.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556216+0000", 2024-09-10T15:26:17.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.0964999999999995e-05 2024-09-10T15:26:17.328 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.328 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:846 6.1c e35/29 6:38283b28:::obj_delete_at_hint.0000000089:head v 35'13, mlcod=35'11)", 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.678188585000001, 2024-09-10T15:26:17.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00135618, 2024-09-10T15:26:17.330 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.330 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.330 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.330 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558409+0000", 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558411+0000", 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.074e-06 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558426+0000", 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4450000000000001e-05 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558461+0000", 2024-09-10T15:26:17.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4816e-05 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558479+0000", 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8260000000000001e-05 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558601+0000", 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012173899999999999 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.333 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.558634+0000", 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3399999999999999e-05 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559688+0000", 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001054445 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.559765+0000", 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6996000000000006e-05 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.334 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:853 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.657416490999999, 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0017592599999999999, 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.335 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579181+0000", 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579183+0000", 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8160000000000001e-06 2024-09-10T15:26:17.336 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579222+0000", 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8559999999999997e-05 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579251+0000", 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9176999999999999e-05 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.337 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579264+0000", 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3087e-05 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579436+0000", 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017202100000000001 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.579496+0000", 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0303000000000002e-05 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.338 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580856+0000", 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0013599059999999999 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.580941+0000", 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4389999999999997e-05 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.339 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:855 6.1c e35/29 6:3ffaa114:::obj_delete_at_hint.0000000092:head v 35'15, mlcod=35'13)", 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.653741193000002, 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213834, 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.340 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.341 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.341 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:17.341 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.341 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.341 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582857+0000", 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582858+0000", 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582869+0000", 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.083e-05 2024-09-10T15:26:17.342 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582894+0000", 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4810000000000001e-05 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.582910+0000", 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5956000000000001e-05 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583023+0000", 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112563 2024-09-10T15:26:17.343 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583088+0000", 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5168999999999999e-05 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.583994+0000", 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000906433 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.584071+0000", 2024-09-10T15:26:17.344 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6253000000000003e-05 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:910 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.525590041999997, 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029626740000000002, 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.345 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 910 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711008+0000", 2024-09-10T15:26:17.346 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711011+0000", 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.196e-06 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711025+0000", 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3963e-05 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.347 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711076+0000", 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1304000000000002e-05 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711091+0000", 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5140000000000001e-05 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711201+0000", 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109397 2024-09-10T15:26:17.348 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711405+0000", 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020444899999999999 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.711723+0000", 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031790099999999999 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.349 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.712939+0000", 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012162220000000001 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713755+0000", 2024-09-10T15:26:17.350 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00081574399999999997 2024-09-10T15:26:17.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.351 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.351 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.351 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713847+0000", 2024-09-10T15:26:17.351 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2149000000000002e-05 2024-09-10T15:26:17.351 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.352 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.352 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.352 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.713970+0000", 2024-09-10T15:26:17.352 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012320899999999999 2024-09-10T15:26:17.352 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:912 6.15 6:ad3f17aa:::obj_delete_at_hint.0000000111:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:17.354 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.521687557999996, 2024-09-10T15:26:17.354 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026619550000000001, 2024-09-10T15:26:17.354 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.354 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.354 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.354 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.355 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.355 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 912 2024-09-10T15:26:17.355 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.355 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.355 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.356 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:17.356 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.356 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.356 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.356 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714910+0000", 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714912+0000", 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9400000000000001e-06 2024-09-10T15:26:17.357 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714923+0000", 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0540000000000001e-05 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714954+0000", 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0895999999999997e-05 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.358 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.714972+0000", 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7863000000000002e-05 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715092+0000", 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012011299999999999 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715209+0000", 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117235 2024-09-10T15:26:17.359 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.715474+0000", 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026522500000000001 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.716588+0000", 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011141009999999999 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717437+0000", 2024-09-10T15:26:17.360 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00084878999999999998 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717516+0000", 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8636999999999999e-05 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.717572+0000", 2024-09-10T15:26:17.361 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6614999999999999e-05 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:928 6.1e e35/29 6:7adbb485:::obj_delete_at_hint.0000000117:head v 35'9, mlcod=35'7)", 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 53.483510422999998, 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014595210000000001, 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.362 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753087+0000", 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.363 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.364 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753089+0000", 2024-09-10T15:26:17.364 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8899999999999999e-06 2024-09-10T15:26:17.364 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.364 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.364 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753105+0000", 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5245999999999999e-05 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753135+0000", 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9952999999999999e-05 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753150+0000", 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5860000000000001e-05 2024-09-10T15:26:17.365 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753276+0000", 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126002 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.753314+0000", 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7732999999999999e-05 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.366 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754458+0000", 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011441349999999999 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.754547+0000", 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8702000000000006e-05 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.367 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:17.369 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:17.369 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:17.366+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:17.470 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:17.467+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:17.530 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:17.530 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:17.530 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:17.530 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:17.547 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:17.570 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:17.567+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:17.671 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:17.667+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:17.708 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:17.708 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:17.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:17.772 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:17.767+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:17.873 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:17.870+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.370839485000005, 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.896 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:17.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 74.155448006, 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:17.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:17.907 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.364466720999999, 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:17.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:17.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:17.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 72.356007591999997, 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.914 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:17.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:17.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:17.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:17.920 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 60.047474100000002, 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 57.991405299, 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.926 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.927 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.928 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.929 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:17.930 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:17.931 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.974346351999998, 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.932 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.933 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.934 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:17.935 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:17.936 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.937 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.947199885000003, 2024-09-10T15:26:17.938 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.939 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:26:17.940 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.941 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.942 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.943 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.928803791, 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.944 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.945 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.946 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:26:17.947 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:26:17.948 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:26:17.949 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.903717030999999, 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.950 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:17.951 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:26:17.952 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.953 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.954 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.955 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.896388053999999, 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.956 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.957 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.958 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:26:17.959 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:26:17.960 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.961 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.756961416000003, 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.962 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.963 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:26:17.964 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:26:17.965 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.966 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:17.967 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.673968033999998, 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.968 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.969 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.970 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.971 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:26:17.972 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.671364504000003, 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:26:17.973 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.974 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:26:17.975 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:26:17.976 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.977 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.668465089999998, 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.978 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:26:17.979 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.980 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:17.981 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.982 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.983 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.449544299999999, 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.984 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.985 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.986 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.987 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:17.988 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.340455337999998, 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.989 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:26:17.990 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:26:17.991 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.992 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:26:17.993 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.32001709, 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:26:17.994 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.995 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:26:17.996 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:26:17.997 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:17.998 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.295218667999997, 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:17.999 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:26:18.000 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.001 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.002 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.003 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:18.004 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 54.130886031999999, 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:18.005 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.006 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:26:18.008 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:18.009 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:18.009 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:18.010 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:18.011 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:18.010+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:18.112 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:18.107+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:18.143 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:18.143 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:18.143 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:18.144 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:18.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:18.212 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:18.210+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:18.313 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:18.311+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:18.327 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:18.327 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:18.327 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:18.327 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:18.327 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:18.341 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:18.414 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:18.414+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:18.515 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.646963829999997, 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055234610000000003, 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.516 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 44 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864941+0000", 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7670000000000001e-06 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864967+0000", 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5925999999999999e-05 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864994+0000", 2024-09-10T15:26:18.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7327000000000001e-05 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865035+0000", 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0386999999999998e-05 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865189+0000", 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015459800000000001 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:18.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865211+0000", 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1569999999999998e-05 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870207+0000", 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049961210000000001 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870461+0000", 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025376499999999998 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.520 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.627640802000002, 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034111469999999998, 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.521 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 206 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884264+0000", 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3560000000000001e-06 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884283+0000", 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-05 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884318+0000", 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5516999999999999e-05 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884341+0000", 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2616000000000002e-05 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884497+0000", 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884741+0000", 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243842 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.885152+0000", 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041088000000000002 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887012+0000", 2024-09-10T15:26:18.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0018603129999999999 2024-09-10T15:26:18.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887519+0000", 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050694599999999998 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887603+0000", 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.3968999999999995e-05 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887671+0000", 2024-09-10T15:26:18.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8362999999999996e-05 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.623952844000002, 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040867880000000001, 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 207 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887950+0000", 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8700000000000001e-06 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887959+0000", 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3870000000000001e-06 2024-09-10T15:26:18.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887982+0000", 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2589e-05 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887995+0000", 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2907e-05 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888086+0000", 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1593000000000002e-05 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888328+0000", 2024-09-10T15:26:18.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024150500000000001 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888738+0000", 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040969299999999998 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891834+0000", 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030965419999999999 2024-09-10T15:26:18.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891891+0000", 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7173000000000003e-05 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891976+0000", 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5060000000000002e-05 2024-09-10T15:26:18.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892035+0000", 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8468999999999999e-05 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.536 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.610852510999997, 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003650174, 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 210 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901052+0000", 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.179e-06 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901068+0000", 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6793e-05 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901111+0000", 2024-09-10T15:26:18.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.244e-05 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901133+0000", 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2419999999999999e-05 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901301+0000", 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016767900000000001 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901644+0000", 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034309999999999999 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.902345+0000", 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000700462 2024-09-10T15:26:18.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.903718+0000", 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013736690000000001 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904545+0000", 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00082700999999999998 2024-09-10T15:26:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904636+0000", 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0863000000000001e-05 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904699+0000", 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2558999999999995e-05 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.543 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.557721841000003, 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033557069999999999, 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.544 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 222 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954182+0000", 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7460000000000001e-06 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954194+0000", 2024-09-10T15:26:18.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1922999999999999e-05 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954226+0000", 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2302999999999999e-05 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954247+0000", 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1347000000000001e-05 2024-09-10T15:26:18.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954445+0000", 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019739200000000001 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954661+0000", 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021628500000000001 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.955094+0000", 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043296300000000002 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.956711+0000", 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001616644 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957380+0000", 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066963199999999997 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957470+0000", 2024-09-10T15:26:18.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9369000000000004e-05 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957535+0000", 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5103000000000003e-05 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.551 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.528894090999998, 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003230208, 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.552 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 230 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983009+0000", 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.537e-06 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983021+0000", 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2033e-05 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983053+0000", 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983078+0000", 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4876e-05 2024-09-10T15:26:18.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983211+0000", 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133189 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983435+0000", 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022390499999999999 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983857+0000", 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042188000000000002 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.985345+0000", 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014883520000000001 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986080+0000", 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00073420400000000002 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986174+0000", 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4662999999999998e-05 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986237+0000", 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2722e-05 2024-09-10T15:26:18.558 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.503619983, 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055684239999999998, 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.559 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 238 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008283+0000", 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008297+0000", 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3933e-05 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008333+0000", 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6096999999999997e-05 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008356+0000", 2024-09-10T15:26:18.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2942000000000002e-05 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008504+0000", 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014746299999999999 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008719+0000", 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021527199999999999 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009020+0000", 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030114399999999999 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010376+0000", 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001355633 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013584+0000", 2024-09-10T15:26:18.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032078879999999999 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013738+0000", 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015396299999999999 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013849+0000", 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111632 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.565 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:237 6.f e35/29 6:f24cb4a8:gc::gc.31:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.502577164000002, 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036952579999999999, 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.566 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009326+0000", 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009369+0000", 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2823e-05 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009395+0000", 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6095999999999999e-05 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009412+0000", 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7765999999999999e-05 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009543+0000", 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013065599999999999 2024-09-10T15:26:18.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009592+0000", 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.867e-05 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.012924+0000", 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003331924 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013019+0000", 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5415999999999996e-05 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:266 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:18.571 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.496951265, 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051958239999999999, 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 266 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014952+0000", 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4940000000000002e-06 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014964+0000", 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1646e-05 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015000+0000", 2024-09-10T15:26:18.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5719999999999997e-05 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015019+0000", 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9524000000000001e-05 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015160+0000", 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:18.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015383+0000", 2024-09-10T15:26:18.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022293500000000001 2024-09-10T15:26:18.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015753+0000", 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036921000000000002 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.018680+0000", 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002926948 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019892+0000", 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001212114 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020041+0000", 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014964899999999999 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020146+0000", 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010417900000000001 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.495130379000003, 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032349560000000002, 2024-09-10T15:26:18.579 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 271 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:18.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016773+0000", 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016787+0000", 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3696999999999999e-05 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016825+0000", 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8036e-05 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016846+0000", 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0846999999999999e-05 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017021+0000", 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017525799999999999 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017343+0000", 2024-09-10T15:26:18.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032234800000000002 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017890+0000", 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054723900000000004 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019263+0000", 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013724029999999999 2024-09-10T15:26:18.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019734+0000", 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047077600000000001 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019896+0000", 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016226899999999999 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020006+0000", 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109626 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:288 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.490440528000001, 2024-09-10T15:26:18.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049465189999999999, 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 288 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:18.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021463+0000", 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.244e-06 2024-09-10T15:26:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021492+0000", 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9193e-05 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021529+0000", 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7045999999999997e-05 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021551+0000", 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.162e-05 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021684+0000", 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013378899999999999 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021892+0000", 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020753500000000001 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.022406+0000", 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00051442899999999995 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.023735+0000", 2024-09-10T15:26:18.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001328894 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026196+0000", 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002460931 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026340+0000", 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000143478 2024-09-10T15:26:18.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026407+0000", 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7360000000000006e-05 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:329 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.593 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.479945176000001, 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032556690000000001, 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 329 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031958+0000", 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.61e-06 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031988+0000", 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9614000000000001e-05 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032017+0000", 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459e-05 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032032+0000", 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4643e-05 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032182+0000", 2024-09-10T15:26:18.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015022599999999999 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032430+0000", 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024767399999999997 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032939+0000", 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050894999999999998 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034259+0000", 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013200200000000001 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034952+0000", 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069333100000000005 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035101+0000", 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148913 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035211+0000", 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110229 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:343 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.473644673999999, 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050411639999999999, 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.601 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 343 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:18.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038258+0000", 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038269+0000", 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.023e-05 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038299+0000", 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0579e-05 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038321+0000", 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1497000000000001e-05 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038426+0000", 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104732 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038633+0000", 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020711899999999999 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:18.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038882+0000", 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249225 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.040030+0000", 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011478669999999999 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043027+0000", 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029972900000000001 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043184+0000", 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015672900000000001 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043297+0000", 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113699 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:347 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.468441218000002, 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040146030000000003, 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.609 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 347 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:18.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043462+0000", 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3130000000000001e-06 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043474+0000", 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1596999999999999e-05 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043501+0000", 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7267000000000002e-05 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043515+0000", 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3653e-05 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043636+0000", 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121842 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043777+0000", 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014075900000000001 2024-09-10T15:26:18.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.044059+0000", 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028201499999999999 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.045090+0000", 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010304050000000001 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047188+0000", 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020984670000000001 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047356+0000", 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016759199999999999 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047474+0000", 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118693 2024-09-10T15:26:18.615 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:367 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.460672064000001, 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037150709999999999, 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.616 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 367 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051232+0000", 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7199999999999998e-06 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051245+0000", 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3463e-05 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051285+0000", 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0142999999999998e-05 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051308+0000", 2024-09-10T15:26:18.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2402999999999999e-05 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051430+0000", 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012228299999999999 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051564+0000", 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013370499999999999 2024-09-10T15:26:18.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051947+0000", 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038371100000000001 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053415+0000", 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001467512 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054793+0000", 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013784019999999999 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054880+0000", 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7188999999999995e-05 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054944+0000", 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3540000000000005e-05 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:371 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.459219519000001, 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052951489999999999, 2024-09-10T15:26:18.623 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 371 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:18.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052683+0000", 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.883e-06 2024-09-10T15:26:18.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052693+0000", 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7769999999999997e-06 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052716+0000", 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663e-05 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052729+0000", 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3144e-05 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052870+0000", 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053183+0000", 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031270700000000001 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053663+0000", 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047959100000000002 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055240+0000", 2024-09-10T15:26:18.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001577097 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057660+0000", 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002420008 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057818+0000", 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015781899999999999 2024-09-10T15:26:18.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057977+0000", 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015905499999999999 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:408 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.630 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.447316164, 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041063569999999997, 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 408 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064587+0000", 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8029999999999999e-06 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064596+0000", 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2259999999999994e-06 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064620+0000", 2024-09-10T15:26:18.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4136000000000001e-05 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064634+0000", 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3821e-05 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064735+0000", 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101005 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064867+0000", 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013217599999999999 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065108+0000", 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240781 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066676+0000", 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001568287 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068521+0000", 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001844516 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068640+0000", 2024-09-10T15:26:18.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119239 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068691+0000", 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1366999999999998e-05 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:589 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.637 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.346006809999999, 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00439215, 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 589 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.638 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165896+0000", 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.778e-06 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165906+0000", 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0448999999999999e-05 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165937+0000", 2024-09-10T15:26:18.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0295e-05 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165953+0000", 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6189999999999999e-05 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166090+0000", 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013686699999999999 2024-09-10T15:26:18.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166312+0000", 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221862 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166744+0000", 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043218999999999999 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.168018+0000", 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00127389 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170092+0000", 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020744140000000001 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170176+0000", 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4172000000000007e-05 2024-09-10T15:26:18.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170286+0000", 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110043 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:18.644 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.243717054999998, 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032686149999999999, 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 715 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268186+0000", 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9929999999999998e-06 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268197+0000", 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1207e-05 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268228+0000", 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1316000000000003e-05 2024-09-10T15:26:18.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268243+0000", 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4610000000000001e-05 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268393+0000", 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150416 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268773+0000", 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037973 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.269332+0000", 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000558819 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.270636+0000", 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013042259999999999 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271181+0000", 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054502999999999995 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271339+0000", 2024-09-10T15:26:18.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015786500000000001 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271453+0000", 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113403 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:18.651 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 54.951675659000003, 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032738950000000002, 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 847 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:18.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:18.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560228+0000", 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.283e-06 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560239+0000", 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1377e-05 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560270+0000", 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1375999999999999e-05 2024-09-10T15:26:18.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560285+0000", 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4703e-05 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560428+0000", 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014316599999999999 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560779+0000", 2024-09-10T15:26:18.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035106699999999999 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.561337+0000", 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000557896 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.562655+0000", 2024-09-10T15:26:18.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013175159999999999 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563245+0000", 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000590363 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563390+0000", 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000145255 2024-09-10T15:26:18.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563499+0000", 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108893 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:18.658 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:18.659 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:18.511+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:18.660 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:18.702 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:18.699+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:18.762 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:18.762+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:18.828 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:18.828 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:18.828 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:18.828 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:18.842 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:18.863 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:18.862+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:18.964 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:18.959+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:18.972 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:18.972 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:18.972 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:18.987 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:19.010 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:19.065 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:19.062+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:19.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:105 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'67, mlcod=16'64)", 2024-09-10T15:26:19.151 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.165852783000005, 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075661770000000003, 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982439+0000", 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6799999999999999e-07 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982456+0000", 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7634000000000001e-05 2024-09-10T15:26:19.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982483+0000", 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982528+0000", 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5179999999999998e-05 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983277+0000", 2024-09-10T15:26:19.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074871099999999999 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983354+0000", 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7305999999999995e-05 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989912+0000", 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065581659999999998 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990004+0000", 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2268999999999994e-05 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.165012367000003, 2024-09-10T15:26:19.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086529399999999996, 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983280+0000", 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6470000000000001e-06 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983337+0000", 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6511999999999997e-05 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983356+0000", 2024-09-10T15:26:19.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9633e-05 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983368+0000", 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.19e-05 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984356+0000", 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00098816300000000002 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984417+0000", 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0829000000000003e-05 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991834+0000", 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0074170369999999996 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991931+0000", 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7219000000000005e-05 2024-09-10T15:26:19.160 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.164234883000006, 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0080112450000000002, 2024-09-10T15:26:19.161 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:19.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:19.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984058+0000", 2024-09-10T15:26:19.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:26:19.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984070+0000", 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2193e-05 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984096+0000", 2024-09-10T15:26:19.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5913000000000001e-05 2024-09-10T15:26:19.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984110+0000", 2024-09-10T15:26:19.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.398e-05 2024-09-10T15:26:19.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985455+0000", 2024-09-10T15:26:19.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013447229999999999 2024-09-10T15:26:19.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985508+0000", 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3560000000000002e-05 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991939+0000", 2024-09-10T15:26:19.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006430776 2024-09-10T15:26:19.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992067+0000", 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012820299999999999 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.171 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'64)", 2024-09-10T15:26:19.171 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:19.171 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.164154350999993, 2024-09-10T15:26:19.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010192494999999999, 2024-09-10T15:26:19.171 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.172 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.172 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.172 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:19.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:19.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:19.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1399999999999997e-07 2024-09-10T15:26:19.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984145+0000", 2024-09-10T15:26:19.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4400000000000005e-06 2024-09-10T15:26:19.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984301+0000", 2024-09-10T15:26:19.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000155632 2024-09-10T15:26:19.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984317+0000", 2024-09-10T15:26:19.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6203000000000001e-05 2024-09-10T15:26:19.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986485+0000", 2024-09-10T15:26:19.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00216782 2024-09-10T15:26:19.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986537+0000", 2024-09-10T15:26:19.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1616999999999997e-05 2024-09-10T15:26:19.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994232+0000", 2024-09-10T15:26:19.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0076954359999999999 2024-09-10T15:26:19.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994329+0000", 2024-09-10T15:26:19.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6832999999999999e-05 2024-09-10T15:26:19.180 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.180 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.181 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.181 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'64)", 2024-09-10T15:26:19.181 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:19.181 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.163921345999995, 2024-09-10T15:26:19.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010043306, 2024-09-10T15:26:19.182 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.182 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.182 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.182 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:19.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:19.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984371+0000", 2024-09-10T15:26:19.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8700000000000004e-07 2024-09-10T15:26:19.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984436+0000", 2024-09-10T15:26:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5683000000000001e-05 2024-09-10T15:26:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984461+0000", 2024-09-10T15:26:19.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5202999999999999e-05 2024-09-10T15:26:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984475+0000", 2024-09-10T15:26:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:26:19.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987258+0000", 2024-09-10T15:26:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027837579999999999 2024-09-10T15:26:19.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987310+0000", 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1164e-05 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994338+0000", 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070280209999999997 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994413+0000", 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5259999999999994e-05 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.190 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'64)", 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.163569705, 2024-09-10T15:26:19.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097639709999999998, 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:19.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984723+0000", 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3540000000000001e-06 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984733+0000", 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0815999999999999e-05 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984756+0000", 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.266e-05 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984771+0000", 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4902999999999999e-05 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988534+0000", 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037629180000000001 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988567+0000", 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3596000000000002e-05 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994420+0000", 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058521880000000004 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994485+0000", 2024-09-10T15:26:19.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5536000000000004e-05 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'64)", 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.163164520999999, 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094333969999999996, 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.197 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985128+0000", 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5629999999999999e-06 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985140+0000", 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985166+0000", 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6006000000000001e-05 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985183+0000", 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7337e-05 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989168+0000", 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039847260000000001 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989228+0000", 2024-09-10T15:26:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0439000000000002e-05 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994491+0000", 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005262783 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994560+0000", 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8782999999999995e-05 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'64)", 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.162697567999999, 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090445999999999999, 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985595+0000", 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.406e-06 2024-09-10T15:26:19.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985706+0000", 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111543 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985722+0000", 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.615e-05 2024-09-10T15:26:19.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985733+0000", 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0383e-05 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990104+0000", 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043707889999999999 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990136+0000", 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2780000000000001e-05 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994565+0000", 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044290930000000003 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994638+0000", 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2455999999999999e-05 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'64)", 2024-09-10T15:26:19.208 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:19.208 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.162216134999994, 2024-09-10T15:26:19.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094591999999999992, 2024-09-10T15:26:19.208 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.208 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.208 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986076+0000", 2024-09-10T15:26:19.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0300000000000001e-06 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986082+0000", 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6529999999999997e-06 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986106+0000", 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4070000000000002e-05 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986115+0000", 2024-09-10T15:26:19.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991015+0000", 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048994119999999997 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991072+0000", 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7719000000000001e-05 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995438+0000", 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043650629999999998 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995534+0000", 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6372999999999994e-05 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:114 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'76, mlcod=16'64)", 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:19.213 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.161829151999996, 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091621759999999993, 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:19.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.04e-06 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986472+0000", 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.594e-06 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986492+0000", 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9715999999999999e-05 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986505+0000", 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3097e-05 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992171+0000", 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005665916 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992224+0000", 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000001e-05 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995545+0000", 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033213000000000001 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995624+0000", 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8763000000000005e-05 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'64)", 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.161443887999994, 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0088521850000000003, 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.218 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986848+0000", 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.393e-06 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987023+0000", 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174539 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987052+0000", 2024-09-10T15:26:19.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8856999999999998e-05 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987076+0000", 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4505999999999999e-05 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993021+0000", 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059451599999999997 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993074+0000", 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2772999999999998e-05 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995630+0000", 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002556268 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995699+0000", 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8689000000000006e-05 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.222 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'65)", 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.160863935999998, 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090862770000000002, 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:19.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987428+0000", 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3400000000000001e-06 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987440+0000", 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.135e-05 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987455+0000", 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5424e-05 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987465+0000", 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6360000000000006e-06 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994716+0000", 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072511140000000003 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994765+0000", 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9576000000000001e-05 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996416+0000", 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016509210000000001 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996513+0000", 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6916000000000005e-05 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'65)", 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.160511534999998, 2024-09-10T15:26:19.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011100295, 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987780+0000", 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.026e-06 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987788+0000", 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5270000000000001e-06 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987802+0000", 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.377e-05 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987809+0000", 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7570000000000004e-06 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995780+0000", 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079709749999999999 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995815+0000", 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4183000000000001e-05 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998786+0000", 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029716640000000002 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998880+0000", 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3393000000000005e-05 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.231 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:120 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'82, mlcod=16'78)", 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.147213894000004, 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0060483389999999998, 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001079+0000", 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001139+0000", 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0016000000000003e-05 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001163+0000", 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4097e-05 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001176+0000", 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.27e-05 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001838+0000", 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066228499999999998 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001869+0000", 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0892000000000002e-05 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007045+0000", 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051759029999999999 2024-09-10T15:26:19.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007125+0000", 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0532999999999996e-05 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:121 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'83, mlcod=16'78)", 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 78.146900213999999, 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057800289999999999, 2024-09-10T15:26:19.236 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001392+0000", 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1000000000000001e-06 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001462+0000", 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0612999999999996e-05 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001477+0000", 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4956999999999999e-05 2024-09-10T15:26:19.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001486+0000", 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9230000000000008e-06 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.002501+0000", 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001014479 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.002536+0000", 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4876000000000003e-05 2024-09-10T15:26:19.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007131+0000", 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045956210000000003 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007171+0000", 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9459999999999998e-05 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:153 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'107, mlcod=16'105)", 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 76.950617854000001, 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055242870000000001, 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197675+0000", 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197700+0000", 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4216e-05 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197738+0000", 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197764+0000", 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5159000000000001e-05 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197912+0000", 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014814900000000001 2024-09-10T15:26:19.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197952+0000", 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0516999999999998e-05 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203117+0000", 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051643169999999999 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203197+0000", 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0698999999999994e-05 2024-09-10T15:26:19.244 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:154 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'108, mlcod=16'105)", 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 76.950236984, 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051879329999999996, 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198055+0000", 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5e-06 2024-09-10T15:26:19.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198084+0000", 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8203000000000001e-05 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198104+0000", 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0466999999999999e-05 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198115+0000", 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0682999999999999e-05 2024-09-10T15:26:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198712+0000", 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059749200000000003 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198748+0000", 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5933000000000003e-05 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203203+0000", 2024-09-10T15:26:19.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044549419999999999 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203242+0000", 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8713e-05 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:159 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'113, mlcod=16'105)", 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 76.947974311999999, 2024-09-10T15:26:19.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048658099999999999, 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:26:19.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200318+0000", 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.187e-06 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200332+0000", 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3787e-05 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200351+0000", 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9026e-05 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200364+0000", 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3346999999999999e-05 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203389+0000", 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030251660000000001 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203443+0000", 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3633e-05 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.205132+0000", 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016897139999999999 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.205182+0000", 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9950000000000001e-05 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.253 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:237 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 56.140098612000003, 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0053950949999999999, 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 237 2024-09-10T15:26:19.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008194+0000", 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8330000000000001e-06 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008205+0000", 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1037e-05 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008265+0000", 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.9573e-05 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008280+0000", 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.558e-05 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008393+0000", 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113029 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008625+0000", 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231244 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009122+0000", 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049786700000000004 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010600+0000", 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001477555 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013417+0000", 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028166010000000002 2024-09-10T15:26:19.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013527+0000", 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110266 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013587+0000", 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0510000000000002e-05 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 55.575853846999998, 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052963760000000002, 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 852 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:19.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572439+0000", 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.334e-06 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572451+0000", 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1703e-05 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572484+0000", 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2852999999999999e-05 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572503+0000", 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9300000000000002e-05 2024-09-10T15:26:19.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572641+0000", 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013763499999999999 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572873+0000", 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023205900000000001 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.573340+0000", 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046693599999999999 2024-09-10T15:26:19.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.574625+0000", 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012853999999999999 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577474+0000", 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028487080000000001 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577620+0000", 2024-09-10T15:26:19.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014651200000000001 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577733+0000", 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112936 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:19.265 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:19.266 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:19.267 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:19.267 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:19.268 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:19.268 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:19.268 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:19.263+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:19.268 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:19.269 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:19.269 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:19.269 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:19.272 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:19.272 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:19.304 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:19.305 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:19.335 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:19.336 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:19.365 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:19.365 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:19.367 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:19.366+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:19.439 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:19.439 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:19.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:19.497 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:19.495+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:19.570 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:19.567+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:19.576 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:19.576 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:19.590 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:19.671 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:19.670+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:19.766 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:19.766 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:19.772 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:19.770+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:19.780 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:19.873 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:19.870+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:19.906 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:19.906 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:19.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:19.975 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:19.971+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:20.040 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:20.040 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:20.050 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:26:20.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:20.097 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:20.095+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:20.176 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:20.174+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:20.215 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:20.215 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:20.229 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:20.276 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:20.274+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:20.359 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:20.359 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:20.373 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:20.377 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:20.375+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:20.478 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:20.478+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:20.527 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:20.528 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:20.542 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:20.580 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:20.575+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:20.680 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:20.678+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:20.705 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:20.706 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:20.719 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:20.806 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:20.806+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:20.870 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:20.870 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:20.882 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:20.883 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:20.879+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:20.983 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:20.979+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:21.041 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:21.041 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:21.054 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:21.084 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:21.079+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:21.173 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:21.173 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:21.185 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:21.182+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:21.187 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:21.286 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:21.283+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:21.348 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:21.348 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:21.362 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:21.389 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:21.410 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:21.410+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:21.486 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:21.487 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:21.488 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:21.483+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:21.500 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:21.555 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:21.555 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:21.586 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:21.586 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:21.589 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:21.587+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:21.614 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:21.614 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:21.618 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:21.618 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:21.630 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:21.650 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:21.650 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:21.686 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:21.686 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:21.690 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:21.687+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:21.710 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:21.711 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:21.731 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:21.732 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:21.741 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:21.741 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:21.741 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:21.741 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:21.752 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:21.752 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:21.754 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:21.791 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:21.787+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:21.892 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:21.887+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:21.915 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:21.916 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:21.916 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:21.916 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:21.916 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:21.929 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:21.992 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:21.990+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:22.043 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.518658275999996, 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:22.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:22.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.050 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 78.303266797000006, 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:22.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.055 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 77.512285512000005, 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:22.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:22.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 76.503826383000003, 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:22.062 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:22.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:22.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 64.195292890999994, 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.069 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:22.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:22.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.139224089999999, 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:22.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.122165142999997, 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:22.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:22.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:22.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.095018676000002, 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:26:22.087 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:26:22.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.076622581999999, 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:26:22.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:26:22.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.051535821999998, 2024-09-10T15:26:22.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:22.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:22.105 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 59.044206844999998, 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:22.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:26:22.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:26:22.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.904780207000002, 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.111 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:22.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.821786824999997, 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.117 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:26:22.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:26:22.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.819183295000002, 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.123 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.127 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.816283880999997, 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:26:22.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:26:22.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:22.133 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.597363090999998, 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:26:22.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.137 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.488274128999997, 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.138 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:26:22.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:26:22.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:26:22.143 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.467835880999999, 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:26:22.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:26:22.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.443037459000003, 2024-09-10T15:26:22.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:26:22.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:26:22.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:26:22.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 58.278704822999998, 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:22.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:26:22.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:26:22.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:26:22.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:22.158 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:22.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:26:22.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:22.161 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:22.159+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:22.261 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:22.258+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:22.295 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:22.296 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:22.296 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:22.296 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:22.310 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:22.362 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:22.359+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:22.441 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:22.441 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:22.441 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:22.441 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:22.441 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:22.455 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:22.489 INFO:tasks.workunit.client.0.smithi099.stderr:Updating files: 98% (11945/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-09-10T15:26:22.497 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:22.495+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:22.562 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:22.562+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:22.619 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.752945437999998, 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055234610000000003, 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:22.620 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 44 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864941+0000", 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7670000000000001e-06 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864967+0000", 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5925999999999999e-05 2024-09-10T15:26:22.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864994+0000", 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7327000000000001e-05 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865035+0000", 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0386999999999998e-05 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865189+0000", 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015459800000000001 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865211+0000", 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1569999999999998e-05 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870207+0000", 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049961210000000001 2024-09-10T15:26:22.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870461+0000", 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025376499999999998 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.733622410000002, 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034111469999999998, 2024-09-10T15:26:22.625 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 206 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884264+0000", 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3560000000000001e-06 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884283+0000", 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-05 2024-09-10T15:26:22.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884318+0000", 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5516999999999999e-05 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884341+0000", 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2616000000000002e-05 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884497+0000", 2024-09-10T15:26:22.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884741+0000", 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243842 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.885152+0000", 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041088000000000002 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887012+0000", 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0018603129999999999 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887519+0000", 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050694599999999998 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887603+0000", 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.3968999999999995e-05 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887671+0000", 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8362999999999996e-05 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.729934452000002, 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040867880000000001, 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.631 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 207 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887950+0000", 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8700000000000001e-06 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887959+0000", 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3870000000000001e-06 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887982+0000", 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2589e-05 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887995+0000", 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2907e-05 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888086+0000", 2024-09-10T15:26:22.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1593000000000002e-05 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888328+0000", 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024150500000000001 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888738+0000", 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040969299999999998 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891834+0000", 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030965419999999999 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891891+0000", 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7173000000000003e-05 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891976+0000", 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5060000000000002e-05 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892035+0000", 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8468999999999999e-05 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.716834118999998, 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003650174, 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.637 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 210 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901052+0000", 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.179e-06 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901068+0000", 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6793e-05 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901111+0000", 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.244e-05 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901133+0000", 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2419999999999999e-05 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901301+0000", 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016767900000000001 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901644+0000", 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034309999999999999 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.902345+0000", 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000700462 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.903718+0000", 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013736690000000001 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904545+0000", 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00082700999999999998 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904636+0000", 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0863000000000001e-05 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904699+0000", 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2558999999999995e-05 2024-09-10T15:26:22.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.663703449000003, 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033557069999999999, 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 222 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954182+0000", 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7460000000000001e-06 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954194+0000", 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1922999999999999e-05 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954226+0000", 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2302999999999999e-05 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954247+0000", 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1347000000000001e-05 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954445+0000", 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019739200000000001 2024-09-10T15:26:22.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954661+0000", 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021628500000000001 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.955094+0000", 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043296300000000002 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.956711+0000", 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001616644 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957380+0000", 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066963199999999997 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957470+0000", 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9369000000000004e-05 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957535+0000", 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5103000000000003e-05 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.634875698999998, 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003230208, 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.649 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 230 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983009+0000", 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.537e-06 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983021+0000", 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2033e-05 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983053+0000", 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983078+0000", 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4876e-05 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983211+0000", 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133189 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983435+0000", 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022390499999999999 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983857+0000", 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042188000000000002 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.985345+0000", 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014883520000000001 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986080+0000", 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00073420400000000002 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986174+0000", 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4662999999999998e-05 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986237+0000", 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2722e-05 2024-09-10T15:26:22.654 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.609601591000001, 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055684239999999998, 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.655 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 238 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008283+0000", 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008297+0000", 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3933e-05 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008333+0000", 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6096999999999997e-05 2024-09-10T15:26:22.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008356+0000", 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2942000000000002e-05 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008504+0000", 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014746299999999999 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008719+0000", 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021527199999999999 2024-09-10T15:26:22.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009020+0000", 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030114399999999999 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010376+0000", 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001355633 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013584+0000", 2024-09-10T15:26:22.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032078879999999999 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013738+0000", 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015396299999999999 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013849+0000", 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111632 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:237 6.f e35/29 6:f24cb4a8:gc::gc.31:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.608558772000002, 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036952579999999999, 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:22.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009326+0000", 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009369+0000", 2024-09-10T15:26:22.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2823e-05 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009395+0000", 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6095999999999999e-05 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009412+0000", 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7765999999999999e-05 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009543+0000", 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013065599999999999 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009592+0000", 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.867e-05 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.012924+0000", 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003331924 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013019+0000", 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5415999999999996e-05 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:266 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.602932873, 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051958239999999999, 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.665 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 266 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014952+0000", 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4940000000000002e-06 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014964+0000", 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1646e-05 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015000+0000", 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5719999999999997e-05 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015019+0000", 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9524000000000001e-05 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015160+0000", 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015383+0000", 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022293500000000001 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015753+0000", 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036921000000000002 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.018680+0000", 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002926948 2024-09-10T15:26:22.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019892+0000", 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001212114 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020041+0000", 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014964899999999999 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020146+0000", 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010417900000000001 2024-09-10T15:26:22.670 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.601111987000003, 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032349560000000002, 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.671 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 271 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016773+0000", 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016787+0000", 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3696999999999999e-05 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016825+0000", 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8036e-05 2024-09-10T15:26:22.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016846+0000", 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0846999999999999e-05 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017021+0000", 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017525799999999999 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017343+0000", 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032234800000000002 2024-09-10T15:26:22.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017890+0000", 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054723900000000004 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019263+0000", 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013724029999999999 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019734+0000", 2024-09-10T15:26:22.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047077600000000001 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019896+0000", 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016226899999999999 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020006+0000", 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109626 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:288 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.596422136000001, 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049465189999999999, 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 288 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021463+0000", 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.244e-06 2024-09-10T15:26:22.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021492+0000", 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9193e-05 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021529+0000", 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7045999999999997e-05 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021551+0000", 2024-09-10T15:26:22.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.162e-05 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021684+0000", 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013378899999999999 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021892+0000", 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020753500000000001 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:22.680 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.022406+0000", 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00051442899999999995 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.023735+0000", 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001328894 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026196+0000", 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002460931 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026340+0000", 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000143478 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026407+0000", 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7360000000000006e-05 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.682 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:329 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.585926784000002, 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032556690000000001, 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 329 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031958+0000", 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.61e-06 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031988+0000", 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9614000000000001e-05 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032017+0000", 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459e-05 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032032+0000", 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4643e-05 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032182+0000", 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015022599999999999 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032430+0000", 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024767399999999997 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032939+0000", 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050894999999999998 2024-09-10T15:26:22.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034259+0000", 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013200200000000001 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034952+0000", 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069333100000000005 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035101+0000", 2024-09-10T15:26:22.687 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148913 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035211+0000", 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110229 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:343 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:22.688 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.579626282, 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050411639999999999, 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 343 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.689 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038258+0000", 2024-09-10T15:26:22.690 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038269+0000", 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.023e-05 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038299+0000", 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0579e-05 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038321+0000", 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1497000000000001e-05 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038426+0000", 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104732 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038633+0000", 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020711899999999999 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038882+0000", 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249225 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.040030+0000", 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011478669999999999 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043027+0000", 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029972900000000001 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043184+0000", 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015672900000000001 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043297+0000", 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113699 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.694 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:347 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.574422826000003, 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040146030000000003, 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 347 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.695 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043462+0000", 2024-09-10T15:26:22.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3130000000000001e-06 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043474+0000", 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1596999999999999e-05 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043501+0000", 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7267000000000002e-05 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043515+0000", 2024-09-10T15:26:22.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3653e-05 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043636+0000", 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121842 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043777+0000", 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014075900000000001 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.044059+0000", 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028201499999999999 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.045090+0000", 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010304050000000001 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047188+0000", 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020984670000000001 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047356+0000", 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016759199999999999 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047474+0000", 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118693 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.700 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:367 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.566653672000001, 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037150709999999999, 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 367 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.701 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051232+0000", 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7199999999999998e-06 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051245+0000", 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3463e-05 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051285+0000", 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0142999999999998e-05 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051308+0000", 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2402999999999999e-05 2024-09-10T15:26:22.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051430+0000", 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012228299999999999 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051564+0000", 2024-09-10T15:26:22.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013370499999999999 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051947+0000", 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038371100000000001 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053415+0000", 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001467512 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054793+0000", 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013784019999999999 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054880+0000", 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7188999999999995e-05 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054944+0000", 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3540000000000005e-05 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.706 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:371 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.565201127000002, 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052951489999999999, 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.707 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 371 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052683+0000", 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.883e-06 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052693+0000", 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7769999999999997e-06 2024-09-10T15:26:22.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052716+0000", 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663e-05 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052729+0000", 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3144e-05 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052870+0000", 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053183+0000", 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031270700000000001 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053663+0000", 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047959100000000002 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055240+0000", 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001577097 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057660+0000", 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002420008 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057818+0000", 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015781899999999999 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057977+0000", 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015905499999999999 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:408 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.553297772000001, 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041063569999999997, 2024-09-10T15:26:22.713 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 408 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064587+0000", 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8029999999999999e-06 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064596+0000", 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2259999999999994e-06 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064620+0000", 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4136000000000001e-05 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064634+0000", 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3821e-05 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064735+0000", 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101005 2024-09-10T15:26:22.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064867+0000", 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013217599999999999 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065108+0000", 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240781 2024-09-10T15:26:22.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066676+0000", 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001568287 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068521+0000", 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001844516 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068640+0000", 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119239 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068691+0000", 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1366999999999998e-05 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:589 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:22.719 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.451988417999999, 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00439215, 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 589 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:22.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165896+0000", 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.778e-06 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165906+0000", 2024-09-10T15:26:22.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0448999999999999e-05 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165937+0000", 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0295e-05 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165953+0000", 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6189999999999999e-05 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166090+0000", 2024-09-10T15:26:22.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013686699999999999 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166312+0000", 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221862 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166744+0000", 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043218999999999999 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.168018+0000", 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00127389 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170092+0000", 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020744140000000001 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170176+0000", 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4172000000000007e-05 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170286+0000", 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110043 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.349698662999998, 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032686149999999999, 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.725 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 715 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268186+0000", 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9929999999999998e-06 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268197+0000", 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1207e-05 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268228+0000", 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1316000000000003e-05 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268243+0000", 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4610000000000001e-05 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268393+0000", 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150416 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268773+0000", 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037973 2024-09-10T15:26:22.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.269332+0000", 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000558819 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.270636+0000", 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013042259999999999 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271181+0000", 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054502999999999995 2024-09-10T15:26:22.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271339+0000", 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015786500000000001 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271453+0000", 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113403 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.057657267000003, 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032738950000000002, 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 847 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:22.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560228+0000", 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.283e-06 2024-09-10T15:26:22.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560239+0000", 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1377e-05 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560270+0000", 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1375999999999999e-05 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560285+0000", 2024-09-10T15:26:22.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4703e-05 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560428+0000", 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014316599999999999 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560779+0000", 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035106699999999999 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:22.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.561337+0000", 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000557896 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.562655+0000", 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013175159999999999 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563245+0000", 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000590363 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:22.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563390+0000", 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000145255 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563499+0000", 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108893 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:22.736 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:22.738 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:22.738 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:22.735+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:22.838 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:22.838+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:22.908 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:22.909 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:22.909 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:22.909 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:22.923 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:22.969 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:22.967+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:23.040 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:23.038+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:23.044 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:23.045 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:23.045 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:23.045 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:23.045 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:23.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:23.065 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:26:23.140 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:23.138+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:105 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'67, mlcod=16'64)", 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.242643048000005, 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075661770000000003, 2024-09-10T15:26:23.228 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982439+0000", 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6799999999999999e-07 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982456+0000", 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7634000000000001e-05 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982483+0000", 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:23.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982528+0000", 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5179999999999998e-05 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983277+0000", 2024-09-10T15:26:23.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074871099999999999 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983354+0000", 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7305999999999995e-05 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989912+0000", 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065581659999999998 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990004+0000", 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2268999999999994e-05 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.241802632000002, 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086529399999999996, 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.233 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983280+0000", 2024-09-10T15:26:23.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6470000000000001e-06 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983337+0000", 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6511999999999997e-05 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983356+0000", 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9633e-05 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983368+0000", 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.19e-05 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984356+0000", 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00098816300000000002 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984417+0000", 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0829000000000003e-05 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991834+0000", 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0074170369999999996 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991931+0000", 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7219000000000005e-05 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.237 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.241025148000006, 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0080112450000000002, 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984058+0000", 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984070+0000", 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2193e-05 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984096+0000", 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5913000000000001e-05 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984110+0000", 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.398e-05 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985455+0000", 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013447229999999999 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985508+0000", 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3560000000000002e-05 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991939+0000", 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006430776 2024-09-10T15:26:23.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992067+0000", 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012820299999999999 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'64)", 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.240944615999993, 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010192494999999999, 2024-09-10T15:26:23.242 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1399999999999997e-07 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984145+0000", 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4400000000000005e-06 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984301+0000", 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000155632 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984317+0000", 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6203000000000001e-05 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986485+0000", 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00216782 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986537+0000", 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1616999999999997e-05 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994232+0000", 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0076954359999999999 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994329+0000", 2024-09-10T15:26:23.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6832999999999999e-05 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'64)", 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.240711610999995, 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010043306, 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.247 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984371+0000", 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8700000000000004e-07 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984436+0000", 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5683000000000001e-05 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984461+0000", 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5202999999999999e-05 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984475+0000", 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987258+0000", 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027837579999999999 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987310+0000", 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1164e-05 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994338+0000", 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070280209999999997 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994413+0000", 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5259999999999994e-05 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'64)", 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:23.251 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.24035997, 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097639709999999998, 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984723+0000", 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3540000000000001e-06 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984733+0000", 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0815999999999999e-05 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984756+0000", 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.266e-05 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984771+0000", 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4902999999999999e-05 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988534+0000", 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037629180000000001 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988567+0000", 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3596000000000002e-05 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994420+0000", 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058521880000000004 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994485+0000", 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5536000000000004e-05 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'64)", 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.239954785999998, 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094333969999999996, 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985128+0000", 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5629999999999999e-06 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985140+0000", 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985166+0000", 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6006000000000001e-05 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985183+0000", 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7337e-05 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989168+0000", 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039847260000000001 2024-09-10T15:26:23.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989228+0000", 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0439000000000002e-05 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994491+0000", 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005262783 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994560+0000", 2024-09-10T15:26:23.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8782999999999995e-05 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'64)", 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.239487832999998, 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090445999999999999, 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985595+0000", 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.406e-06 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985706+0000", 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111543 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985722+0000", 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.615e-05 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985733+0000", 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0383e-05 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990104+0000", 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043707889999999999 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990136+0000", 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2780000000000001e-05 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994565+0000", 2024-09-10T15:26:23.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044290930000000003 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994638+0000", 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2455999999999999e-05 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'64)", 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.239006399999994, 2024-09-10T15:26:23.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094591999999999992, 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986076+0000", 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0300000000000001e-06 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986082+0000", 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6529999999999997e-06 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986106+0000", 2024-09-10T15:26:23.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4070000000000002e-05 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986115+0000", 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991015+0000", 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048994119999999997 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991072+0000", 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7719000000000001e-05 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995438+0000", 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043650629999999998 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995534+0000", 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6372999999999994e-05 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:114 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'76, mlcod=16'64)", 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.238619416999995, 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091621759999999993, 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.04e-06 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986472+0000", 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.594e-06 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986492+0000", 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9715999999999999e-05 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986505+0000", 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3097e-05 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992171+0000", 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005665916 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992224+0000", 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000001e-05 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995545+0000", 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033213000000000001 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995624+0000", 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8763000000000005e-05 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.272 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'64)", 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.238234152999993, 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0088521850000000003, 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.273 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986848+0000", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.393e-06 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987023+0000", 2024-09-10T15:26:23.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174539 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987052+0000", 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8856999999999998e-05 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987076+0000", 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4505999999999999e-05 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993021+0000", 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059451599999999997 2024-09-10T15:26:23.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993074+0000", 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2772999999999998e-05 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995630+0000", 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002556268 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.276 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995699+0000", 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8689000000000006e-05 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'65)", 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.237654200999998, 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090862770000000002, 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.277 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.278 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987428+0000", 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3400000000000001e-06 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987440+0000", 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.135e-05 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987455+0000", 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5424e-05 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987465+0000", 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6360000000000006e-06 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994716+0000", 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072511140000000003 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994765+0000", 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9576000000000001e-05 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.280 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996416+0000", 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016509210000000001 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996513+0000", 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6916000000000005e-05 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.281 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'65)", 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.237301799999997, 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011100295, 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.282 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987780+0000", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.026e-06 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987788+0000", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5270000000000001e-06 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987802+0000", 2024-09-10T15:26:23.283 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.377e-05 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987809+0000", 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7570000000000004e-06 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995780+0000", 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079709749999999999 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995815+0000", 2024-09-10T15:26:23.284 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4183000000000001e-05 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998786+0000", 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029716640000000002 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998880+0000", 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3393000000000005e-05 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.285 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:120 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'82, mlcod=16'78)", 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.224004159000003, 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0060483389999999998, 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.286 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001079+0000", 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001139+0000", 2024-09-10T15:26:23.287 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0016000000000003e-05 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001163+0000", 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4097e-05 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001176+0000", 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.27e-05 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.288 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001838+0000", 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066228499999999998 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001869+0000", 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0892000000000002e-05 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007045+0000", 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051759029999999999 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.289 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007125+0000", 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0532999999999996e-05 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:121 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'83, mlcod=16'78)", 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 82.223690478999998, 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057800289999999999, 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.290 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001391+0000", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001392+0000", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1000000000000001e-06 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001462+0000", 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0612999999999996e-05 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001477+0000", 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4956999999999999e-05 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001486+0000", 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9230000000000008e-06 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.292 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.002501+0000", 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001014479 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.002536+0000", 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4876000000000003e-05 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007131+0000", 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045956210000000003 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007171+0000", 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9459999999999998e-05 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:153 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'107, mlcod=16'105)", 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 81.027408119, 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055242870000000001, 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.294 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197673+0000", 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197675+0000", 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2800000000000002e-06 2024-09-10T15:26:23.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197700+0000", 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4216e-05 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197738+0000", 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197764+0000", 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5159000000000001e-05 2024-09-10T15:26:23.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197912+0000", 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014814900000000001 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.197952+0000", 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0516999999999998e-05 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203117+0000", 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051643169999999999 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203197+0000", 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0698999999999994e-05 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:154 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'108, mlcod=16'105)", 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:26:23.298 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 81.027027249, 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051879329999999996, 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198054+0000", 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198055+0000", 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5e-06 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198084+0000", 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8203000000000001e-05 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198104+0000", 2024-09-10T15:26:23.300 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0466999999999999e-05 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198115+0000", 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0682999999999999e-05 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198712+0000", 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059749200000000003 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.198748+0000", 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5933000000000003e-05 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203203+0000", 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044549419999999999 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203242+0000", 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8713e-05 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.302 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:159 1.0 e17/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'113, mlcod=16'105)", 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 81.024764576999999, 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048658099999999999, 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:26:23.303 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200317+0000", 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200318+0000", 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.187e-06 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.304 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200332+0000", 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3787e-05 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200351+0000", 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9026e-05 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.200364+0000", 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3346999999999999e-05 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203389+0000", 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030251660000000001 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.203443+0000", 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3633e-05 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.205132+0000", 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016897139999999999 2024-09-10T15:26:23.306 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:02.205182+0000", 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9950000000000001e-05 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:237 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.216888877000002, 2024-09-10T15:26:23.307 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0053950949999999999, 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 237 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008192+0000", 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008194+0000", 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8330000000000001e-06 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008205+0000", 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1037e-05 2024-09-10T15:26:23.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008265+0000", 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.9573e-05 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008280+0000", 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.558e-05 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008393+0000", 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113029 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008625+0000", 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231244 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009122+0000", 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049786700000000004 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010600+0000", 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001477555 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.311 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013417+0000", 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028166010000000002 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013527+0000", 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110266 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013587+0000", 2024-09-10T15:26:23.312 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0510000000000002e-05 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:852 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 59.652644111999997, 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052963760000000002, 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.313 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 852 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572437+0000", 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572439+0000", 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.334e-06 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572451+0000", 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1703e-05 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572484+0000", 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2852999999999999e-05 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572503+0000", 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9300000000000002e-05 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572641+0000", 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013763499999999999 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.572873+0000", 2024-09-10T15:26:23.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023205900000000001 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.573340+0000", 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046693599999999999 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.574625+0000", 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012853999999999999 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577474+0000", 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028487080000000001 2024-09-10T15:26:23.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577620+0000", 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014651200000000001 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.577733+0000", 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000112936 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.318 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:23.320 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to '7162ca8a22368558b9ec845c47e93c7afc45e8c3'. 2024-09-10T15:26:23.320 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.321 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-10T15:26:23.322 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-09-10T15:26:23.322 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at 7162ca8a223 Merge branch 'wip-67712-squid' of https://github.com/cbodley/ceph into wip-tejas-testing-2024-09-09-1611-squid 2024-09-10T15:26:23.322 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:23.322 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:23.315+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:23.323 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-10T15:26:23.367 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-10T15:26:23.370 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T15:26:23.370 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-10T15:26:23.421 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:23.418+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:23.488 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:23.488 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:23.488 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:23.488 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:23.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:23.549 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:23.547+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:23.621 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:23.621 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:23.621 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:23.622 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:23.622 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:23.623 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:23.619+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:23.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:23.724 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:23.719+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:23.769 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 67.963456731999997, 2024-09-10T15:26:23.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:26:23.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.908315049000002, 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032891270000000002, 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.813 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894908+0000", 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3099999999999997e-07 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894927+0000", 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9320000000000001e-05 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894953+0000", 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6305e-05 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894974+0000", 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0315000000000001e-05 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895666+0000", 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069212899999999999 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895705+0000", 2024-09-10T15:26:23.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511000000000002e-05 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898094+0000", 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023885450000000002 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898196+0000", 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102271 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.894378377000002, 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067331149999999996, 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 212 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908847+0000", 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908860+0000", 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908886+0000", 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6553000000000001e-05 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908902+0000", 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5437000000000001e-05 2024-09-10T15:26:23.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909091+0000", 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018897799999999999 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909108+0000", 2024-09-10T15:26:23.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7603000000000001e-05 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.911974+0000", 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002865098 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912318+0000", 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034433499999999998 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:23.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912981+0000", 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066294100000000001 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.914409+0000", 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014279259999999999 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915383+0000", 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00097384900000000005 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915475+0000", 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2439e-05 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915577+0000", 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101876 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.824 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.830700348000001, 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031354550000000001, 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 227 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972522+0000", 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972524+0000", 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6299999999999998e-06 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972537+0000", 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2279999999999999e-05 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972569+0000", 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2199000000000001e-05 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972584+0000", 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4793999999999999e-05 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972705+0000", 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012087900000000001 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.972927+0000", 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022207499999999999 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.973341+0000", 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041414000000000002 2024-09-10T15:26:23.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.974687+0000", 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001345913 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975402+0000", 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071543400000000004 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975544+0000", 2024-09-10T15:26:23.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141896 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.975657+0000", 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011321500000000001 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.823753394999997, 2024-09-10T15:26:23.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031521919999999998, 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 229 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979469+0000", 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979471+0000", 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979485+0000", 2024-09-10T15:26:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4073000000000001e-05 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979517+0000", 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979531+0000", 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4769999999999999e-05 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979672+0000", 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014040600000000001 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.979916+0000", 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000244305 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.980332+0000", 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041584599999999999 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.981945+0000", 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001612701 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982476+0000", 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053147299999999997 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982557+0000", 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0835999999999997e-05 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.982621+0000", 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3938999999999999e-05 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.809804968999998, 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035617890000000001, 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.836 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 233 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993420+0000", 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993431+0000", 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.151e-05 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993463+0000", 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1662999999999998e-05 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993477+0000", 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.47e-05 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993627+0000", 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014946499999999999 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993999+0000", 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037189100000000001 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.994779+0000", 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077995400000000002 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996617+0000", 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001838519 2024-09-10T15:26:23.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996817+0000", 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000199655 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996908+0000", 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1232999999999999e-05 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996979+0000", 2024-09-10T15:26:23.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0878999999999997e-05 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:380 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.747594059999997, 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046206290000000002, 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.842 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 380 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055631+0000", 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2540000000000001e-06 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055643+0000", 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1875999999999999e-05 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055674+0000", 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0623000000000001e-05 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055689+0000", 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5339999999999999e-05 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055853+0000", 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000163523 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056161+0000", 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030789700000000001 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056575+0000", 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041402000000000002 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058087+0000", 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0015127649999999999 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060135+0000", 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020474849999999999 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060199+0000", 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4264999999999995e-05 2024-09-10T15:26:23.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060249+0000", 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9580999999999998e-05 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:398 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.742033237999998, 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005050527, 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.848 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 398 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061191+0000", 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5880000000000001e-06 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061199+0000", 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7269999999999996e-06 2024-09-10T15:26:23.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061219+0000", 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9743000000000001e-05 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061230+0000", 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1124999999999999e-05 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061335+0000", 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104786 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061525+0000", 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000190361 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062771+0000", 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001245538 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064149+0000", 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013781380000000001 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066121+0000", 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001971914 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066188+0000", 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6895000000000002e-05 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066239+0000", 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1712000000000002e-05 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.854 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.624511548999998, 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048961990000000004, 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 607 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178712+0000", 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.443e-06 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178720+0000", 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1049999999999995e-06 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178740+0000", 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9558000000000001e-05 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178751+0000", 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0886e-05 2024-09-10T15:26:23.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178837+0000", 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5889000000000004e-05 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178957+0000", 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120044 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.179175+0000", 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021854200000000001 2024-09-10T15:26:23.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.180055+0000", 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088007899999999997 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183495+0000", 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034399489999999999 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183560+0000", 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4669e-05 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183607+0000", 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7034999999999999e-05 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:614 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.860 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.619086553000002, 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003153304, 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 614 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184136+0000", 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184137+0000", 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1939999999999999e-06 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184143+0000", 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8540000000000002e-06 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184155+0000", 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2622e-05 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184163+0000", 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0299999999999994e-06 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184251+0000", 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7998999999999996e-05 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184348+0000", 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6212000000000007e-05 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.184654+0000", 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030643899999999998 2024-09-10T15:26:23.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.186177+0000", 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001522661 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187008+0000", 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00083182099999999995 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187185+0000", 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000176949 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.187289+0000", 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103523 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:668 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:26:23.866 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.581749903000002, 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050043780000000003, 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 668 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221474+0000", 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221483+0000", 2024-09-10T15:26:23.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9500000000000007e-06 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221509+0000", 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5627e-05 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221523+0000", 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4656e-05 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221632+0000", 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108305 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221843+0000", 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021159600000000001 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.222095+0000", 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025175000000000002 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.223008+0000", 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091253799999999996 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226321+0000", 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033133839999999999 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226414+0000", 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2669000000000003e-05 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226477+0000", 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2990000000000005e-05 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:675 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.575536851000003, 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00398336, 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.872 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 675 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227687+0000", 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.057e-06 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227699+0000", 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.199e-05 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227731+0000", 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1628999999999998e-05 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227748+0000", 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7274000000000001e-05 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227932+0000", 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018350500000000001 2024-09-10T15:26:23.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228079+0000", 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000146849 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228347+0000", 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026789799999999998 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.229446+0000", 2024-09-10T15:26:23.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001099308 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231522+0000", 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020760840000000002 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231611+0000", 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9118999999999998e-05 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231669+0000", 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7646999999999999e-05 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.360281938999996, 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051962070000000004, 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.878 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 798 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:26:23.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442942+0000", 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0370000000000001e-06 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442953+0000", 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0696000000000001e-05 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442985+0000", 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1853999999999997e-05 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443000+0000", 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4732999999999999e-05 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443139+0000", 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013904499999999999 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443393+0000", 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025468499999999999 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443859+0000", 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046606600000000001 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.445087+0000", 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001227681 2024-09-10T15:26:23.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.447858+0000", 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027710220000000002 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448017+0000", 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000158789 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448136+0000", 2024-09-10T15:26:23.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119599 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:804 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.343646110999998, 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031922360000000002, 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.884 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 804 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459576+0000", 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459578+0000", 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459590+0000", 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.131e-05 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459621+0000", 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0932999999999997e-05 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459636+0000", 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5e-05 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459759+0000", 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012373500000000001 2024-09-10T15:26:23.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.459981+0000", 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022172500000000001 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.460443+0000", 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000462354 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.461651+0000", 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001207243 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462506+0000", 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085575099999999997 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462657+0000", 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015077499999999999 2024-09-10T15:26:23.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.462768+0000", 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111113 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.183202371999997, 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003610715, 2024-09-10T15:26:23.890 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 871 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620022+0000", 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.153e-06 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620033+0000", 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0983e-05 2024-09-10T15:26:23.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620062+0000", 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9467000000000001e-05 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620079+0000", 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6226e-05 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620231+0000", 2024-09-10T15:26:23.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152659 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620596+0000", 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036434400000000001 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.621141+0000", 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054557900000000003 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.622459+0000", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013181930000000001 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623372+0000", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091299999999999997 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623521+0000", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014889800000000001 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623631+0000", 2024-09-10T15:26:23.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109213 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:873 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.178253200999997, 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0031086, 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.896 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 873 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624969+0000", 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624971+0000", 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9970000000000001e-06 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.624983+0000", 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2037e-05 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625016+0000", 2024-09-10T15:26:23.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2892999999999998e-05 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625031+0000", 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5290000000000001e-05 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625150+0000", 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011902500000000001 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625371+0000", 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000220812 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.625841+0000", 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046990600000000002 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627115+0000", 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012742669999999999 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627814+0000", 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069906500000000002 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.627963+0000", 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014890500000000001 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.628078+0000", 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000114403 2024-09-10T15:26:23.901 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.149349626999999, 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003669692, 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 886 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653875+0000", 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.34e-06 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653889+0000", 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4127e-05 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653920+0000", 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0786e-05 2024-09-10T15:26:23.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653935+0000", 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4846e-05 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654051+0000", 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011603999999999999 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654270+0000", 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021907099999999999 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654582+0000", 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031208800000000002 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.655676+0000", 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010938650000000001 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657273+0000", 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001597654 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657427+0000", 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015405900000000001 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657542+0000", 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011481600000000001 2024-09-10T15:26:23.907 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.144424031, 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032696209999999999, 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 888 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658798+0000", 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658800+0000", 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.973e-06 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658813+0000", 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2523e-05 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658845+0000", 2024-09-10T15:26:23.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2767e-05 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658861+0000", 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5760000000000002e-05 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.658986+0000", 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012435500000000001 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.659210+0000", 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224522 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.659674+0000", 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046431 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.660932+0000", 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00125764 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.661789+0000", 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085672299999999999 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.661951+0000", 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016220899999999999 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.662068+0000", 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000116839 2024-09-10T15:26:23.913 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.041284593999997, 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048721060000000002, 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 933 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761940+0000", 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0999999999999998e-06 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761950+0000", 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0733e-05 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761982+0000", 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1826999999999999e-05 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761997+0000", 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5228999999999999e-05 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762140+0000", 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014274900000000001 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762269+0000", 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000128529 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762518+0000", 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249335 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.763664+0000", 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011457679999999999 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766649+0000", 2024-09-10T15:26:23.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029852699999999999 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766742+0000", 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2373000000000005e-05 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766810+0000", 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8193000000000003e-05 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.919 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:946 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 60.007729478999998, 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032080849999999998, 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 946 2024-09-10T15:26:23.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:23.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795493+0000", 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795495+0000", 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3590000000000002e-06 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795506+0000", 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1246999999999999e-05 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795537+0000", 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0840000000000003e-05 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795552+0000", 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4759999999999999e-05 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.795694+0000", 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000142399 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.796074+0000", 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000379613 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.796628+0000", 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00055361600000000005 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798019+0000", 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001391853 2024-09-10T15:26:23.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798440+0000", 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000420433 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798591+0000", 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150805 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.798701+0000", 2024-09-10T15:26:23.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011016 2024-09-10T15:26:23.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.926 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:23.926 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:23.926 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:23.927 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:23.927 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:23.928 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:23.929 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:23.923+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:23.944 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:23.944 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:23.960 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:23.960 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:23.976 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:23.976 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:23.995 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:23.995 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:24.012 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:24.013 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:24.028 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:24.026+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:24.030 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:24.030 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:24.050 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:24.050 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:24.103 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:24.103 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:24.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:24.129 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:24.126+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:24.225 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-10T15:26:24.229 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:24.230+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:24.235 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:24.235 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:24.250 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:24.313 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-10T15:26:24.330 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:24.330+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:24.376 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:24.376 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:24.376 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-10T15:26:24.377 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T15:26:24.377 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-10T15:26:24.389 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:24.424 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-10T15:26:24.427 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-09-10T15:26:24.427 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-10T15:26:24.474 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:24.474+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:24.478 INFO:tasks.workunit:Running workunits matching rgw/s3_multipart_upload.pl on client.0... 2024-09-10T15:26:24.479 INFO:tasks.workunit:Running workunit rgw/s3_multipart_upload.pl... 2024-09-10T15:26:24.479 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/s3_multipart_upload.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7162ca8a22368558b9ec845c47e93c7afc45e8c3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-09-10T15:26:24.511 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:24.511 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:24.525 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:24.566 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:24.566+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:24.633 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:24.627+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:24.672 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:24.673 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:24.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:24.734 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:24.734+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:24.803 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:24.803 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:24.817 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:24.862 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:24.862+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:24.935 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:24.934+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:25.009 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:25.009 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:25.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:25.066 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:25.066+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:25.089 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:26:25.122 INFO:tasks.workunit.client.0.smithi099.stdout:Bucket Created: buck_2024_08_10_15_26_25 2024-09-10T15:26:25.123 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 1 2024-09-10T15:26:25.137 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:25.135+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:25.187 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:25.187 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:25.198 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:25.199 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:25.199 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0746224 s, 1.4 GB/s 2024-09-10T15:26:25.205 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:25.238 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:25.235+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:25.339 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:25.338+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:25.362 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:25.363 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:25.375 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:25.440 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:25.435+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:25.541 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:25.539+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:25.563 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:25.563 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:25.585 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:25.641 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:25.638+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:25.715 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.1 2024-09-10T15:26:25.716 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:25.716 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 2 2024-09-10T15:26:25.717 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:25.717 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:25.732 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:25.742 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:25.739+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:25.787 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:25.787 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:25.787 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0703677 s, 1.5 GB/s 2024-09-10T15:26:25.843 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:25.842+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:25.889 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:25.889 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:25.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:25.944 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:25.939+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:26.046 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:26.046+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:26.067 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:26.071 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:26:26.087 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:26.087 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:26.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:26.146 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:26.143+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:26.247 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:26.243+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:26.277 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:26.277 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:26.298 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:26.299 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:26.303 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:26.303 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:26.316 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:26.316 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:26.317 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:26.337 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:26.337 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:26.348 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:26.346+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:26.358 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:26.359 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:26.372 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.2 2024-09-10T15:26:26.372 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:26.372 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 3 2024-09-10T15:26:26.380 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:26.380 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:26.400 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:26.401 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:26.420 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:26.420 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:26.432 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.908595168000005, 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.433 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:26.434 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.435 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:26.436 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.437 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.438 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.439 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 82.693203689000001, 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:26.440 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:26.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:26.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:26.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:26.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 81.902222404, 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:26.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:26.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 80.893763274999998, 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:26.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:26.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.585229783000003, 2024-09-10T15:26:26.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:26.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:26.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:26.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 66.529160981999993, 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:26.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:26.471 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.512102034999998, 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.472 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:26.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:26.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:26.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:26.478 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.484955567999997, 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038993690000000002, 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.479 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 220 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946738+0000", 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946740+0000", 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5730000000000002e-06 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946752+0000", 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.172e-05 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946783+0000", 2024-09-10T15:26:26.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1523000000000003e-05 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946799+0000", 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5506999999999999e-05 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.946949+0000", 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015032899999999999 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947313+0000", 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00036335700000000002 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.947993+0000", 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00068077800000000005 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.949782+0000", 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001788303 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950480+0000", 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00069882699999999996 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950568+0000", 2024-09-10T15:26:26.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7100000000000003e-05 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.950637+0000", 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9351999999999996e-05 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.466559474, 2024-09-10T15:26:26.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040484120000000004, 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 225 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:26.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965134+0000", 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965136+0000", 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965147+0000", 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1240000000000001e-05 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965177+0000", 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0122999999999999e-05 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965194+0000", 2024-09-10T15:26:26.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6663e-05 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965340+0000", 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014571199999999999 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.965696+0000", 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035646099999999997 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.966441+0000", 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000745041 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.967929+0000", 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014875649999999999 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.968906+0000", 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00097716600000000002 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969062+0000", 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015665199999999999 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.969182+0000", 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119592 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.491 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.441472714, 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032356479999999998, 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 232 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990220+0000", 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990223+0000", 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3769999999999999e-06 2024-09-10T15:26:26.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990234+0000", 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0803e-05 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990264+0000", 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0516000000000001e-05 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990279+0000", 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.489e-05 2024-09-10T15:26:26.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990393+0000", 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114349 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.990611+0000", 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000217519 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.991021+0000", 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041039000000000001 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.992485+0000", 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014637980000000001 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993198+0000", 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00071295500000000003 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993342+0000", 2024-09-10T15:26:26.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.993456+0000", 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113589 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.434143736999999, 2024-09-10T15:26:26.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034612029999999999, 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 234 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:26.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997549+0000", 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997552+0000", 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5229999999999998e-06 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997563+0000", 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0787e-05 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997594+0000", 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0883000000000002e-05 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997608+0000", 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4637000000000001e-05 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997732+0000", 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000123879 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.997968+0000", 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235694 2024-09-10T15:26:26.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.998390+0000", 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042210700000000002 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.999638+0000", 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00124793 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000731+0000", 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010935490000000001 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.000899+0000", 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167722 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.001011+0000", 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111492 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.503 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:550 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.294717099000003, 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045546270000000003, 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.504 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 550 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136976+0000", 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136977+0000", 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5600000000000004e-07 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136980+0000", 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3799999999999998e-06 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136988+0000", 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1380000000000007e-06 2024-09-10T15:26:26.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.136993+0000", 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2910000000000001e-06 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137063+0000", 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9830000000000001e-05 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137167+0000", 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000104459 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.137395+0000", 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022759200000000001 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.138963+0000", 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015680760000000001 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141474+0000", 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025109500000000001 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141508+0000", 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3918999999999998e-05 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.141531+0000", 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3036000000000001e-05 2024-09-10T15:26:26.509 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:667 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.211723716999998, 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040252830000000002, 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.510 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 667 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219969+0000", 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219970+0000", 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.9400000000000004e-07 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219977+0000", 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2869999999999999e-06 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219987+0000", 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.1870000000000003e-06 2024-09-10T15:26:26.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.219992+0000", 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6010000000000002e-06 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220060+0000", 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7628999999999999e-05 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220149+0000", 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8669000000000001e-05 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.220308+0000", 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000159798 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223563+0000", 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032549039999999999 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223908+0000", 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034490500000000001 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223958+0000", 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9880999999999999e-05 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.223995+0000", 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6628000000000002e-05 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:668 6.1 e35/29 6:84d19476:::obj_delete_at_hint.0000000038:head v 35'5, mlcod=35'3)", 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.209120187000003, 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036910290000000002, 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222573+0000", 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222574+0000", 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.6599999999999996e-07 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222581+0000", 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9659999999999999e-06 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222591+0000", 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0084e-05 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222596+0000", 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2499999999999997e-06 2024-09-10T15:26:26.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222641+0000", 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5018999999999997e-05 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.222654+0000", 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3303e-05 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226202+0000", 2024-09-10T15:26:26.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035481000000000002 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.226264+0000", 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1641000000000002e-05 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:673 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:26.520 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 63.206220772999998, 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0038499200000000002, 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 673 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:26.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225472+0000", 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225473+0000", 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.068e-06 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225478+0000", 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1409999999999998e-06 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225487+0000", 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8220000000000002e-06 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225492+0000", 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6979999999999997e-06 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225524+0000", 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1930000000000001e-05 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225565+0000", 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1298000000000003e-05 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.225664+0000", 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8484000000000001e-05 2024-09-10T15:26:26.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.228777+0000", 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031137040000000001 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229048+0000", 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027022400000000001 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229204+0000", 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156792 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.229322+0000", 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117759 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:798 6.1 e35/29 6:8411e274:::obj_delete_at_hint.0000000073:head v 35'10, mlcod=35'8)", 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:26.526 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.987299983, 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033837070000000001, 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444393+0000", 2024-09-10T15:26:26.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444394+0000", 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.184e-06 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444403+0000", 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3760000000000008e-06 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444424+0000", 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1447e-05 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444441+0000", 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6495999999999999e-05 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444581+0000", 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014020100000000001 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.444595+0000", 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4222999999999999e-05 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447696+0000", 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003100495 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.447777+0000", 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1285000000000005e-05 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.530 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:844 6.1c 6:38283b28:::obj_delete_at_hint.0000000089:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.878211020999998, 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003328831, 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.531 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 844 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553482+0000", 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553484+0000", 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0099999999999998e-06 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553496+0000", 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1506e-05 2024-09-10T15:26:26.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553517+0000", 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1753e-05 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553531+0000", 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3674e-05 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.553680+0000", 2024-09-10T15:26:26.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000149462 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554036+0000", 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035561399999999997 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.554591+0000", 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00055450200000000001 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.555883+0000", 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00129221 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556529+0000", 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00064617899999999998 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556694+0000", 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016456199999999999 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.556811+0000", 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117359 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:852 6.6 e35/29 6:624175ac:::obj_delete_at_hint.0000000091:head v 35'12, mlcod=35'10)", 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.857772773000001, 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003468577, 2024-09-10T15:26:26.537 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573920+0000", 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573922+0000", 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7370000000000001e-06 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573933+0000", 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.099e-05 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573962+0000", 2024-09-10T15:26:26.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8863000000000001e-05 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.573975+0000", 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2923e-05 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574117+0000", 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014196900000000001 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.574152+0000", 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5209999999999997e-05 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577312+0000", 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003160019 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.577389+0000", 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6866000000000006e-05 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.541 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:862 6.8 6:116b4168:::obj_delete_at_hint.0000000095:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.832974350999997, 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034773569999999999, 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 862 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598719+0000", 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598721+0000", 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4600000000000002e-06 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598735+0000", 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3550000000000001e-05 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598764+0000", 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8983999999999999e-05 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598778+0000", 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4323e-05 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.598932+0000", 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015419500000000001 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599291+0000", 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000359224 2024-09-10T15:26:26.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.599831+0000", 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053930299999999998 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.600976+0000", 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011448509999999999 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.601979+0000", 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010036590000000001 2024-09-10T15:26:26.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602079+0000", 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9275000000000001e-05 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.602196+0000", 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117533 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.547 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:933 6.1 e35/29 6:86cc8a85:::obj_delete_at_hint.0000000118:head v 35'14, mlcod=35'12)", 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 62.668641715, 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034911529999999999, 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763051+0000", 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763053+0000", 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4959999999999999e-06 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763063+0000", 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.048e-05 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763087+0000", 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3317000000000001e-05 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763098+0000", 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1593000000000001e-05 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763218+0000", 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119766 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.763270+0000", 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1941999999999998e-05 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766453+0000", 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003183183 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:23.766543+0000", 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9376000000000006e-05 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.551 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:26.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:26.552 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:26.554 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:26.554 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:26.550+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:26.654 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:26.654+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:26.687 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:26.688 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:26.688 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:26.688 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:26.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:26.714 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:26.714 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:26.714 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.102522 s, 1.0 GB/s 2024-09-10T15:26:26.755 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:26.754+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:26.822 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:26.822 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:26.822 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:26.822 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:26.822 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:26.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:26.881 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:26.879+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:26.956 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:26.954+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:26.960 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:26.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:26.960 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:26.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 69.091828007000004, 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055234610000000003, 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 44 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.961 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864937+0000", 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864941+0000", 2024-09-10T15:26:26.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7670000000000001e-06 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864967+0000", 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5925999999999999e-05 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.864994+0000", 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7327000000000001e-05 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865035+0000", 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0386999999999998e-05 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865189+0000", 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015459800000000001 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.865211+0000", 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1569999999999998e-05 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870207+0000", 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049961210000000001 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:17.870461+0000", 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025376499999999998 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:26.965 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.072504979000001, 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034111469999999998, 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 206 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884260+0000", 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884264+0000", 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3560000000000001e-06 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884283+0000", 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-05 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884318+0000", 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5516999999999999e-05 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884341+0000", 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2616000000000002e-05 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884497+0000", 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015627499999999999 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.884741+0000", 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243842 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.885152+0000", 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041088000000000002 2024-09-10T15:26:26.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887012+0000", 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0018603129999999999 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887519+0000", 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050694599999999998 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887603+0000", 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.3968999999999995e-05 2024-09-10T15:26:26.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887671+0000", 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8362999999999996e-05 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.068817021000001, 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040867880000000001, 2024-09-10T15:26:26.971 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 207 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887948+0000", 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887950+0000", 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8700000000000001e-06 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887959+0000", 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3870000000000001e-06 2024-09-10T15:26:26.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887982+0000", 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2589e-05 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.887995+0000", 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2907e-05 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888086+0000", 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1593000000000002e-05 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888328+0000", 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024150500000000001 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.888738+0000", 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040969299999999998 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891834+0000", 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030965419999999999 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891891+0000", 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7173000000000003e-05 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.891976+0000", 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5060000000000002e-05 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892035+0000", 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8468999999999999e-05 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.055716688000004, 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003650174, 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.977 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 210 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901048+0000", 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901052+0000", 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.179e-06 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901068+0000", 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6793e-05 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901111+0000", 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.244e-05 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901133+0000", 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2419999999999999e-05 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901301+0000", 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016767900000000001 2024-09-10T15:26:26.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.901644+0000", 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034309999999999999 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.902345+0000", 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000700462 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.903718+0000", 2024-09-10T15:26:26.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013736690000000001 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904545+0000", 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00082700999999999998 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904636+0000", 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0863000000000001e-05 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:26.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.904699+0000", 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2558999999999995e-05 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.002586018000002, 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033557069999999999, 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 222 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954179+0000", 2024-09-10T15:26:26.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954182+0000", 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7460000000000001e-06 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954194+0000", 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1922999999999999e-05 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954226+0000", 2024-09-10T15:26:26.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2302999999999999e-05 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954247+0000", 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1347000000000001e-05 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954445+0000", 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019739200000000001 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:26.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.954661+0000", 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021628500000000001 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.955094+0000", 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043296300000000002 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.956711+0000", 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001616644 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957380+0000", 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066963199999999997 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957470+0000", 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9369000000000004e-05 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.957535+0000", 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5103000000000003e-05 2024-09-10T15:26:26.988 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.973758267999997, 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003230208, 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.989 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 230 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983007+0000", 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983009+0000", 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.537e-06 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983021+0000", 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2033e-05 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983053+0000", 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1847000000000002e-05 2024-09-10T15:26:26.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983078+0000", 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4876e-05 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983211+0000", 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133189 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983435+0000", 2024-09-10T15:26:26.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022390499999999999 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.983857+0000", 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042188000000000002 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.985345+0000", 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014883520000000001 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986080+0000", 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00073420400000000002 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986174+0000", 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4662999999999998e-05 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.986237+0000", 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2722e-05 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:26.994 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.94848416, 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055684239999999998, 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 238 2024-09-10T15:26:26.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008283+0000", 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008297+0000", 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3933e-05 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008333+0000", 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6096999999999997e-05 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008356+0000", 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2942000000000002e-05 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008504+0000", 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014746299999999999 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008719+0000", 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021527199999999999 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009020+0000", 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030114399999999999 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010376+0000", 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001355633 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013584+0000", 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032078879999999999 2024-09-10T15:26:26.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013738+0000", 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015396299999999999 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013849+0000", 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111632 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:237 6.f e35/29 6:f24cb4a8:gc::gc.31:head v 35'2, mlcod=0'0)", 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.947441341000001, 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036952579999999999, 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009324+0000", 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009326+0000", 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009369+0000", 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2823e-05 2024-09-10T15:26:27.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009395+0000", 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6095999999999999e-05 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009412+0000", 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7765999999999999e-05 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009543+0000", 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013065599999999999 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009592+0000", 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.867e-05 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.012924+0000", 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003331924 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013019+0000", 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5415999999999996e-05 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:266 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.941815441999999, 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051958239999999999, 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.005 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 266 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.006 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014950+0000", 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014952+0000", 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4940000000000002e-06 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.014964+0000", 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1646e-05 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015000+0000", 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5719999999999997e-05 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015019+0000", 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9524000000000001e-05 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015160+0000", 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:27.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015383+0000", 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022293500000000001 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.015753+0000", 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036921000000000002 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.018680+0000", 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002926948 2024-09-10T15:26:27.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019892+0000", 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001212114 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020041+0000", 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014964899999999999 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020146+0000", 2024-09-10T15:26:27.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010417900000000001 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.939994556000002, 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032349560000000002, 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.011 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 271 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016771+0000", 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016773+0000", 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016787+0000", 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3696999999999999e-05 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016825+0000", 2024-09-10T15:26:27.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8036e-05 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.016846+0000", 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0846999999999999e-05 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017021+0000", 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017525799999999999 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017343+0000", 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00032234800000000002 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.017890+0000", 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054723900000000004 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019263+0000", 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013724029999999999 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019734+0000", 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047077600000000001 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.019896+0000", 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016226899999999999 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.020006+0000", 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109626 2024-09-10T15:26:27.016 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:288 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.935304705, 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049465189999999999, 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.017 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 288 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021460+0000", 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.018 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021463+0000", 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.244e-06 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021492+0000", 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9193e-05 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021529+0000", 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7045999999999997e-05 2024-09-10T15:26:27.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021551+0000", 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.162e-05 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021684+0000", 2024-09-10T15:26:27.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013378899999999999 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.021892+0000", 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020753500000000001 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.022406+0000", 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00051442899999999995 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.023735+0000", 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001328894 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026196+0000", 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002460931 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026340+0000", 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000143478 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.026407+0000", 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7360000000000006e-05 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:329 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.924809353000001, 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032556690000000001, 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.023 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 329 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031956+0000", 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031958+0000", 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.61e-06 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.031988+0000", 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9614000000000001e-05 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032017+0000", 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459e-05 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032032+0000", 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4643e-05 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032182+0000", 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015022599999999999 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032430+0000", 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024767399999999997 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.032939+0000", 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00050894999999999998 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034259+0000", 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013200200000000001 2024-09-10T15:26:27.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.034952+0000", 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069333100000000005 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035101+0000", 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000148913 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.035211+0000", 2024-09-10T15:26:27.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110229 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:343 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.918508850999999, 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050411639999999999, 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.029 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 343 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038256+0000", 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038258+0000", 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1969999999999999e-06 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038269+0000", 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.023e-05 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038299+0000", 2024-09-10T15:26:27.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0579e-05 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038321+0000", 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1497000000000001e-05 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038426+0000", 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104732 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038633+0000", 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020711899999999999 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.038882+0000", 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249225 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.040030+0000", 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011478669999999999 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043027+0000", 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029972900000000001 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043184+0000", 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015672900000000001 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043297+0000", 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113699 2024-09-10T15:26:27.034 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:347 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.913305395000002, 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040146030000000003, 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.035 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 347 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043460+0000", 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043462+0000", 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3130000000000001e-06 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043474+0000", 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1596999999999999e-05 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043501+0000", 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7267000000000002e-05 2024-09-10T15:26:27.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043515+0000", 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3653e-05 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043636+0000", 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121842 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.043777+0000", 2024-09-10T15:26:27.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014075900000000001 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.044059+0000", 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028201499999999999 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.045090+0000", 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010304050000000001 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047188+0000", 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020984670000000001 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047356+0000", 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016759199999999999 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.047474+0000", 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118693 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.040 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:367 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.905536241, 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037150709999999999, 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.041 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 367 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051229+0000", 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051232+0000", 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7199999999999998e-06 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051245+0000", 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3463e-05 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051285+0000", 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0142999999999998e-05 2024-09-10T15:26:27.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051308+0000", 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2402999999999999e-05 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051430+0000", 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012228299999999999 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051564+0000", 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013370499999999999 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051947+0000", 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038371100000000001 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053415+0000", 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001467512 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054793+0000", 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013784019999999999 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054880+0000", 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7188999999999995e-05 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.054944+0000", 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3540000000000005e-05 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.046 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:371 6.16 6:6dc3b799:reshard::reshard.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.904083696000001, 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052951489999999999, 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.047 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 371 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052681+0000", 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052683+0000", 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.883e-06 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052693+0000", 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7769999999999997e-06 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052716+0000", 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663e-05 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052729+0000", 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3144e-05 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052870+0000", 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014140499999999999 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053183+0000", 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031270700000000001 2024-09-10T15:26:27.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053663+0000", 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047959100000000002 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055240+0000", 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001577097 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057660+0000", 2024-09-10T15:26:27.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002420008 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057818+0000", 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015781899999999999 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.057977+0000", 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015905499999999999 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:408 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.892180341, 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041063569999999997, 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 408 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.053 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064585+0000", 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064587+0000", 2024-09-10T15:26:27.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8029999999999999e-06 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064596+0000", 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2259999999999994e-06 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064620+0000", 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4136000000000001e-05 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064634+0000", 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3821e-05 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064735+0000", 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101005 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064867+0000", 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013217599999999999 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065108+0000", 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240781 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066676+0000", 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001568287 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068521+0000", 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001844516 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068640+0000", 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119239 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.068691+0000", 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1366999999999998e-05 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.058 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:589 6.9 6:9195808b:::obj_delete_at_hint.0000000027:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.790870986999998, 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00439215, 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 589 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165894+0000", 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165896+0000", 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.778e-06 2024-09-10T15:26:27.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165906+0000", 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0448999999999999e-05 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165937+0000", 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0295e-05 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165953+0000", 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6189999999999999e-05 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166090+0000", 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013686699999999999 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166312+0000", 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221862 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.166744+0000", 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043218999999999999 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.168018+0000", 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00127389 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170092+0000", 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020744140000000001 2024-09-10T15:26:27.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170176+0000", 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4172000000000007e-05 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.170286+0000", 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110043 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.688581231999997, 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032686149999999999, 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 715 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268184+0000", 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268186+0000", 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9929999999999998e-06 2024-09-10T15:26:27.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268197+0000", 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1207e-05 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268228+0000", 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1316000000000003e-05 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268243+0000", 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4610000000000001e-05 2024-09-10T15:26:27.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268393+0000", 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000150416 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.268773+0000", 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037973 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.269332+0000", 2024-09-10T15:26:27.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000558819 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.270636+0000", 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013042259999999999 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271181+0000", 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054502999999999995 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.069 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271339+0000", 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015786500000000001 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.271453+0000", 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113403 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 63.396539836000002, 2024-09-10T15:26:27.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032738950000000002, 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 847 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:27.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560225+0000", 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560228+0000", 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.283e-06 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560239+0000", 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1377e-05 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560270+0000", 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1375999999999999e-05 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560285+0000", 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4703e-05 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560428+0000", 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014316599999999999 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.560779+0000", 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035106699999999999 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.561337+0000", 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000557896 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.562655+0000", 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013175159999999999 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563245+0000", 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000590363 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563390+0000", 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000145255 2024-09-10T15:26:27.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.563499+0000", 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108893 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.076 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:27.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:27.078 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:27.078+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:27.178 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:27.175+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:27.254 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:27.254 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.018653183, 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018681803, 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "waiting for sub ops", 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:27.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:27.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 1 2024-09-10T15:26:27.260 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:27.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:27.279 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:27.278+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:27.380 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:27.375+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:27.457 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:27.457 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:27.457 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:27.457 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:27.457 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:27.471 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:27.513 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:27.511+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:27.560 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.3 2024-09-10T15:26:27.560 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:27.560 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 4 2024-09-10T15:26:27.582 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:27.582+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:27.636 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:105 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'67, mlcod=16'64)", 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.650846619000006, 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075661770000000003, 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.637 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982438+0000", 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982439+0000", 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6799999999999999e-07 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982456+0000", 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7634000000000001e-05 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982483+0000", 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.982528+0000", 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5179999999999998e-05 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983277+0000", 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074871099999999999 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983354+0000", 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7305999999999995e-05 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989912+0000", 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065581659999999998 2024-09-10T15:26:27.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990004+0000", 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2268999999999994e-05 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:106 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'68, mlcod=16'64)", 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.650006203000004, 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086529399999999996, 2024-09-10T15:26:27.642 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983278+0000", 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983280+0000", 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6470000000000001e-06 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983337+0000", 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6511999999999997e-05 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983356+0000", 2024-09-10T15:26:27.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9633e-05 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.983368+0000", 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.19e-05 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984356+0000", 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00098816300000000002 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984417+0000", 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0829000000000003e-05 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991834+0000", 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0074170369999999996 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991931+0000", 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7219000000000005e-05 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.646 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:107 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'69, mlcod=16'64)", 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.649228719000007, 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0080112450000000002, 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984056+0000", 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984058+0000", 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.897e-06 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984070+0000", 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2193e-05 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984096+0000", 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5913000000000001e-05 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984110+0000", 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.398e-05 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985455+0000", 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013447229999999999 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985508+0000", 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3560000000000002e-05 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991939+0000", 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006430776 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992067+0000", 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012820299999999999 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.651 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:108 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'70, mlcod=16'64)", 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.649148186999994, 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010192494999999999, 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984137+0000", 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1399999999999997e-07 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984145+0000", 2024-09-10T15:26:27.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4400000000000005e-06 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984301+0000", 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000155632 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984317+0000", 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6203000000000001e-05 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986485+0000", 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00216782 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986537+0000", 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1616999999999997e-05 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994232+0000", 2024-09-10T15:26:27.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0076954359999999999 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994329+0000", 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6832999999999999e-05 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.656 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:109 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'71, mlcod=16'64)", 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.648915181999996, 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010043306, 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.657 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984370+0000", 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984371+0000", 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8700000000000004e-07 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984436+0000", 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5683000000000001e-05 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984461+0000", 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5202999999999999e-05 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984475+0000", 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987258+0000", 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027837579999999999 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987310+0000", 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1164e-05 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994338+0000", 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070280209999999997 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994413+0000", 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5259999999999994e-05 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.661 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:110 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'72, mlcod=16'64)", 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.648563541000001, 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097639709999999998, 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984721+0000", 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984723+0000", 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3540000000000001e-06 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984733+0000", 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0815999999999999e-05 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984756+0000", 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.266e-05 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.984771+0000", 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4902999999999999e-05 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988534+0000", 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037629180000000001 2024-09-10T15:26:27.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.988567+0000", 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3596000000000002e-05 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994420+0000", 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058521880000000004 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994485+0000", 2024-09-10T15:26:27.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5536000000000004e-05 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:111 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'73, mlcod=16'64)", 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.648158357, 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094333969999999996, 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985126+0000", 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985128+0000", 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5629999999999999e-06 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985140+0000", 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985166+0000", 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6006000000000001e-05 2024-09-10T15:26:27.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985183+0000", 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7337e-05 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989168+0000", 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039847260000000001 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.989228+0000", 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0439000000000002e-05 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994491+0000", 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005262783 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994560+0000", 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8782999999999995e-05 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.670 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:112 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'74, mlcod=16'64)", 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.647691404, 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090445999999999999, 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985593+0000", 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985595+0000", 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.406e-06 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985706+0000", 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111543 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985722+0000", 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.615e-05 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.985733+0000", 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0383e-05 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990104+0000", 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043707889999999999 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.990136+0000", 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2780000000000001e-05 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994565+0000", 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044290930000000003 2024-09-10T15:26:27.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994638+0000", 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2455999999999999e-05 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:113 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'75, mlcod=16'64)", 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.647209970999995, 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094591999999999992, 2024-09-10T15:26:27.675 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986075+0000", 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986076+0000", 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0300000000000001e-06 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986082+0000", 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6529999999999997e-06 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986106+0000", 2024-09-10T15:26:27.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4070000000000002e-05 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986115+0000", 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8799999999999997e-06 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991015+0000", 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048994119999999997 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.991072+0000", 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7719000000000001e-05 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995438+0000", 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043650629999999998 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995534+0000", 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6372999999999994e-05 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:114 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'76, mlcod=16'64)", 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:27.680 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.646822987999997, 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091621759999999993, 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986462+0000", 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986463+0000", 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.04e-06 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986472+0000", 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.594e-06 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986492+0000", 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9715999999999999e-05 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986505+0000", 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3097e-05 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992171+0000", 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005665916 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.992224+0000", 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000001e-05 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995545+0000", 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033213000000000001 2024-09-10T15:26:27.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995624+0000", 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8763000000000005e-05 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:115 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'77, mlcod=16'64)", 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.646437723999995, 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0088521850000000003, 2024-09-10T15:26:27.685 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986847+0000", 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.986848+0000", 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.393e-06 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987023+0000", 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174539 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987052+0000", 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8856999999999998e-05 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987076+0000", 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4505999999999999e-05 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993021+0000", 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059451599999999997 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.993074+0000", 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2772999999999998e-05 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995630+0000", 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002556268 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995699+0000", 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8689000000000006e-05 2024-09-10T15:26:27.689 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:116 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'78, mlcod=16'65)", 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.645857771999999, 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090862770000000002, 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.690 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987427+0000", 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987428+0000", 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3400000000000001e-06 2024-09-10T15:26:27.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987440+0000", 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.135e-05 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987455+0000", 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5424e-05 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987465+0000", 2024-09-10T15:26:27.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6360000000000006e-06 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994716+0000", 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072511140000000003 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.994765+0000", 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9576000000000001e-05 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996416+0000", 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016509210000000001 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.996513+0000", 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6916000000000005e-05 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:117 1.0 e16/15 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'79, mlcod=16'65)", 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:27.694 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.645505370999999, 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011100295, 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987779+0000", 2024-09-10T15:26:27.695 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987780+0000", 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.026e-06 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987788+0000", 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5270000000000001e-06 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987802+0000", 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.377e-05 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.987809+0000", 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7570000000000004e-06 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995780+0000", 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079709749999999999 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.995815+0000", 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4183000000000001e-05 2024-09-10T15:26:27.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998786+0000", 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029716640000000002 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.701 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:00.998880+0000", 2024-09-10T15:26:27.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3393000000000005e-05 2024-09-10T15:26:27.701 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.701 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4198.0:120 1.0 e16/15 1:30306672:devicehealth::main.db.0000000000000000:head v 16'82, mlcod=16'78)", 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 86.632207730000005, 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0060483389999999998, 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.702 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001077+0000", 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001079+0000", 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001139+0000", 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0016000000000003e-05 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001163+0000", 2024-09-10T15:26:27.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4097e-05 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001176+0000", 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.27e-05 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001838+0000", 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066228499999999998 2024-09-10T15:26:27.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.001869+0000", 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0892000000000002e-05 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007045+0000", 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051759029999999999 2024-09-10T15:26:27.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:01.007125+0000", 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0532999999999996e-05 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1176 3.28 e62/23 3:15488b12:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_3:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.021213+0000", 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.61207133300000005, 2024-09-10T15:26:27.707 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013209352000000001, 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.021213+0000", 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.021213+0000", 2024-09-10T15:26:27.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.021214+0000", 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.73e-07 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.026877+0000", 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0056638590000000003 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.026893+0000", 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5573000000000002e-05 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.026903+0000", 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.533e-06 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.026971+0000", 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8509000000000004e-05 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.026988+0000", 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6721000000000001e-05 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.034345+0000", 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073569550000000001 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.034423+0000", 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8028999999999994e-05 2024-09-10T15:26:27.711 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1179 3.4 e62/23 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.55041746800000002, 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016361245999999999, 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.712 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.713 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082868+0000", 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7300000000000005e-07 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085770+0000", 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002901945 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085822+0000", 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2089000000000002e-05 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085841+0000", 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9119000000000001e-05 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086000+0000", 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015898999999999999 2024-09-10T15:26:27.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086040+0000", 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9972000000000003e-05 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099137+0000", 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013096813000000001 2024-09-10T15:26:27.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099228+0000", 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1545000000000005e-05 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1180 3.10 e62/23 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:27.717 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.53655455299999999, 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018493124, 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096733+0000", 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7499999999999999e-06 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103771+0000", 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070384489999999996 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103806+0000", 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4798999999999997e-05 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103832+0000", 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6013e-05 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103956+0000", 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124194 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103998+0000", 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1841999999999997e-05 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115130+0000", 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011132246 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115223+0000", 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2831000000000006e-05 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.722 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.39753514299999998, 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:27.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1192 3.38 3:1fd275ab:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.28149864600000002, 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01700991, 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1192 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351789+0000", 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.531e-06 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355811+0000", 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040222690000000002 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355839+0000", 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.864e-05 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355851+0000", 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1776e-05 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355926+0000", 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.4318000000000002e-05 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356068+0000", 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260999999999999 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356198+0000", 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012937800000000001 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.364011+0000", 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078136939999999995 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368681+0000", 2024-09-10T15:26:27.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046692440000000003 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368733+0000", 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2085e-05 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368796+0000", 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3365000000000001e-05 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1195 3.3d 3:bc04a9f1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.21047706499999999, 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016842467999999999, 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1195 2024-09-10T15:26:27.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:27.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422810+0000", 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1500000000000002e-06 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426623+0000", 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038136469999999999 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426651+0000", 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7543e-05 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426662+0000", 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0937999999999999e-05 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426734+0000", 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2465000000000005e-05 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426849+0000", 2024-09-10T15:26:27.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011429099999999999 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426960+0000", 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111266 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.437403+0000", 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010442811 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:27.739 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439351+0000", 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019481609999999999 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439523+0000", 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000172549 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439650+0000", 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126647 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.740 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.741 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.741 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:27.741 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:27.741 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:27.742 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:27.742 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:27.742 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0801402 s, 1.3 GB/s 2024-09-10T15:26:27.743 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:27.743 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:27.742+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:27.843 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:27.842+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:27.870 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:27.870 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:27.870 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:27.870 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:27.884 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:27.943 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:27.939+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:28.008 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:28.009 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:28.009 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:28.009 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:28.009 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:28.028 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:28.069 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:28.067+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:28.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:26:28.170 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:28.170+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:28.207 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:28.207 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 72.363086261000007, 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:26:28.208 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:26:28.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:26:28.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:46 7.1f e32/31 7:f95f44c2:::notify.0:head v 32'1, mlcod=0'0)", 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 68.307944578000004, 2024-09-10T15:26:28.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032891270000000002, 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894907+0000", 2024-09-10T15:26:28.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894908+0000", 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3099999999999997e-07 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894927+0000", 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9320000000000001e-05 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894953+0000", 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6305e-05 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.894974+0000", 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0315000000000001e-05 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895666+0000", 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00069212899999999999 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.895705+0000", 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511000000000002e-05 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898094+0000", 2024-09-10T15:26:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023885450000000002 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:19.898196+0000", 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102271 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.219 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.294007906000004, 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067331149999999996, 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.220 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 212 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908844+0000", 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908847+0000", 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908860+0000", 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.323e-05 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908886+0000", 2024-09-10T15:26:28.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6553000000000001e-05 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.908902+0000", 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5437000000000001e-05 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909091+0000", 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018897799999999999 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.909108+0000", 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7603000000000001e-05 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.911974+0000", 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002865098 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912318+0000", 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034433499999999998 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.912981+0000", 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066294100000000001 2024-09-10T15:26:28.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.914409+0000", 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014279259999999999 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915383+0000", 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00097384900000000005 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915475+0000", 2024-09-10T15:26:28.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2439e-05 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.915577+0000", 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101876 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.209434497999993, 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035617890000000001, 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.229 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 233 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993417+0000", 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993420+0000", 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3199999999999998e-06 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993431+0000", 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.151e-05 2024-09-10T15:26:28.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993463+0000", 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1662999999999998e-05 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993477+0000", 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.47e-05 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993627+0000", 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014946499999999999 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.993999+0000", 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00037189100000000001 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.994779+0000", 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077995400000000002 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996617+0000", 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001838519 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996817+0000", 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000199655 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996908+0000", 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1232999999999999e-05 2024-09-10T15:26:28.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.996979+0000", 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0878999999999997e-05 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:380 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.147223589000006, 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046206290000000002, 2024-09-10T15:26:28.235 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 380 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055628+0000", 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055631+0000", 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2540000000000001e-06 2024-09-10T15:26:28.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055643+0000", 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1875999999999999e-05 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055674+0000", 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0623000000000001e-05 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055689+0000", 2024-09-10T15:26:28.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5339999999999999e-05 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055853+0000", 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000163523 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056161+0000", 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030789700000000001 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.056575+0000", 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041402000000000002 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.058087+0000", 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0015127649999999999 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060135+0000", 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020474849999999999 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060199+0000", 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4264999999999995e-05 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.060249+0000", 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9580999999999998e-05 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:398 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.141662767, 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005050527, 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 398 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.242 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061189+0000", 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061191+0000", 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5880000000000001e-06 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061199+0000", 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7269999999999996e-06 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061219+0000", 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9743000000000001e-05 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061230+0000", 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1124999999999999e-05 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061335+0000", 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104786 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061525+0000", 2024-09-10T15:26:28.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000190361 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062771+0000", 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001245538 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.064149+0000", 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013781380000000001 2024-09-10T15:26:28.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066121+0000", 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001971914 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066188+0000", 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6895000000000002e-05 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.066239+0000", 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1712000000000002e-05 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.024141078, 2024-09-10T15:26:28.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048961990000000004, 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 607 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:26:28.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178711+0000", 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178712+0000", 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.443e-06 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178720+0000", 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1049999999999995e-06 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178740+0000", 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9558000000000001e-05 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178751+0000", 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0886e-05 2024-09-10T15:26:28.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178837+0000", 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5889000000000004e-05 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.178957+0000", 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000120044 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.179175+0000", 2024-09-10T15:26:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021854200000000001 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.180055+0000", 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00088007899999999997 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183495+0000", 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034399489999999999 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183560+0000", 2024-09-10T15:26:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4669e-05 2024-09-10T15:26:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.183607+0000", 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7034999999999999e-05 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.255 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:668 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.981379431999997, 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050043780000000003, 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 668 2024-09-10T15:26:28.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221472+0000", 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221474+0000", 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9130000000000001e-06 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221483+0000", 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9500000000000007e-06 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221509+0000", 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5627e-05 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221523+0000", 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4656e-05 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221632+0000", 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108305 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.221843+0000", 2024-09-10T15:26:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021159600000000001 2024-09-10T15:26:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.222095+0000", 2024-09-10T15:26:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025175000000000002 2024-09-10T15:26:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.223008+0000", 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091253799999999996 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226321+0000", 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033133839999999999 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226414+0000", 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2669000000000003e-05 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.226477+0000", 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2990000000000005e-05 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:675 6.1 6:84d19476:::obj_delete_at_hint.0000000038:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.975166380000005, 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00398336, 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 675 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.264 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227685+0000", 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227687+0000", 2024-09-10T15:26:28.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.057e-06 2024-09-10T15:26:28.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227699+0000", 2024-09-10T15:26:28.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.199e-05 2024-09-10T15:26:28.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227731+0000", 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1628999999999998e-05 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227748+0000", 2024-09-10T15:26:28.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7274000000000001e-05 2024-09-10T15:26:28.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.269 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.269 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.227932+0000", 2024-09-10T15:26:28.269 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018350500000000001 2024-09-10T15:26:28.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228079+0000", 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000146849 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.228347+0000", 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026789799999999998 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.229446+0000", 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001099308 2024-09-10T15:26:28.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.272 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.272 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231522+0000", 2024-09-10T15:26:28.272 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020760840000000002 2024-09-10T15:26:28.272 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.273 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.273 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.273 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231611+0000", 2024-09-10T15:26:28.273 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9118999999999998e-05 2024-09-10T15:26:28.273 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.274 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.274 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.231669+0000", 2024-09-10T15:26:28.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7646999999999999e-05 2024-09-10T15:26:28.274 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.274 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.275 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.275 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.275 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:798 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.275 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:26:28.276 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.759911467999999, 2024-09-10T15:26:28.276 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051962070000000004, 2024-09-10T15:26:28.276 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.276 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.276 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.276 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.277 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.277 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.277 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 798 2024-09-10T15:26:28.277 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.277 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.278 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.278 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:26:28.278 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.278 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.279 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442940+0000", 2024-09-10T15:26:28.279 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442942+0000", 2024-09-10T15:26:28.280 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0370000000000001e-06 2024-09-10T15:26:28.280 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.280 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.280 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442953+0000", 2024-09-10T15:26:28.281 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0696000000000001e-05 2024-09-10T15:26:28.281 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.281 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.281 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.281 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.442985+0000", 2024-09-10T15:26:28.281 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1853999999999997e-05 2024-09-10T15:26:28.282 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.282 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.282 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.282 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443000+0000", 2024-09-10T15:26:28.282 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4732999999999999e-05 2024-09-10T15:26:28.283 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.283 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.283 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.283 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443139+0000", 2024-09-10T15:26:28.283 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013904499999999999 2024-09-10T15:26:28.283 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.284 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.284 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.284 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443393+0000", 2024-09-10T15:26:28.284 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025468499999999999 2024-09-10T15:26:28.284 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.443859+0000", 2024-09-10T15:26:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00046606600000000001 2024-09-10T15:26:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.286 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.286 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.286 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.445087+0000", 2024-09-10T15:26:28.286 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001227681 2024-09-10T15:26:28.286 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.286 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.287 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.287 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.447858+0000", 2024-09-10T15:26:28.287 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0027710220000000002 2024-09-10T15:26:28.287 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.287 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.288 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.288 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448017+0000", 2024-09-10T15:26:28.288 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000158789 2024-09-10T15:26:28.288 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.288 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.288 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.289 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.448136+0000", 2024-09-10T15:26:28.289 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000119599 2024-09-10T15:26:28.289 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.289 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.289 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.290 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.290 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.290 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.290 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:26:28.290 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.582831901000006, 2024-09-10T15:26:28.290 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003610715, 2024-09-10T15:26:28.291 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.291 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.291 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.291 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.291 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.292 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.292 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 871 2024-09-10T15:26:28.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.292 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:26:28.293 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.294 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620020+0000", 2024-09-10T15:26:28.294 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.294 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.294 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.294 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.294 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620022+0000", 2024-09-10T15:26:28.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.153e-06 2024-09-10T15:26:28.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.295 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.295 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.295 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620033+0000", 2024-09-10T15:26:28.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0983e-05 2024-09-10T15:26:28.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620062+0000", 2024-09-10T15:26:28.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9467000000000001e-05 2024-09-10T15:26:28.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620079+0000", 2024-09-10T15:26:28.297 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6226e-05 2024-09-10T15:26:28.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.298 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.298 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620231+0000", 2024-09-10T15:26:28.298 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152659 2024-09-10T15:26:28.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.299 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.299 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.299 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.620596+0000", 2024-09-10T15:26:28.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036434400000000001 2024-09-10T15:26:28.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.300 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.300 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.621141+0000", 2024-09-10T15:26:28.300 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054557900000000003 2024-09-10T15:26:28.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.622459+0000", 2024-09-10T15:26:28.301 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013181930000000001 2024-09-10T15:26:28.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.302 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623372+0000", 2024-09-10T15:26:28.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091299999999999997 2024-09-10T15:26:28.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.303 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623521+0000", 2024-09-10T15:26:28.303 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014889800000000001 2024-09-10T15:26:28.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.303 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.303 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.623631+0000", 2024-09-10T15:26:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109213 2024-09-10T15:26:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.305 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:886 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.305 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:26:28.305 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.548979156000001, 2024-09-10T15:26:28.305 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003669692, 2024-09-10T15:26:28.305 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 886 2024-09-10T15:26:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:26:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.308 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.308 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653873+0000", 2024-09-10T15:26:28.308 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653875+0000", 2024-09-10T15:26:28.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.34e-06 2024-09-10T15:26:28.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.310 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653889+0000", 2024-09-10T15:26:28.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4127e-05 2024-09-10T15:26:28.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.311 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.311 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653920+0000", 2024-09-10T15:26:28.311 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0786e-05 2024-09-10T15:26:28.311 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.311 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.312 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.653935+0000", 2024-09-10T15:26:28.312 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4846e-05 2024-09-10T15:26:28.312 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.312 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.313 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654051+0000", 2024-09-10T15:26:28.313 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011603999999999999 2024-09-10T15:26:28.313 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.313 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.313 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.313 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654270+0000", 2024-09-10T15:26:28.314 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021907099999999999 2024-09-10T15:26:28.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.314 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.654582+0000", 2024-09-10T15:26:28.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00031208800000000002 2024-09-10T15:26:28.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.315 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.655676+0000", 2024-09-10T15:26:28.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0010938650000000001 2024-09-10T15:26:28.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.316 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.316 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657273+0000", 2024-09-10T15:26:28.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001597654 2024-09-10T15:26:28.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.317 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.317 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.317 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657427+0000", 2024-09-10T15:26:28.317 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015405900000000001 2024-09-10T15:26:28.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.318 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.318 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.318 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.657542+0000", 2024-09-10T15:26:28.318 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011481600000000001 2024-09-10T15:26:28.318 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.318 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.319 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.319 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.319 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.319 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.319 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:26:28.319 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 64.440914122999999, 2024-09-10T15:26:28.320 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048721060000000002, 2024-09-10T15:26:28.320 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.320 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.320 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.320 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.320 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.321 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.321 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 933 2024-09-10T15:26:28.321 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.321 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.321 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.321 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.322 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:26:28.322 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.322 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.322 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.322 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.322 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761938+0000", 2024-09-10T15:26:28.323 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.323 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.323 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.323 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.323 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761940+0000", 2024-09-10T15:26:28.323 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0999999999999998e-06 2024-09-10T15:26:28.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.324 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761950+0000", 2024-09-10T15:26:28.324 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0733e-05 2024-09-10T15:26:28.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.325 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761982+0000", 2024-09-10T15:26:28.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1826999999999999e-05 2024-09-10T15:26:28.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.326 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.761997+0000", 2024-09-10T15:26:28.326 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5228999999999999e-05 2024-09-10T15:26:28.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.326 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762140+0000", 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014274900000000001 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762269+0000", 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000128529 2024-09-10T15:26:28.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.762518+0000", 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000249335 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.328 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.763664+0000", 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011457679999999999 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766649+0000", 2024-09-10T15:26:28.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029852699999999999 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766742+0000", 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2373000000000005e-05 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.766810+0000", 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8193000000000003e-05 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.1266072279999999, 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:28.331 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.332 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.332 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.332 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.332 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.332 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.332 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:28.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.333 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.333 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.333 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:28.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.334 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.334 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.334 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:28.334 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.335 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.335 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:28.335 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:28.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:28.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:28.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:28.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:28.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.341 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:28.341 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:28.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1188 3.25 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.94547757700000001, 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019443585999999999, 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.343 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1188 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.344 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257377+0000", 2024-09-10T15:26:28.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8700000000000001e-06 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261294+0000", 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039172979999999996 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261328+0000", 2024-09-10T15:26:28.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3353999999999999e-05 2024-09-10T15:26:28.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261342+0000", 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4174e-05 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261424+0000", 2024-09-10T15:26:28.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2427000000000002e-05 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261555+0000", 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000130908 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261671+0000", 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115624 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.268433+0000", 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067620909999999996 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276721+0000", 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082879170000000005 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276771+0000", 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0328000000000003e-05 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276818+0000", 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6594999999999997e-05 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.354 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.87547592200000002, 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.355 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:28.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:28.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.361 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1193 3.15 e62/23 3:a820acfb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_20:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.82432188900000003, 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014435465, 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378532+0000", 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6980000000000001e-06 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383652+0000", 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051201090000000003 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383673+0000", 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1319e-05 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383684+0000", 2024-09-10T15:26:28.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0899e-05 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383770+0000", 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6142000000000003e-05 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383802+0000", 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2295000000000002e-05 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392895+0000", 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090925280000000008 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392965+0000", 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0475000000000005e-05 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1202 3.b e62/23 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:28.366 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.948894+0000", 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.25395747499999999, 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011485423, 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948894+0000", 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948894+0000", 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948897+0000", 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.548e-06 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.950779+0000", 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0018819900000000001 2024-09-10T15:26:28.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.950817+0000", 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8287999999999997e-05 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.950834+0000", 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6736e-05 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.950917+0000", 2024-09-10T15:26:28.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.3552000000000002e-05 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.950939+0000", 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2011999999999999e-05 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960329+0000", 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093892290000000007 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960380+0000", 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1068e-05 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.16690232099999999, 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.371 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:28.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:28.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.14763278199999999, 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.377 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:28.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:28.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.383 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:28.384 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.4 2024-09-10T15:26:28.384 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:28.384 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 5 2024-09-10T15:26:28.385 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:28.386 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:28.382+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:28.413 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:28.413 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:28.413 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0752671 s, 1.4 GB/s 2024-09-10T15:26:28.486 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:28.486+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:28.514 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:28.514 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:28.514 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:28.514 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:28.528 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:28.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:28.598 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:28.598+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:28.645 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:28.646 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:28.646 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:28.646 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:28.646 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:28.660 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:28.705 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:28.703+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:28.717 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:28.717 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:28.734 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:28.734 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:28.761 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:28.761 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:28.781 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:28.781 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:28.793 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:28.794+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:28.807 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:28.807 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:28.811 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:28.811 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:28.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:28.811 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:28.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.811 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.911002183999997, 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003695229, 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 208 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.812 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892422+0000", 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892426+0000", 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2030000000000002e-06 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892445+0000", 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8284e-05 2024-09-10T15:26:28.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892489+0000", 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3955999999999997e-05 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892519+0000", 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0108999999999999e-05 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892691+0000", 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017201599999999999 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.892998+0000", 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030683400000000002 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.893664+0000", 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00066628100000000001 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895375+0000", 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017113969999999999 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.895964+0000", 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00058865999999999996 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896051+0000", 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7515000000000005e-05 2024-09-10T15:26:28.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.896117+0000", 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5974000000000002e-05 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.870640576, 2024-09-10T15:26:28.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003242516, 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 216 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:26:28.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932784+0000", 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932787+0000", 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.807e-06 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932799+0000", 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2785999999999999e-05 2024-09-10T15:26:28.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932831+0000", 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1350000000000003e-05 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.932846+0000", 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5696999999999999e-05 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933030+0000", 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018387500000000001 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933261+0000", 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230442 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.933673+0000", 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041251299999999999 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935414+0000", 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0017412930000000001 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935865+0000", 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000450941 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.935952+0000", 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6971999999999993e-05 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.936026+0000", 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3839999999999998e-05 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.825 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.842125225999993, 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032517259999999999, 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.826 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 224 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961299+0000", 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961301+0000", 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2699999999999999e-06 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961314+0000", 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2830000000000001e-05 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961344+0000", 2024-09-10T15:26:28.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0307e-05 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961393+0000", 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8668999999999998e-05 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961519+0000", 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012537599999999999 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.961726+0000", 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020736800000000001 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.962170+0000", 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044366400000000003 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.963687+0000", 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001517731 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964402+0000", 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00071518899999999997 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964490+0000", 2024-09-10T15:26:28.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7134999999999998e-05 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:22.964551+0000", 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1186999999999995e-05 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:368 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:26:28.832 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.752107870000003, 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041994140000000003, 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 368 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:26:28.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051316+0000", 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051318+0000", 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4330000000000001e-06 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051326+0000", 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4270000000000008e-06 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051342+0000", 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5569999999999998e-05 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051356+0000", 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4402e-05 2024-09-10T15:26:28.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.051765+0000", 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040867799999999999 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052006+0000", 2024-09-10T15:26:28.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240678 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.052449+0000", 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044326000000000001 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.053565+0000", 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001116384 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055273+0000", 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00170733 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055412+0000", 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000139393 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.055516+0000", 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103859 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.838 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:401 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.741711980999995, 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004220583, 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.839 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 401 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061712+0000", 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061715+0000", 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7269999999999999e-06 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061732+0000", 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6696000000000001e-05 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061764+0000", 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2184000000000002e-05 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061786+0000", 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1676e-05 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.061935+0000", 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014901500000000001 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062062+0000", 2024-09-10T15:26:28.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000127317 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.062269+0000", 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000206744 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.063459+0000", 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001190226 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065746+0000", 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022868900000000002 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065870+0000", 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124129 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.065933+0000", 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2978999999999995e-05 2024-09-10T15:26:28.845 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:587 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.639962643000004, 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042266669999999999, 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.846 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 587 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163462+0000", 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163464+0000", 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2970000000000002e-06 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163475+0000", 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1070000000000001e-05 2024-09-10T15:26:28.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163503+0000", 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8062999999999999e-05 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163518+0000", 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4627000000000001e-05 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163646+0000", 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012872099999999999 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.163827+0000", 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018048399999999999 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.164224+0000", 2024-09-10T15:26:28.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039711999999999999 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.165380+0000", 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0011557990000000001 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167476+0000", 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020961119999999998 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167595+0000", 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118585 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.167688+0000", 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.3789000000000006e-05 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 65.340389321000004, 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00345248, 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 805 2024-09-10T15:26:28.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463035+0000", 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463037+0000", 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463049+0000", 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1620000000000001e-05 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463079+0000", 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9876e-05 2024-09-10T15:26:28.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463094+0000", 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4766999999999999e-05 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463256+0000", 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016214499999999999 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.463625+0000", 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00036956700000000001 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.464163+0000", 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00053810299999999995 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.465401+0000", 2024-09-10T15:26:28.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0012375940000000001 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466225+0000", 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000824277 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466379+0000", 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000154172 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.466487+0000", 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108006 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1188 3.25 e62/23 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.261907+0000", 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.5415168970000002, 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014529301, 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.859 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261907+0000", 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261907+0000", 2024-09-10T15:26:28.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261912+0000", 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4000000000000002e-06 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.267032+0000", 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051199410000000002 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.267072+0000", 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0419e-05 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.267090+0000", 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7929999999999999e-05 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.267182+0000", 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2145999999999995e-05 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.267209+0000", 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6832e-05 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276385+0000", 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091764220000000001 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276437+0000", 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1211000000000001e-05 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.86055789000000005, 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:28.864 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:28.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:28.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1205 3.23 e62/23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.78773976899999998, 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014669375, 2024-09-10T15:26:28.870 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015688+0000", 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.993e-06 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017637+0000", 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019491269999999999 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017679+0000", 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2738999999999999e-05 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017706+0000", 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6395999999999999e-05 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017927+0000", 2024-09-10T15:26:28.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221241 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017968+0000", 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1213e-05 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030244+0000", 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012276001999999999 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030354+0000", 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109664 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1206 3.c e62/23 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.77575150999999998, 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015827707999999999, 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.875 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027675+0000", 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035053+0000", 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073779279999999997 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035089+0000", 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5979000000000002e-05 2024-09-10T15:26:28.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035105+0000", 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6290000000000002e-05 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035198+0000", 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2367000000000005e-05 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035217+0000", 2024-09-10T15:26:28.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9066e-05 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043398+0000", 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081812329999999996 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043501+0000", 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010237499999999999 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1207 3.25 e62/23 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.762356378, 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014971961000000001, 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041070+0000", 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043463+0000", 2024-09-10T15:26:28.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023929699999999999 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043496+0000", 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3506000000000001e-05 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043518+0000", 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1806000000000001e-05 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043666+0000", 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000147913 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043705+0000", 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9199000000000002e-05 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055912+0000", 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012207310000000001 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056040+0000", 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012743699999999999 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.884 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.68028428799999996, 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:28.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:28.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.65446049299999998, 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.891 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:28.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:28.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:28.897 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.54507724099999999, 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:28.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1225 3.8 e62/23 3:12daa5c3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_24:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.295613+0000", 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.507811232, 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014544065, 2024-09-10T15:26:28.902 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295613+0000", 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295613+0000", 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295615+0000", 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0279999999999999e-06 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298554+0000", 2024-09-10T15:26:28.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029391349999999998 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298603+0000", 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9122999999999997e-05 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298631+0000", 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7566e-05 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298749+0000", 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118557 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298776+0000", 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6587000000000001e-05 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310049+0000", 2024-09-10T15:26:28.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011273025000000001 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310157+0000", 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108044 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:28.907 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.48915824800000002, 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:28.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:28.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1231 3.0 e62/23 3:016afb57:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_2:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.669959+0000", 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.13346572400000001, 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011227406000000001, 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.914 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669959+0000", 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669959+0000", 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669960+0000", 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.883e-06 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.671602+0000", 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016419799999999999 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.671627+0000", 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4148e-05 2024-09-10T15:26:28.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.671638+0000", 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1260000000000001e-05 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.671740+0000", 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102277 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.671773+0000", 2024-09-10T15:26:28.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2511000000000001e-05 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681114+0000", 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093412589999999993 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681186+0000", 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2088000000000005e-05 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.918 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1237 3.b 3:d20aacec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.078125473000000001, 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017229367999999998, 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.919 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1237 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:28.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725302+0000", 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2480000000000001e-06 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729641+0000", 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043387460000000001 2024-09-10T15:26:28.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729670+0000", 2024-09-10T15:26:28.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.955e-05 2024-09-10T15:26:28.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729684+0000", 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3172e-05 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729774+0000", 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0729999999999994e-05 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729975+0000", 2024-09-10T15:26:28.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000200504 2024-09-10T15:26:28.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:28.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730111+0000", 2024-09-10T15:26:28.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013626099999999999 2024-09-10T15:26:28.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.740994+0000", 2024-09-10T15:26:28.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010883163 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742446+0000", 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014518560000000001 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742485+0000", 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742528+0000", 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2873000000000001e-05 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1240 3.2e 3:74a4e6e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:28.927 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.046635374, 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016415019999999999, 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1240 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:28.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756792+0000", 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7630000000000001e-06 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760797+0000", 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004004896 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760840+0000", 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3618999999999997e-05 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:28.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760859+0000", 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9032e-05 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760952+0000", 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2856999999999995e-05 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761077+0000", 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125327 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761176+0000", 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8424999999999994e-05 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767159+0000", 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059834450000000004 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773081+0000", 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059217380000000002 2024-09-10T15:26:28.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773150+0000", 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.9305000000000001e-05 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773204+0000", 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3613000000000003e-05 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:28.933 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:28.934 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:28.934 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:28.935 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:28.935 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:28.936 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:28.936 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:28.937 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:28.937 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:28.938 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:28.934+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:28.981 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.5 2024-09-10T15:26:28.981 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:28.981 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 6 2024-09-10T15:26:29.035 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:29.034+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:29.056 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:29.057 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:29.057 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0737877 s, 1.4 GB/s 2024-09-10T15:26:29.099 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:29.099 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:29.114 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:29.122 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:26:29.146 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:29.146+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:29.237 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:29.234+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:29.238 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:29.238 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:29.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:29.342 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:29.342+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:29.439 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:29.435+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:29.448 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:29.449 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:29.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:29.540 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:29.535+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:29.637 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:29.637 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:29.640 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:29.638+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:29.647 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.6 2024-09-10T15:26:29.647 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:29.647 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 7 2024-09-10T15:26:29.650 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:29.724 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:29.724 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:29.725 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0743096 s, 1.4 GB/s 2024-09-10T15:26:29.741 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:29.739+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:29.823 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:29.824 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:29.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:29.842 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:29.839+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:29.945 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:29.942+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:30.038 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:30.038 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:30.046 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:30.043+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:30.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:30.148 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:30.146+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:30.248 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:30.246+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:30.248 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:30.248 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:30.274 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:30.346 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.7 2024-09-10T15:26:30.346 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:30.347 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 8 2024-09-10T15:26:30.349 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:30.347+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:30.422 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:30.422 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:30.422 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0735857 s, 1.4 GB/s 2024-09-10T15:26:30.443 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:30.444 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:30.450 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:30.450+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:30.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:30.551 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:30.550+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:30.635 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:30.635 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:30.652 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:30.650+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:30.655 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:30.753 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:30.751+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:30.854 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:30.851+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:30.855 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:30.855 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:30.883 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:30.939 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:30.986 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:30.986+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:30.987 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.8 2024-09-10T15:26:30.987 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:30.987 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 9 2024-09-10T15:26:31.013 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:31.013 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:31.031 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:31.058 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:31.058 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:31.058 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0698108 s, 1.5 GB/s 2024-09-10T15:26:31.059 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:31.058+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:31.077 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:31.077 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:31.108 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:31.108 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:31.128 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:31.129 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:31.145 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:31.145 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:31.146 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:26:31.165 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:31.166 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:31.166 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:31.166+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:31.183 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:31.183 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:31.183 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:31.183 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.659447412000006, 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.184 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.185 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.186 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:31.187 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.188 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.189 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:31.190 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 87.444055933000001, 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.191 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:26:31.192 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.193 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.194 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 86.653074648, 2024-09-10T15:26:31.195 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058881640000000004, 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 5 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.196 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529471+0000", 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529474+0000", 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529491+0000", 2024-09-10T15:26:31.197 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7430000000000001e-05 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529527+0000", 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5556000000000003e-05 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529545+0000", 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7887e-05 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.198 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529690+0000", 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144843 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.529698+0000", 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8170000000000005e-06 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532423+0000", 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027240910000000001 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.199 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532667+0000", 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024447800000000001 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.532864+0000", 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000197235 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.534352+0000", 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014881149999999999 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.200 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535213+0000", 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00086107000000000002 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535296+0000", 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2108999999999996e-05 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.535359+0000", 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3252999999999999e-05 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.201 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 85.644615518999998, 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080623340000000009, 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.202 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 7 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.203 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537930+0000", 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537934+0000", 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0029999999999996e-06 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537950+0000", 2024-09-10T15:26:31.204 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6560000000000001e-05 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.537988+0000", 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7880000000000003e-05 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538017+0000", 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8702999999999999e-05 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.205 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538167+0000", 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015022899999999999 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.538178+0000", 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0967e-05 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542110+0000", 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039315590000000003 2024-09-10T15:26:31.206 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542336+0000", 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022671799999999999 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.542710+0000", 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037352700000000002 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.544726+0000", 2024-09-10T15:26:31.207 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020165220000000002 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545849+0000", 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001122741 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545930+0000", 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.1289e-05 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:05.545992+0000", 2024-09-10T15:26:31.208 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1636000000000004e-05 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 73.336082027000003, 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014486644, 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.209 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 43 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846463+0000", 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.210 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846466+0000", 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0299999999999998e-06 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846481+0000", 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5063e-05 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.211 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846555+0000", 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3279000000000001e-05 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846595+0000", 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9861999999999999e-05 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846728+0000", 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013320699999999999 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.212 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.846740+0000", 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1973e-05 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848731+0000", 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019911550000000001 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:31.213 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.848748+0000", 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6823000000000001e-05 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860766+0000", 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01201786 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:17.860950+0000", 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018439199999999999 2024-09-10T15:26:31.214 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:50 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 71.280013225999994, 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0050038369999999997, 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.215 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 50 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902532+0000", 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.216 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902535+0000", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2459999999999999e-06 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902549+0000", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3317e-05 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902587+0000", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8007999999999999e-05 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.217 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902606+0000", 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9633999999999999e-05 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902744+0000", 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013739199999999999 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.902922+0000", 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017810699999999999 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.218 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.903142+0000", 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022023600000000001 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.904227+0000", 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00108472 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907413+0000", 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031863120000000002 2024-09-10T15:26:31.219 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907482+0000", 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8753999999999999e-05 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.907536+0000", 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.4110999999999997e-05 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.220 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:214 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 68.262954278999999, 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091788189999999995, 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 214 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.221 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919591+0000", 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919594+0000", 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3230000000000002e-06 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.222 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919611+0000", 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.681e-05 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919647+0000", 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5463000000000002e-05 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919664+0000", 2024-09-10T15:26:31.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6996000000000001e-05 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919788+0000", 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012421900000000001 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.919798+0000", 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8500000000000006e-06 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925512+0000", 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0057146030000000004 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.925713+0000", 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020023099999999999 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.926133+0000", 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042036999999999999 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.927739+0000", 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001605942 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928595+0000", 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00085572899999999995 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928685+0000", 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0210000000000005e-05 2024-09-10T15:26:31.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:22.928770+0000", 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5073000000000004e-05 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1175 3.30 3:0f1b3996:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.001648+0000", 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.1808976610000004, 2024-09-10T15:26:31.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028348508000000001, 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1175 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.001648+0000", 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.001648+0000", 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.001652+0000", 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006499+0000", 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048467199999999997 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006539+0000", 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0745999999999999e-05 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006559+0000", 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9076000000000002e-05 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006692+0000", 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133857 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006945+0000", 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025226099999999999 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007213+0000", 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000268044 2024-09-10T15:26:31.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029424+0000", 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.02221163 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029927+0000", 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050258200000000001 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029964+0000", 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6730999999999998e-05 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029996+0000", 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2524999999999998e-05 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1176 3.28 3:15488b12:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.013041+0000", 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.1695043500000004, 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022431941, 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.233 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1176 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.013041+0000", 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.013041+0000", 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.013045+0000", 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6430000000000001e-06 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016675+0000", 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036305909999999999 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016725+0000", 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9521999999999998e-05 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016759+0000", 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4029000000000002e-05 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016920+0000", 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161707 2024-09-10T15:26:31.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.017312+0000", 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039121799999999998 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.017757+0000", 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044546599999999999 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.032984+0000", 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015227021 2024-09-10T15:26:31.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.035417+0000", 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024327480000000002 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.035448+0000", 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1188e-05 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.035473+0000", 2024-09-10T15:26:31.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4808e-05 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1185 3.2f 3:f6cc2071:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.191149+0000", 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.9913962769999998, 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018373825999999999, 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.239 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1185 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.191149+0000", 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.191149+0000", 2024-09-10T15:26:31.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.191153+0000", 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4769999999999999e-06 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194534+0000", 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033818429999999998 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194570+0000", 2024-09-10T15:26:31.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5422000000000001e-05 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194587+0000", 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.677e-05 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194735+0000", 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014863699999999999 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.195025+0000", 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028954700000000002 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.195329+0000", 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030440600000000001 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.208219+0000", 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012889469000000001 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.209433+0000", 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001213911 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.209479+0000", 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6315e-05 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.209523+0000", 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4029000000000001e-05 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1196 3.d 3:b022ad54:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.446181+0000", 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.7363641369999998, 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019953740000000001, 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1196 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.245 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.446181+0000", 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.446181+0000", 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.446187+0000", 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449586+0000", 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033995689999999999 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449648+0000", 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1376000000000003e-05 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449668+0000", 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449813+0000", 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014528100000000001 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.450137+0000", 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032372199999999997 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.450372+0000", 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023495499999999999 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.465383+0000", 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015010862 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.465963+0000", 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058020299999999995 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.466059+0000", 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5607999999999997e-05 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.466135+0000", 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6192000000000005e-05 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.250 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1197 3.11 3:89914701:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.513564+0000", 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.6689812910000001, 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019861805, 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1197 2024-09-10T15:26:31.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.513564+0000", 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.513564+0000", 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.513567+0000", 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8229999999999999e-06 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516243+0000", 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002676079 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516287+0000", 2024-09-10T15:26:31.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3835999999999998e-05 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516306+0000", 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9675999999999999e-05 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516484+0000", 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017797900000000001 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516740+0000", 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025542099999999998 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516986+0000", 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000246085 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533136+0000", 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016150235999999998 2024-09-10T15:26:31.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533259+0000", 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012310399999999999 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533353+0000", 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3548000000000006e-05 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533426+0000", 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3017999999999998e-05 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1204 3.37 e62/23 3:ec79df02:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_3:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.991284+0000", 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.1912614480000001, 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018272098000000001, 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.257 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.991284+0000", 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.991284+0000", 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.991287+0000", 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1769999999999998e-06 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.993590+0000", 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0023034040000000002 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.993641+0000", 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0896000000000002e-05 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.993675+0000", 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3466000000000001e-05 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.993839+0000", 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016458299999999999 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.993895+0000", 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5655000000000002e-05 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009416+0000", 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015521233000000001 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009556+0000", 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000139684 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.261 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1214 3.d 3:b0e9e7a3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.162572+0000", 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 3.0199736490000002, 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015656764, 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.262 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1214 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.162572+0000", 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.162572+0000", 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.162575+0000", 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.056e-06 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.164736+0000", 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021608650000000001 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.164771+0000", 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5895000000000001e-05 2024-09-10T15:26:31.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.164787+0000", 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6007000000000001e-05 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.164873+0000", 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5840000000000005e-05 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.164991+0000", 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117218 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.165144+0000", 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000153745 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.175604+0000", 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010459461999999999 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.178125+0000", 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025214899999999999 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.178168+0000", 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2809999999999998e-05 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.178228+0000", 2024-09-10T15:26:31.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0375999999999999e-05 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1216 3.17 e62/23 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.191161+0000", 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.991384515, 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012799748, 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.268 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.191161+0000", 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.191161+0000", 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.191162+0000", 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.694e-06 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.196758+0000", 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0055951430000000003 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.196798+0000", 2024-09-10T15:26:31.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9873000000000003e-05 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.196816+0000", 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8675999999999999e-05 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.196913+0000", 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7108999999999995e-05 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.196938+0000", 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4922999999999998e-05 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.203907+0000", 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0069691110000000001 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.203961+0000", 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3219e-05 2024-09-10T15:26:31.272 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1217 3.12 e62/23 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.202075+0000", 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.9804700830000002, 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013915093999999999, 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.273 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.202075+0000", 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.202075+0000", 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.202075+0000", 2024-09-10T15:26:31.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6199999999999999e-07 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.206751+0000", 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046756819999999996 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.206777+0000", 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6026000000000001e-05 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.206791+0000", 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4028e-05 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.206860+0000", 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8726999999999994e-05 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.206878+0000", 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7802e-05 2024-09-10T15:26:31.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.215933+0000", 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090555619999999996 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.215990+0000", 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7005000000000001e-05 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1219 3.30 3:0da591de:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.221532+0000", 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.9610137270000001, 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015069971, 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1219 2024-09-10T15:26:31.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.221532+0000", 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.221532+0000", 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.221534+0000", 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8399999999999999e-06 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223140+0000", 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016054019999999999 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223173+0000", 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3537000000000001e-05 2024-09-10T15:26:31.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223186+0000", 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3096e-05 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223302+0000", 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115264 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223493+0000", 2024-09-10T15:26:31.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019175400000000001 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223663+0000", 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016977999999999999 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.235326+0000", 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011663059999999999 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.236475+0000", 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001148296 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.236545+0000", 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0864000000000005e-05 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.236602+0000", 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6078000000000001e-05 2024-09-10T15:26:31.283 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1234 3.35 e62/23 3:af64b682:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_5:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.697676+0000", 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.4848688279999998, 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015781051000000001, 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.697676+0000", 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.697676+0000", 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.697679+0000", 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.419e-06 2024-09-10T15:26:31.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.699948+0000", 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0022695829999999999 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.699977+0000", 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.83e-05 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.699991+0000", 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3767e-05 2024-09-10T15:26:31.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.700078+0000", 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7212000000000005e-05 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.700109+0000", 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1265e-05 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.713398+0000", 2024-09-10T15:26:31.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013288739000000001 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.713458+0000", 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9765999999999997e-05 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1238 3.13 3:c924df1d:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.736020+0000", 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.446525705, 2024-09-10T15:26:31.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015259218, 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1238 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.736020+0000", 2024-09-10T15:26:31.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.736020+0000", 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.736023+0000", 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3210000000000001e-06 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.738354+0000", 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00233117 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.738377+0000", 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2497000000000002e-05 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.738388+0000", 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1304000000000001e-05 2024-09-10T15:26:31.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.738472+0000", 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.3882999999999996e-05 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.738672+0000", 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019973500000000001 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.738847+0000", 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017505 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.750366+0000", 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011519725999999999 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.751154+0000", 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00078814 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.751223+0000", 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8156000000000003e-05 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.751279+0000", 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6236000000000002e-05 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1239 3.11 3:8afda196:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.294 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.746552+0000", 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 2.43599298, 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015404753, 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1239 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.746552+0000", 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.746552+0000", 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.746555+0000", 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.751e-06 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.748308+0000", 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001752939 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.748334+0000", 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6033e-05 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.748348+0000", 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4129e-05 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.748441+0000", 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2323000000000004e-05 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.748663+0000", 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00022261899999999999 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.748847+0000", 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000183788 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.761402+0000", 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012555297999999999 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.761843+0000", 2024-09-10T15:26:31.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044073799999999998 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.761905+0000", 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1783000000000001e-05 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.761957+0000", 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2352000000000003e-05 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.301 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:31.301 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:31.301 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:31.302 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:31.303 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:31.303 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:31.303 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:31.304 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:31.304 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:31.305 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:31.305 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:31.302+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:31.404 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:31.399+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:31.458 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:31.458 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:31.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1365 3.8 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.023704625999999999, 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023764094999999999, 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "waiting for sub ops", 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1365 2024-09-10T15:26:31.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434955+0000", 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7139999999999999e-06 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443391+0000", 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0084368099999999994 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443430+0000", 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8189000000000003e-05 2024-09-10T15:26:31.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443446+0000", 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6900000000000001e-05 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443570+0000", 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012320399999999999 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443821+0000", 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025176099999999998 2024-09-10T15:26:31.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444043+0000", 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022190900000000001 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 1 2024-09-10T15:26:31.463 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:31.474 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:31.503 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:31.502+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:31.598 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.9 2024-09-10T15:26:31.598 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:31.598 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 10 2024-09-10T15:26:31.604 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:31.599+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:31.648 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:31.648 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:31.648 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:31.662 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:31.673 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records in 2024-09-10T15:26:31.673 INFO:tasks.workunit.client.0.smithi099.stderr:10+0 records out 2024-09-10T15:26:31.673 INFO:tasks.workunit.client.0.smithi099.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.072043 s, 1.5 GB/s 2024-09-10T15:26:31.705 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:31.702+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:31.805 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:31.806+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:238 6.18 6:1a734c59:::obj_delete_at_hint.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:31.829 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 68.817065713999995, 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055684239999999998, 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 238 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008281+0000", 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008283+0000", 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4569999999999999e-06 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008297+0000", 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3933e-05 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008333+0000", 2024-09-10T15:26:31.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6096999999999997e-05 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008356+0000", 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2942000000000002e-05 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008504+0000", 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014746299999999999 2024-09-10T15:26:31.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.008719+0000", 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021527199999999999 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.009020+0000", 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030114399999999999 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.010376+0000", 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001355633 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013584+0000", 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032078879999999999 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013738+0000", 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015396299999999999 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:23.013849+0000", 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111632 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1177 3.3a e62/23 3:5f641ecd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_4:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7839743459999999, 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020497457, 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041404+0000", 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1856000000000001e-05 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050019+0000", 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086145660000000006 2024-09-10T15:26:31.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050058+0000", 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9289000000000003e-05 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050081+0000", 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2748999999999999e-05 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050218+0000", 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013712300000000001 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050239+0000", 2024-09-10T15:26:31.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0784999999999998e-05 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.061763+0000", 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011523805 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.061870+0000", 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107284 2024-09-10T15:26:31.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1181 3.19 3:98ecfd30:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7206193320000001, 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024964212, 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1181 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104732+0000", 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2200000000000003e-06 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111913+0000", 2024-09-10T15:26:31.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00718171 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111956+0000", 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2855999999999998e-05 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111988+0000", 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1415999999999999e-05 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112135+0000", 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014741600000000001 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112393+0000", 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025839 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112642+0000", 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024873400000000002 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.125741+0000", 2024-09-10T15:26:31.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013098487000000001 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129377+0000", 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036366760000000001 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129582+0000", 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020458499999999999 2024-09-10T15:26:31.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129692+0000", 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109722 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1182 3.2b 3:d6877f0f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.850 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6986322529999995, 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023699754999999999, 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1182 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126718+0000", 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131768+0000", 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050503650000000002 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131795+0000", 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7361000000000001e-05 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131809+0000", 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4106e-05 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131933+0000", 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012341500000000001 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132188+0000", 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025496999999999998 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132440+0000", 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025235399999999999 2024-09-10T15:26:31.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.145720+0000", 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013279699000000001 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150294+0000", 2024-09-10T15:26:31.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045736780000000003 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150348+0000", 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4840999999999999e-05 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150414+0000", 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5763e-05 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1186 3.2b 3:d6908ca0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.859 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6114913069999997, 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021761591, 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.860 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1186 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213858+0000", 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8159999999999998e-06 2024-09-10T15:26:31.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217781+0000", 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039231550000000002 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217819+0000", 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7577000000000003e-05 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217831+0000", 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1751e-05 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217955+0000", 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124017 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218199+0000", 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024441099999999999 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218430+0000", 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230461 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.227085+0000", 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086550289999999998 2024-09-10T15:26:31.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235393+0000", 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083088959999999996 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235489+0000", 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5778000000000004e-05 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235617+0000", 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012769999999999999 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1190 3.3c e62/23 3:3d352607:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_17:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.308738+0000", 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.5166082769999996, 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011665719999999999, 2024-09-10T15:26:31.867 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.308738+0000", 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.308738+0000", 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.309668+0000", 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00093004800000000005 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.313267+0000", 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035980980000000001 2024-09-10T15:26:31.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.313302+0000", 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5605999999999998e-05 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.313325+0000", 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3125999999999998e-05 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.870 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.313438+0000", 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011278899999999999 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.313456+0000", 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8420999999999999e-05 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.320275+0000", 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068184650000000001 2024-09-10T15:26:31.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.320404+0000", 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012916699999999999 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1194 3.1b 3:db05cc66:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:31.872 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.4251921339999996, 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019807701, 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1194 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400157+0000", 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4650000000000001e-06 2024-09-10T15:26:31.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404841+0000", 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046836760000000003 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404869+0000", 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7920999999999999e-05 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404880+0000", 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0947999999999999e-05 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404951+0000", 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1477999999999996e-05 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.405087+0000", 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000135704 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.405201+0000", 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011396 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.412024+0000", 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068235470000000001 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419890+0000", 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078657390000000001 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419930+0000", 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0253999999999998e-05 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419962+0000", 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2008999999999998e-05 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1195 3.3d e62/23 3:bc04a9f1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_22:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.427101+0000", 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.3982461439999998, 2024-09-10T15:26:31.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011877034, 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.427101+0000", 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.427101+0000", 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.427103+0000", 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4499999999999998e-06 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.429123+0000", 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002019758 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.429163+0000", 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0703e-05 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.429181+0000", 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7646e-05 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.429280+0000", 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.87e-05 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.429310+0000", 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0596999999999999e-05 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.438833+0000", 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095221139999999999 2024-09-10T15:26:31.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.438978+0000", 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014506600000000001 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1199 3.1b 3:dae099b0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.884 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.2885368030000004, 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022241449999999999, 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1199 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536813+0000", 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.54e-06 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540890+0000", 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040768100000000002 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540934+0000", 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4155e-05 2024-09-10T15:26:31.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540954+0000", 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9366000000000001e-05 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541095+0000", 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014104699999999999 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541348+0000", 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025277999999999998 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541945+0000", 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059730099999999995 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.552388+0000", 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01044308 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.558941+0000", 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065525849999999997 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559008+0000", 2024-09-10T15:26:31.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7175000000000007e-05 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559051+0000", 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3611e-05 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1209 3.1b 3:d9c2a680:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:31.891 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.7487611360000002, 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019290194, 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1209 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076589+0000", 2024-09-10T15:26:31.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084343+0000", 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077541559999999999 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084384+0000", 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1158999999999997e-05 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084410+0000", 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6308999999999998e-05 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084508+0000", 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7405999999999995e-05 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084634+0000", 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012651399999999999 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084738+0000", 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010309700000000001 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.092599+0000", 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078618309999999997 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095801+0000", 2024-09-10T15:26:31.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032015960000000001 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095839+0000", 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8535999999999998e-05 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095876+0000", 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6269999999999997e-05 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.898 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1210 3.2b 3:d428ccbb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.7261979439999999, 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024418312000000001, 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.899 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1210 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099151+0000", 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.43e-06 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.103964+0000", 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048127949999999999 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104006+0000", 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2391999999999997e-05 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104033+0000", 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.616e-05 2024-09-10T15:26:31.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104145+0000", 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011285099999999999 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104365+0000", 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021917 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104567+0000", 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020294399999999999 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.114085+0000", 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095177730000000002 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123440+0000", 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009354757 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123510+0000", 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0127000000000001e-05 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123567+0000", 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6913000000000002e-05 2024-09-10T15:26:31.905 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1212 3.3a e62/23 3:5fff66ed:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_11:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.6828196630000001, 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014868973000000001, 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.906 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142529+0000", 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2330000000000001e-06 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147323+0000", 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047936130000000004 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147363+0000", 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9765000000000003e-05 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147389+0000", 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6316e-05 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147498+0000", 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010914 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147516+0000", 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8232000000000001e-05 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.157295+0000", 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097791570000000001 2024-09-10T15:26:31.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.157396+0000", 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100517 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1225 3.8 3:12daa5c3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:31.911 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.5358505789999999, 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021292011, 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1225 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289499+0000", 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3129999999999999e-06 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294420+0000", 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049203329999999998 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294459+0000", 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511999999999997e-05 2024-09-10T15:26:31.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294478+0000", 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8369999999999999e-05 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294642+0000", 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164253 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295016+0000", 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000374201 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295405+0000", 2024-09-10T15:26:31.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038931099999999999 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.308446+0000", 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013040754 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310510+0000", 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020643010000000002 2024-09-10T15:26:31.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310674+0000", 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016396299999999999 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310788+0000", 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0001137 2024-09-10T15:26:31.918 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1230 3.7 3:e0a54a53:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.1733881429999999, 2024-09-10T15:26:31.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020686421, 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1230 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:31.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651962+0000", 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656858+0000", 2024-09-10T15:26:31.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048953039999999996 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656897+0000", 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9345999999999999e-05 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656915+0000", 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7836e-05 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657097+0000", 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018200200000000001 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657504+0000", 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000407284 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657936+0000", 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043207599999999999 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.667656+0000", 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097194099999999995 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672492+0000", 2024-09-10T15:26:31.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048363399999999997 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672577+0000", 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4812e-05 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672645+0000", 2024-09-10T15:26:31.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8077999999999994e-05 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1233 3.2b 3:d6e77df5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.927 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.1414171290000001, 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018296130000000001, 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.928 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1233 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683932+0000", 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.379e-06 2024-09-10T15:26:31.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687803+0000", 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038709840000000001 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687829+0000", 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6480999999999999e-05 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687843+0000", 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3706999999999999e-05 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687924+0000", 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0508999999999998e-05 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.688093+0000", 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169426 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.688245+0000", 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015193300000000001 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.695010+0000", 2024-09-10T15:26:31.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067654489999999998 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702145+0000", 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0071349769999999998 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702188+0000", 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2833999999999997e-05 2024-09-10T15:26:31.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702226+0000", 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7450999999999998e-05 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1236 3.7 3:e25c0c35:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:31.935 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.1096746450000001, 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017002278999999999, 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1236 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715674+0000", 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719555+0000", 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038807630000000002 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719580+0000", 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4649000000000001e-05 2024-09-10T15:26:31.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719591+0000", 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0818999999999999e-05 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719661+0000", 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0203999999999994e-05 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719775+0000", 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011458199999999999 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719875+0000", 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9611999999999994e-05 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730347+0000", 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010472415000000001 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732512+0000", 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021641220000000001 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732607+0000", 2024-09-10T15:26:31.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5049000000000004e-05 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732674+0000", 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7711000000000003e-05 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1355 3.3d e63/23 3:bf2d92a6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_4:head v 63'6, mlcod=63'4)", 2024-09-10T15:26:31.942 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.326942+0000", 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.49840427199999998, 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014244135, 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326942+0000", 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326942+0000", 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326947+0000", 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.403e-06 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.330370+0000", 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034234090000000001 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.330396+0000", 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6049000000000001e-05 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.330413+0000", 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6697999999999998e-05 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.330533+0000", 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012039100000000001 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.330562+0000", 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8532000000000001e-05 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341117+0000", 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010554694 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341187+0000", 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.9958999999999999e-05 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.947 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1359 3.39 e63/23 3:9d7627ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_8:head v 63'1, mlcod=0'0)", 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.46019621900000002, 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015266238999999999, 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365158+0000", 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.678e-06 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369551+0000", 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043930929999999998 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369581+0000", 2024-09-10T15:26:31.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9713000000000002e-05 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369593+0000", 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369679+0000", 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5947999999999998e-05 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369701+0000", 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2306999999999998e-05 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.380245+0000", 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010543235999999999 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.380417+0000", 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017211700000000001 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1360 3.3a e63/23 3:5e523b29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_9:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.450981252, 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016175763999999999, 2024-09-10T15:26:31.953 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374369+0000", 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0970000000000002e-06 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381916+0000", 2024-09-10T15:26:31.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075478890000000003 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381949+0000", 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2892000000000003e-05 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381966+0000", 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6330000000000001e-05 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.382066+0000", 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100852 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.382103+0000", 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6291000000000002e-05 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.957 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.390438+0000", 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083354080000000007 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.390541+0000", 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010300499999999999 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.958 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1365 3.8 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.390395885, 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025243808999999999, 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1365 2024-09-10T15:26:31.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:31.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434955+0000", 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7139999999999999e-06 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443391+0000", 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0084368099999999994 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443430+0000", 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8189000000000003e-05 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443446+0000", 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6900000000000001e-05 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443570+0000", 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012320399999999999 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443821+0000", 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025176099999999998 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444043+0000", 2024-09-10T15:26:31.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022190900000000001 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459249+0000", 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015206040000000001 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460027+0000", 2024-09-10T15:26:31.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077740299999999997 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460123+0000", 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6053999999999999e-05 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:31.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460195+0000", 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1824999999999998e-05 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:31.966 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:31.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:31.969 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:31.966+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:32.069 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:32.066+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:32.104 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:32.104 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:32.104 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:32.105 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:32.119 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:32.133 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:26:32.169 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:32.167+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:32.259 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:32.259 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:32.259 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:32.260 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:32.260 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:32.271 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:32.267+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:32.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:32.372 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:32.367+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:32.454 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1179 3.4 e62/23 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.3677830359999996, 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016361245999999999, 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082868+0000", 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7300000000000005e-07 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085770+0000", 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002901945 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085822+0000", 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2089000000000002e-05 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085841+0000", 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9119000000000001e-05 2024-09-10T15:26:32.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086000+0000", 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015898999999999999 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086040+0000", 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9972000000000003e-05 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099137+0000", 2024-09-10T15:26:32.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013096813000000001 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099228+0000", 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1545000000000005e-05 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1180 3.10 e62/23 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.3539201209999998, 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018493124, 2024-09-10T15:26:32.459 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096733+0000", 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7499999999999999e-06 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103771+0000", 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070384489999999996 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103806+0000", 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4798999999999997e-05 2024-09-10T15:26:32.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103832+0000", 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6013e-05 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103956+0000", 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124194 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103998+0000", 2024-09-10T15:26:32.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1841999999999997e-05 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115130+0000", 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011132246 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115223+0000", 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2831000000000006e-05 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.2149007110000003, 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:32.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:32.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:32.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:26:32.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1192 3.38 3:1fd275ab:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:32.469 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.0988642139999998, 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01700991, 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1192 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351789+0000", 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.531e-06 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355811+0000", 2024-09-10T15:26:32.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040222690000000002 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355839+0000", 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.864e-05 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355851+0000", 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1776e-05 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355926+0000", 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.4318000000000002e-05 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356068+0000", 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260999999999999 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356198+0000", 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012937800000000001 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.364011+0000", 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078136939999999995 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368681+0000", 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046692440000000003 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368733+0000", 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2085e-05 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368796+0000", 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3365000000000001e-05 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1195 3.3d 3:bc04a9f1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.0278426329999997, 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016842467999999999, 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.475 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1195 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422810+0000", 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1500000000000002e-06 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426623+0000", 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038136469999999999 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426651+0000", 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7543e-05 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426662+0000", 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0937999999999999e-05 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426734+0000", 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2465000000000005e-05 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426849+0000", 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011429099999999999 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426960+0000", 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111266 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.437403+0000", 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010442811 2024-09-10T15:26:32.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439351+0000", 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019481609999999999 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439523+0000", 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000172549 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439650+0000", 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126647 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1205 3.23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.4398274430000004, 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020233378, 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.481 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1205 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010826+0000", 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.689e-06 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015077+0000", 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042514229999999998 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015112+0000", 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5275999999999999e-05 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015134+0000", 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1687000000000001e-05 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015257+0000", 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012268500000000001 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015400+0000", 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014325300000000001 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015516+0000", 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115757 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030382+0000", 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014866890000000001 2024-09-10T15:26:32.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030952+0000", 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00056960500000000005 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031011+0000", 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8972999999999999e-05 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031056+0000", 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5139999999999998e-05 2024-09-10T15:26:32.486 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1215 3.1f 3:faffbb4f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.2774357240000001, 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018963486000000002, 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.487 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1215 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173218+0000", 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8929999999999998e-06 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177338+0000", 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004119592 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177376+0000", 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7558999999999997e-05 2024-09-10T15:26:32.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177394+0000", 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8277000000000001e-05 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177507+0000", 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011278299999999999 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177702+0000", 2024-09-10T15:26:32.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019584299999999999 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177884+0000", 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000181134 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185658+0000", 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077739660000000002 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.191981+0000", 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063235940000000001 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192071+0000", 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0051999999999998e-05 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192178+0000", 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679300000000001 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.492 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1216 3.17 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.265511837, 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024358715999999999, 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1216 2024-09-10T15:26:32.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185142+0000", 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7000000000000002e-06 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189137+0000", 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039947480000000002 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189170+0000", 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3402999999999999e-05 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189188+0000", 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7385999999999999e-05 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189357+0000", 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016903299999999999 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189760+0000", 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040378099999999998 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.190175+0000", 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041465300000000002 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.205685+0000", 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015510098 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209323+0000", 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036379149999999998 2024-09-10T15:26:32.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209424+0000", 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101303 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209497+0000", 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2695999999999997e-05 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.498 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1222 3.23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.1973083190000002, 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029186541999999999, 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1222 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253345+0000", 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.954e-06 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257398+0000", 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040527439999999996 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257431+0000", 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3513000000000003e-05 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257447+0000", 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6022e-05 2024-09-10T15:26:32.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257579+0000", 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000132187 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257866+0000", 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028712300000000002 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258110+0000", 2024-09-10T15:26:32.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243248 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269782+0000", 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011672342 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282341+0000", 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012558613 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282439+0000", 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8688000000000001e-05 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282528+0000", 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9108000000000001e-05 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1231 3.0 3:016afb57:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:32.504 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.7865270419999999, 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017421782, 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1231 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:32.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664127+0000", 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3000000000000002e-06 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669087+0000", 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049601000000000003 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669128+0000", 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1362000000000001e-05 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669146+0000", 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7663e-05 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669294+0000", 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014813000000000001 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669544+0000", 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025002100000000001 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669770+0000", 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022583400000000001 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.680977+0000", 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011207178 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681448+0000", 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047145500000000002 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681500+0000", 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1264000000000002e-05 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681545+0000", 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5475000000000001e-05 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1241 3.29 3:97ec7333:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.6832488350000001, 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018815331000000001, 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.510 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1241 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767404+0000", 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2259999999999999e-06 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771530+0000", 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041263999999999997 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771574+0000", 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4143000000000001e-05 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771594+0000", 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9409e-05 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771685+0000", 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1252e-05 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771798+0000", 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113206 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771894+0000", 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.611e-05 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778783+0000", 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068883809999999998 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786070+0000", 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072874050000000003 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786158+0000", 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7947000000000003e-05 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786217+0000", 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8851999999999998e-05 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.515 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1242 3.38 3:1d12f6dd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.6723755689999997, 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024298450999999999, 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.516 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1242 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778277+0000", 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5639999999999999e-06 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783335+0000", 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050581660000000002 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783370+0000", 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5012999999999998e-05 2024-09-10T15:26:32.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783400+0000", 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9142e-05 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783528+0000", 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012881700000000001 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783864+0000", 2024-09-10T15:26:32.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00033515200000000002 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.784288+0000", 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042494000000000001 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.798794+0000", 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014505980999999999 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802363+0000", 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035688579999999998 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802491+0000", 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012784299999999999 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802573+0000", 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1975e-05 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.521 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1243 3.22 e62/23 3:456b4d20:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_14:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.6586148060000001, 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017000360999999999, 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792038+0000", 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.097e-06 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797587+0000", 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055492659999999997 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797619+0000", 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2372000000000001e-05 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797635+0000", 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.575e-05 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797769+0000", 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013404000000000001 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797830+0000", 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0835000000000003e-05 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.808891+0000", 2024-09-10T15:26:32.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011061161 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.809036+0000", 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014484 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1353 3.4 e63/23 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.1447046519999999, 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015921056999999999, 2024-09-10T15:26:32.526 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305948+0000", 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309743+0000", 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037948280000000001 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309783+0000", 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0039000000000001e-05 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309815+0000", 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2316e-05 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309987+0000", 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017165299999999999 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.310052+0000", 2024-09-10T15:26:32.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4931999999999994e-05 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.321702+0000", 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01165007 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.321867+0000", 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016470300000000001 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1355 3.3d 3:bf2d92a6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.130000026, 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020864745000000001, 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1355 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.531 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320655+0000", 2024-09-10T15:26:32.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3540000000000002e-06 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326192+0000", 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055377869999999997 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326232+0000", 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0012999999999998e-05 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326251+0000", 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8975e-05 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326396+0000", 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014415399999999999 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326561+0000", 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016593099999999999 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326707+0000", 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014573599999999999 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.333446+0000", 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067385800000000001 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341424+0000", 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079780619999999993 2024-09-10T15:26:32.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341474+0000", 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0661999999999997e-05 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341515+0000", 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0491000000000002e-05 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.536 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1363 3.1f 3:f8d0acf1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.040625533, 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020666087999999999, 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1363 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410030+0000", 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9660000000000004e-06 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414404+0000", 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043742260000000002 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414446+0000", 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1579000000000003e-05 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414472+0000", 2024-09-10T15:26:32.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414682+0000", 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020987600000000001 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414921+0000", 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000239304 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.415143+0000", 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221776 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424445+0000", 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093022169999999998 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430518+0000", 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006072694 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430615+0000", 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7725000000000004e-05 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430691+0000", 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5581999999999996e-05 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.542 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1377 3.3e 3:7f7ea93f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.87064839800000005, 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017764525999999999, 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1377 2024-09-10T15:26:32.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580004+0000", 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.181e-06 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583837+0000", 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038328939999999999 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583867+0000", 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0301e-05 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583878+0000", 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1226999999999999e-05 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583952+0000", 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3411000000000006e-05 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584114+0000", 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016212400000000001 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584554+0000", 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044031700000000002 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.591179+0000", 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0066242760000000001 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597670+0000", 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0064910439999999996 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597727+0000", 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7361999999999997e-05 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597766+0000", 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9388999999999998e-05 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.548 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1394 3.23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.25715633399999999, 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.043242203, 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1394 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193497+0000", 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1949999999999999e-06 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197756+0000", 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042592400000000001 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197790+0000", 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3831999999999997e-05 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197824+0000", 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3818e-05 2024-09-10T15:26:32.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197899+0000", 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5414000000000007e-05 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197905+0000", 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000003e-06 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.201937+0000", 2024-09-10T15:26:32.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040326889999999999 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202120+0000", 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182704 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202312+0000", 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019223299999999999 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.228030+0000", 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025717357999999999 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236643+0000", 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086134929999999998 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236699+0000", 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5407e-05 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236736+0000", 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7545000000000001e-05 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1395 3.18 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.24828568600000001, 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033860491999999999, 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.555 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1395 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202366+0000", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.725e-06 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208089+0000", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057225280000000002 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208111+0000", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663999999999998e-05 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208125+0000", 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3516000000000001e-05 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208199+0000", 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3677000000000006e-05 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208309+0000", 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011049599999999999 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208403+0000", 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4056999999999997e-05 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233736+0000", 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025333248999999999 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236043+0000", 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00230693 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236146+0000", 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102954 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236225+0000", 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8695999999999993e-05 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1403 3.1e 3:7aef99fe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:32.560 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.108206883, 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021656937000000001, 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1403 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342447+0000", 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5260000000000002e-06 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346589+0000", 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041420600000000004 2024-09-10T15:26:32.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346633+0000", 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3578999999999997e-05 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346652+0000", 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9177e-05 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346780+0000", 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012826999999999999 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347012+0000", 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023154499999999999 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347236+0000", 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224429 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.353199+0000", 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059633519999999999 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.363980+0000", 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010780811 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364047+0000", 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6611000000000003e-05 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364100+0000", 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3576999999999999e-05 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.565 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:32.566 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:32.566 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:32.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:32.568 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:32.563+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:32.668 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:32.666+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:32.745 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:32.746 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:32.746 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:32.746 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:32.761 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:32.769 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:32.766+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:32.870 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:32.870+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:32.884 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:32.884 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:32.884 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:32.884 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:32.884 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:32.900 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:32.971 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:32.966+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 77.189176144000001, 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.034 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.035 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:26:33.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:26:33.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.952697111, 2024-09-10T15:26:33.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:33.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:33.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1188 3.25 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.77156746, 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019443585999999999, 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.046 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1188 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257377+0000", 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8700000000000001e-06 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261294+0000", 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039172979999999996 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261328+0000", 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3353999999999999e-05 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261342+0000", 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4174e-05 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261424+0000", 2024-09-10T15:26:33.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2427000000000002e-05 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261555+0000", 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000130908 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261671+0000", 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115624 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.268433+0000", 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067620909999999996 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276721+0000", 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082879170000000005 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276771+0000", 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0328000000000003e-05 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276818+0000", 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6594999999999997e-05 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.7015658049999995, 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:33.052 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:33.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:33.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1193 3.15 e62/23 3:a820acfb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_20:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:33.058 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.650411772, 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014435465, 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:33.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378532+0000", 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6980000000000001e-06 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383652+0000", 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051201090000000003 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383673+0000", 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1319e-05 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383684+0000", 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0899e-05 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383770+0000", 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6142000000000003e-05 2024-09-10T15:26:33.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383802+0000", 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2295000000000002e-05 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392895+0000", 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090925280000000008 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392965+0000", 2024-09-10T15:26:33.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0475000000000005e-05 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.9929922040000001, 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.063 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:33.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.065 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:33.068 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.9737226650000004, 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.069 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:33.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.074 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.8331796650000003, 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.075 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:33.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:33.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.080 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1223 3.24 3:24dc70f2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7599225360000004, 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017503632000000002, 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.081 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1223 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269022+0000", 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272893+0000", 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038702099999999998 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272926+0000", 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3612000000000003e-05 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272944+0000", 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8043e-05 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273031+0000", 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6278000000000003e-05 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273152+0000", 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121564 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273254+0000", 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101519 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.280527+0000", 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072731979999999998 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286154+0000", 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005627656 2024-09-10T15:26:33.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286358+0000", 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020398200000000001 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286523+0000", 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016425000000000001 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1224 3.1 3:83c983e8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7498891800000003, 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017784127, 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1224 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279076+0000", 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3538000000000001e-05 2024-09-10T15:26:33.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282896+0000", 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038197539999999999 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282917+0000", 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1274e-05 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282928+0000", 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1032999999999999e-05 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283047+0000", 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011906899999999999 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283274+0000", 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000226994 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.090 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283497+0000", 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022311499999999999 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.291660+0000", 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081630839999999993 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296660+0000", 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049993119999999997 2024-09-10T15:26:33.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296759+0000", 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9698000000000007e-05 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296837+0000", 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7255999999999994e-05 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.72875749, 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.093 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:33.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.098 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.5645567790000001, 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:33.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.555506096, 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:33.103 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:33.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:33.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1370 3.12 3:49cd0d62:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.5337231199999999, 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018546729000000001, 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1370 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.108 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495230+0000", 2024-09-10T15:26:33.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1396999999999999e-05 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499293+0000", 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040634 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499311+0000", 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8114e-05 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499320+0000", 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0329999999999997e-06 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499392+0000", 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1928000000000007e-05 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499531+0000", 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013831999999999999 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:33.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499658+0000", 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012751900000000001 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509514+0000", 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098560490000000004 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513599+0000", 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040848880000000001 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513689+0000", 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9530000000000005e-05 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513765+0000", 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6551000000000006e-05 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1371 3.1 3:823dae61:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:33.113 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.5189877899999999, 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019092687000000001, 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1371 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509956+0000", 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.215e-06 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514247+0000", 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042912860000000001 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514261+0000", 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3957e-05 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514269+0000", 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.593e-06 2024-09-10T15:26:33.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514335+0000", 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5692999999999996e-05 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514511+0000", 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017681700000000001 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514695+0000", 2024-09-10T15:26:33.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018357000000000001 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.521453+0000", 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067582440000000001 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528786+0000", 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073324499999999999 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528929+0000", 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014385400000000001 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.529046+0000", 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000117008 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1372 3.1 3:83c0d5fc:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:33.119 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.509333574, 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017231015999999998, 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1372 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:33.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519610+0000", 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9230000000000001e-06 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524843+0000", 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052327449999999996 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524862+0000", 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9377000000000001e-05 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524872+0000", 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0308e-05 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524949+0000", 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6465999999999996e-05 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.525144+0000", 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000194792 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.525317+0000", 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017317499999999999 2024-09-10T15:26:33.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.534366+0000", 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090490669999999992 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536695+0000", 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023289029999999998 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536777+0000", 2024-09-10T15:26:33.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2358e-05 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536839+0000", 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1902000000000005e-05 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1374 3.25 3:a5c592a7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:33.125 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.484480228, 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018460776000000002, 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1374 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:33.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544495+0000", 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3989000000000003e-05 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548835+0000", 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043393219999999996 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548872+0000", 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7138999999999998e-05 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548890+0000", 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8006999999999999e-05 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549005+0000", 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115166 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549217+0000", 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021217 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549415+0000", 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019820999999999999 2024-09-10T15:26:33.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562491+0000", 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013075765 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562833+0000", 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034160000000000001 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562881+0000", 2024-09-10T15:26:33.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8439000000000002e-05 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562922+0000", 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0969e-05 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:33.131 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.007337945, 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:33.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:33.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.82030699200000001, 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:33.137 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:33.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:33.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.79189382399999997, 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.142 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:33.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:33.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:33.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:33.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:33.147 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:33.149 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:33.149 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:33.146+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:33.249 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:33.246+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:33.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:33.321 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:33.321 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:33.321 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:33.321 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:33.335 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:33.354 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:33.354+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:33.448 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:33.448 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:33.451 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:33.446+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:33.458 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:33.458 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:33.459 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:33.459 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:33.464 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:33.464 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:33.473 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:33.482 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:33.482 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:33.499 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:33.499 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:33.516 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:33.516 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:33.536 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:33.537 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:33.555 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:33.555 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:33.561 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:33.558+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:33.585 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:33.585 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:33.647 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:33.647 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:33.652 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:33.646+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:33.660 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:33.753 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:33.750+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:33.787 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:33.787 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:33.802 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:33.853 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:33.854+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:33.929 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:33.929 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:33.942 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:33.955 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:33.950+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:34.056 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:34.054+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:34.111 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:34.111 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:34.125 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:34.166 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:34.166+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:34.181 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:26:34.258 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:34.254+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:34.293 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:34.294 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:34.309 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:34.358 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:34.354+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:34.431 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:34.431 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:34.448 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:34.494 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:34.494+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:34.559 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:34.554+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:34.564 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:34.564 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:34.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:34.661 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:34.654+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:34.744 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:34.744 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:34.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:34.802 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:34.802+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:34.861 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:34.858+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:34.886 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:34.886 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:34.900 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:34.962 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:34.958+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:35.059 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:35.059 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:35.062 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:35.062+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:35.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:35.163 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:35.158+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:26:35.244 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:35.245 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:35.264 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:35.258+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:35.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:35.365 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:35.362+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:35.381 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:35.381 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:35.397 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:35.466 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:35.462+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:35.558 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:35.558 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:35.566 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:35.566+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:35.573 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:35.605 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:35.667 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:35.662+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:35.705 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:35.705 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:35.719 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:35.753 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:35.754 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:35.770 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:35.770 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:35.787 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:35.787 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:35.804 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:35.804 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:35.805 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:35.802+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:35.828 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:35.828 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:35.847 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:35.847 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:35.869 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:35.866+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:35.870 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:35.882 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:35.882 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:35.882 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:35.882 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:35.883 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:35.890 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:35.890 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:35.896 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:35.970 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:35.970+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:36.071 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:36.070+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:36.073 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:36.073 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:36.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:36.073 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:36.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.073 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1177 3.3a e62/23 3:5f641ecd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_4:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.0284000710000001, 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020497457, 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041404+0000", 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1856000000000001e-05 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050019+0000", 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086145660000000006 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050058+0000", 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9289000000000003e-05 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050081+0000", 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2748999999999999e-05 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050218+0000", 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013712300000000001 2024-09-10T15:26:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050239+0000", 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0784999999999998e-05 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.061763+0000", 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011523805 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.061870+0000", 2024-09-10T15:26:36.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107284 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1181 3.19 3:98ecfd30:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.9650450569999993, 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024964212, 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1181 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:36.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104732+0000", 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2200000000000003e-06 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111913+0000", 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00718171 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111956+0000", 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2855999999999998e-05 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111988+0000", 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1415999999999999e-05 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112135+0000", 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014741600000000001 2024-09-10T15:26:36.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112393+0000", 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025839 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112642+0000", 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024873400000000002 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.125741+0000", 2024-09-10T15:26:36.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013098487000000001 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129377+0000", 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036366760000000001 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129582+0000", 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020458499999999999 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129692+0000", 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109722 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1182 3.2b 3:d6877f0f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.9430579780000006, 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023699754999999999, 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.084 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1182 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126718+0000", 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131768+0000", 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050503650000000002 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131795+0000", 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7361000000000001e-05 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131809+0000", 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4106e-05 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131933+0000", 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012341500000000001 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132188+0000", 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025496999999999998 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132440+0000", 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025235399999999999 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.145720+0000", 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013279699000000001 2024-09-10T15:26:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150294+0000", 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045736780000000003 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150348+0000", 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4840999999999999e-05 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150414+0000", 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5763e-05 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1186 3.2b 3:d6908ca0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.8559170320000007, 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021761591, 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.090 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1186 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213858+0000", 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8159999999999998e-06 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217781+0000", 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039231550000000002 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217819+0000", 2024-09-10T15:26:36.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7577000000000003e-05 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217831+0000", 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1751e-05 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217955+0000", 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124017 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218199+0000", 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024441099999999999 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218430+0000", 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230461 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.227085+0000", 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086550289999999998 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235393+0000", 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083088959999999996 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235489+0000", 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5778000000000004e-05 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235617+0000", 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012769999999999999 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1194 3.1b 3:db05cc66:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.6696178590000006, 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019807701, 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.322 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1194 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:36.323 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400157+0000", 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4650000000000001e-06 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404841+0000", 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046836760000000003 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404869+0000", 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7920999999999999e-05 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404880+0000", 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0947999999999999e-05 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404951+0000", 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1477999999999996e-05 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.405087+0000", 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000135704 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.405201+0000", 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011396 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.412024+0000", 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068235470000000001 2024-09-10T15:26:36.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419890+0000", 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078657390000000001 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419930+0000", 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0253999999999998e-05 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419962+0000", 2024-09-10T15:26:36.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2008999999999998e-05 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1199 3.1b 3:dae099b0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.5329625280000005, 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022241449999999999, 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.328 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1199 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:36.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536813+0000", 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.54e-06 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540890+0000", 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040768100000000002 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540934+0000", 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4155e-05 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540954+0000", 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9366000000000001e-05 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541095+0000", 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014104699999999999 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.331 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541348+0000", 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025277999999999998 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541945+0000", 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059730099999999995 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.552388+0000", 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01044308 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.332 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.558941+0000", 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065525849999999997 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559008+0000", 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7175000000000007e-05 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559051+0000", 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3611e-05 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.333 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1209 3.1b 3:d9c2a680:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.9931868609999999, 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019290194, 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.334 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1209 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.335 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076589+0000", 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084343+0000", 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077541559999999999 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084384+0000", 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1158999999999997e-05 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084410+0000", 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6308999999999998e-05 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084508+0000", 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7405999999999995e-05 2024-09-10T15:26:36.337 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084634+0000", 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012651399999999999 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084738+0000", 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010309700000000001 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.092599+0000", 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078618309999999997 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095801+0000", 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032015960000000001 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095839+0000", 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8535999999999998e-05 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095876+0000", 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6269999999999997e-05 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1210 3.2b 3:d428ccbb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.9706236690000001, 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024418312000000001, 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.340 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1210 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099151+0000", 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.43e-06 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.103964+0000", 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048127949999999999 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104006+0000", 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2391999999999997e-05 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104033+0000", 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.616e-05 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104145+0000", 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011285099999999999 2024-09-10T15:26:36.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104365+0000", 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021917 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104567+0000", 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020294399999999999 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.114085+0000", 2024-09-10T15:26:36.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095177730000000002 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123440+0000", 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009354757 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123510+0000", 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0127000000000001e-05 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123567+0000", 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6913000000000002e-05 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1212 3.3a e62/23 3:5fff66ed:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_11:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.9272453880000002, 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014868973000000001, 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.346 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142529+0000", 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2330000000000001e-06 2024-09-10T15:26:36.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147323+0000", 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047936130000000004 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147363+0000", 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9765000000000003e-05 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.348 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147389+0000", 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6316e-05 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147498+0000", 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010914 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147516+0000", 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8232000000000001e-05 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.157295+0000", 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097791570000000001 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.157396+0000", 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100517 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1225 3.8 3:12daa5c3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:36.350 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.780276304, 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021292011, 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1225 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289499+0000", 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3129999999999999e-06 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294420+0000", 2024-09-10T15:26:36.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049203329999999998 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294459+0000", 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511999999999997e-05 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294478+0000", 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8369999999999999e-05 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294642+0000", 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164253 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295016+0000", 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000374201 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295405+0000", 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038931099999999999 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.308446+0000", 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013040754 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310510+0000", 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020643010000000002 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310674+0000", 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016396299999999999 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310788+0000", 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0001137 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1230 3.7 3:e0a54a53:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.4178138679999996, 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020686421, 2024-09-10T15:26:36.356 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1230 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651962+0000", 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656858+0000", 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048953039999999996 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656897+0000", 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9345999999999999e-05 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656915+0000", 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7836e-05 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657097+0000", 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018200200000000001 2024-09-10T15:26:36.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657504+0000", 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000407284 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657936+0000", 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043207599999999999 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.667656+0000", 2024-09-10T15:26:36.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097194099999999995 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672492+0000", 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048363399999999997 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672577+0000", 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4812e-05 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672645+0000", 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8077999999999994e-05 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1233 3.2b 3:d6e77df5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.3858428539999998, 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018296130000000001, 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.362 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1233 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:36.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683932+0000", 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.379e-06 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687803+0000", 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038709840000000001 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687829+0000", 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6480999999999999e-05 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687843+0000", 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3706999999999999e-05 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687924+0000", 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0508999999999998e-05 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.365 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.688093+0000", 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169426 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.688245+0000", 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015193300000000001 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.695010+0000", 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067654489999999998 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702145+0000", 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0071349769999999998 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702188+0000", 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2833999999999997e-05 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702226+0000", 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7450999999999998e-05 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.367 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1236 3.7 3:e25c0c35:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.3541003700000003, 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017002278999999999, 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.368 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1236 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715674+0000", 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719555+0000", 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038807630000000002 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719580+0000", 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4649000000000001e-05 2024-09-10T15:26:36.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719591+0000", 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0818999999999999e-05 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719661+0000", 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0203999999999994e-05 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719775+0000", 2024-09-10T15:26:36.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011458199999999999 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719875+0000", 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9611999999999994e-05 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730347+0000", 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010472415000000001 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732512+0000", 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021641220000000001 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732607+0000", 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5049000000000004e-05 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732674+0000", 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7711000000000003e-05 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.373 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1359 3.39 e63/23 3:9d7627ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_8:head v 63'1, mlcod=0'0)", 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7046219440000003, 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015266238999999999, 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:36.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365158+0000", 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.678e-06 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369551+0000", 2024-09-10T15:26:36.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043930929999999998 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369581+0000", 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9713000000000002e-05 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369593+0000", 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369679+0000", 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5947999999999998e-05 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369701+0000", 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2306999999999998e-05 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.380245+0000", 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010543235999999999 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.380417+0000", 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017211700000000001 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1360 3.3a e63/23 3:5e523b29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_9:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6954069770000002, 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016175763999999999, 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.378 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374369+0000", 2024-09-10T15:26:36.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0970000000000002e-06 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381916+0000", 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075478890000000003 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381949+0000", 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2892000000000003e-05 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381966+0000", 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6330000000000001e-05 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.382066+0000", 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100852 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.382103+0000", 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6291000000000002e-05 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.390438+0000", 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083354080000000007 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.390541+0000", 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010300499999999999 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1365 3.8 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:36.382 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6348216100000004, 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025243808999999999, 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1365 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:36.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434955+0000", 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7139999999999999e-06 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443391+0000", 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0084368099999999994 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443430+0000", 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8189000000000003e-05 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443446+0000", 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6900000000000001e-05 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443570+0000", 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012320399999999999 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443821+0000", 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025176099999999998 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444043+0000", 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022190900000000001 2024-09-10T15:26:36.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459249+0000", 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015206040000000001 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460027+0000", 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077740299999999997 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460123+0000", 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6053999999999999e-05 2024-09-10T15:26:36.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460195+0000", 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1824999999999998e-05 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1381 3.2b 3:d6ca9a27:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.1159060529999998, 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.028008075, 2024-09-10T15:26:36.388 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1381 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953870+0000", 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3569999999999998e-06 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957911+0000", 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040408420000000002 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957947+0000", 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6801999999999998e-05 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957965+0000", 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7473e-05 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958102+0000", 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137181 2024-09-10T15:26:36.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958354+0000", 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025186400000000003 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958590+0000", 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000236445 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.970044+0000", 2024-09-10T15:26:36.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011453502000000001 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981461+0000", 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011417418 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981714+0000", 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000252434 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981874+0000", 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016075700000000001 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1383 3.39 e63/23 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head v 63'2, mlcod=0'0)", 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.993970+0000", 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.0758028700000004, 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016938682, 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.394 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.993970+0000", 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.993970+0000", 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.993972+0000", 2024-09-10T15:26:36.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998058+0000", 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040860150000000001 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998096+0000", 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7452e-05 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998113+0000", 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7776000000000001e-05 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998223+0000", 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010963099999999999 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998262+0000", 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8668999999999999e-05 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.397 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.010797+0000", 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012535121999999999 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.010908+0000", 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011144100000000001 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1387 3.2b 3:d54d5f84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:36.398 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.064699+0000", 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.0050736020000004, 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018141995000000001, 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1387 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.064699+0000", 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.064699+0000", 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.064701+0000", 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.339e-06 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068521+0000", 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038198519999999999 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068551+0000", 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0161000000000001e-05 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068570+0000", 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8941999999999999e-05 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068690+0000", 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012016800000000001 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068949+0000", 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000258621 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.069175+0000", 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022640200000000001 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.080471+0000", 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011296082000000001 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.082674+0000", 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022030779999999998 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.082766+0000", 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1294999999999999e-05 2024-09-10T15:26:36.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.082841+0000", 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5055000000000006e-05 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1396 3.9 e64/23 3:90cc0258:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_17:head v 64'6, mlcod=63'4)", 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.8571277940000002, 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.030549334000000001, 2024-09-10T15:26:36.404 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.39e-07 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217600+0000", 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049551860000000003 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217620+0000", 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9928e-05 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217629+0000", 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2660000000000007e-06 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217770+0000", 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000140798 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217836+0000", 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6278000000000005e-05 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243052+0000", 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025215339 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243194+0000", 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014219999999999999 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.408 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:36.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:36.410 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:36.410+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:36.511 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:36.510+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:36.546 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:36.546 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:36.546 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:36.546 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:36.560 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:36.613 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:36.606+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:36.688 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:36.688 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:36.688 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:36.688 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:36.688 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:36.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:36.745 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:36.742+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:36.814 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:36.810+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:36.873 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:36.873 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:36.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:36.873 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:36.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1179 3.4 e62/23 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7867422669999993, 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016361245999999999, 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082868+0000", 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7300000000000005e-07 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085770+0000", 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002901945 2024-09-10T15:26:36.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085822+0000", 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2089000000000002e-05 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085841+0000", 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9119000000000001e-05 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086000+0000", 2024-09-10T15:26:36.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015898999999999999 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086040+0000", 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9972000000000003e-05 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099137+0000", 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013096813000000001 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099228+0000", 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1545000000000005e-05 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1180 3.10 e62/23 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7728793520000004, 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018493124, 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.878 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096733+0000", 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7499999999999999e-06 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103771+0000", 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070384489999999996 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103806+0000", 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4798999999999997e-05 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103832+0000", 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6013e-05 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103956+0000", 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124194 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103998+0000", 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1841999999999997e-05 2024-09-10T15:26:36.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115130+0000", 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011132246 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115223+0000", 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2831000000000006e-05 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.882 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.6338599420000008, 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:26:36.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1192 3.38 3:1fd275ab:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.5178234449999994, 2024-09-10T15:26:36.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01700991, 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1192 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:36.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351789+0000", 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.531e-06 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355811+0000", 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040222690000000002 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355839+0000", 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.864e-05 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355851+0000", 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1776e-05 2024-09-10T15:26:36.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355926+0000", 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.4318000000000002e-05 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356068+0000", 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260999999999999 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356198+0000", 2024-09-10T15:26:36.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012937800000000001 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.364011+0000", 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078136939999999995 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368681+0000", 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046692440000000003 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368733+0000", 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2085e-05 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368796+0000", 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3365000000000001e-05 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.896 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1195 3.3d 3:bc04a9f1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.4468018639999993, 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016842467999999999, 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.897 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1195 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422810+0000", 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1500000000000002e-06 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426623+0000", 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038136469999999999 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426651+0000", 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7543e-05 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426662+0000", 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0937999999999999e-05 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426734+0000", 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2465000000000005e-05 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426849+0000", 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011429099999999999 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:36.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426960+0000", 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111266 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.437403+0000", 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010442811 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439351+0000", 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019481609999999999 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439523+0000", 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000172549 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439650+0000", 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126647 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1205 3.23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.902 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.8587866739999992, 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020233378, 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1205 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:36.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010826+0000", 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.689e-06 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015077+0000", 2024-09-10T15:26:36.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042514229999999998 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015112+0000", 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5275999999999999e-05 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015134+0000", 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1687000000000001e-05 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015257+0000", 2024-09-10T15:26:36.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012268500000000001 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015400+0000", 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014325300000000001 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015516+0000", 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115757 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030382+0000", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014866890000000001 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030952+0000", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00056960500000000005 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031011+0000", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8972999999999999e-05 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031056+0000", 2024-09-10T15:26:36.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5139999999999998e-05 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1215 3.1f 3:faffbb4f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.6963949550000006, 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018963486000000002, 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1215 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173218+0000", 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8929999999999998e-06 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177338+0000", 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004119592 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177376+0000", 2024-09-10T15:26:36.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7558999999999997e-05 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177394+0000", 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8277000000000001e-05 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177507+0000", 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011278299999999999 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177702+0000", 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019584299999999999 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177884+0000", 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000181134 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185658+0000", 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077739660000000002 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.191981+0000", 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063235940000000001 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192071+0000", 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0051999999999998e-05 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192178+0000", 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679300000000001 2024-09-10T15:26:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1216 3.17 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.6844710680000006, 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024358715999999999, 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.914 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1216 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185142+0000", 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7000000000000002e-06 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189137+0000", 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039947480000000002 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189170+0000", 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3402999999999999e-05 2024-09-10T15:26:36.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189188+0000", 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7385999999999999e-05 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189357+0000", 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016903299999999999 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189760+0000", 2024-09-10T15:26:36.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040378099999999998 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.190175+0000", 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041465300000000002 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.205685+0000", 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015510098 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209323+0000", 2024-09-10T15:26:36.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036379149999999998 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209424+0000", 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101303 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209497+0000", 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2695999999999997e-05 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1222 3.23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.6162675499999999, 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029186541999999999, 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1222 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253345+0000", 2024-09-10T15:26:36.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.954e-06 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257398+0000", 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040527439999999996 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257431+0000", 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3513000000000003e-05 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257447+0000", 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6022e-05 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257579+0000", 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000132187 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257866+0000", 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028712300000000002 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258110+0000", 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243248 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269782+0000", 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011672342 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282341+0000", 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012558613 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282439+0000", 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8688000000000001e-05 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282528+0000", 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9108000000000001e-05 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.925 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1231 3.0 3:016afb57:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.205486273, 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017421782, 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1231 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664127+0000", 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3000000000000002e-06 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669087+0000", 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049601000000000003 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669128+0000", 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1362000000000001e-05 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669146+0000", 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7663e-05 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669294+0000", 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014813000000000001 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669544+0000", 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025002100000000001 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669770+0000", 2024-09-10T15:26:36.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022583400000000001 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.680977+0000", 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011207178 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681448+0000", 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047145500000000002 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681500+0000", 2024-09-10T15:26:36.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1264000000000002e-05 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681545+0000", 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5475000000000001e-05 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1241 3.29 3:97ec7333:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:36.931 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.1022080659999993, 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018815331000000001, 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1241 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:36.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767404+0000", 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2259999999999999e-06 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771530+0000", 2024-09-10T15:26:36.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041263999999999997 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771574+0000", 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4143000000000001e-05 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771594+0000", 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9409e-05 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771685+0000", 2024-09-10T15:26:36.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1252e-05 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771798+0000", 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113206 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771894+0000", 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.611e-05 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778783+0000", 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068883809999999998 2024-09-10T15:26:36.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786070+0000", 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072874050000000003 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786158+0000", 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7947000000000003e-05 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786217+0000", 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8851999999999998e-05 2024-09-10T15:26:36.936 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1242 3.38 3:1d12f6dd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.0913348000000003, 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024298450999999999, 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.937 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1242 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778277+0000", 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5639999999999999e-06 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783335+0000", 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050581660000000002 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783370+0000", 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5012999999999998e-05 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783400+0000", 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9142e-05 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783528+0000", 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012881700000000001 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783864+0000", 2024-09-10T15:26:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00033515200000000002 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.784288+0000", 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042494000000000001 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.798794+0000", 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014505980999999999 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802363+0000", 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035688579999999998 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802491+0000", 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012784299999999999 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802573+0000", 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1975e-05 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1243 3.22 e62/23 3:456b4d20:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_14:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.0775740369999998, 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017000360999999999, 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792038+0000", 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.097e-06 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797587+0000", 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055492659999999997 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797619+0000", 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2372000000000001e-05 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797635+0000", 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.575e-05 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797769+0000", 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013404000000000001 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797830+0000", 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0835000000000003e-05 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.808891+0000", 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011061161 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.809036+0000", 2024-09-10T15:26:36.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014484 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1353 3.4 e63/23 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.5636638830000003, 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015921056999999999, 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305948+0000", 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:36.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309743+0000", 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037948280000000001 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309783+0000", 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0039000000000001e-05 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309815+0000", 2024-09-10T15:26:36.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2316e-05 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309987+0000", 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017165299999999999 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.310052+0000", 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4931999999999994e-05 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.321702+0000", 2024-09-10T15:26:36.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01165007 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.321867+0000", 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016470300000000001 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1355 3.3d 3:bf2d92a6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.5489592569999999, 2024-09-10T15:26:36.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020864745000000001, 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1355 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320655+0000", 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3540000000000002e-06 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326192+0000", 2024-09-10T15:26:36.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055377869999999997 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326232+0000", 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0012999999999998e-05 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326251+0000", 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8975e-05 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326396+0000", 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014415399999999999 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326561+0000", 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016593099999999999 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326707+0000", 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014573599999999999 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.333446+0000", 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067385800000000001 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341424+0000", 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079780619999999993 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341474+0000", 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0661999999999997e-05 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341515+0000", 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0491000000000002e-05 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1363 3.1f 3:f8d0acf1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.4595847639999997, 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020666087999999999, 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.957 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1363 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410030+0000", 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9660000000000004e-06 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414404+0000", 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043742260000000002 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414446+0000", 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1579000000000003e-05 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414472+0000", 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414682+0000", 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020987600000000001 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414921+0000", 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000239304 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.415143+0000", 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221776 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424445+0000", 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093022169999999998 2024-09-10T15:26:36.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430518+0000", 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006072694 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430615+0000", 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7725000000000004e-05 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430691+0000", 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5581999999999996e-05 2024-09-10T15:26:36.962 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1377 3.3e 3:7f7ea93f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.2896076289999998, 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017764525999999999, 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.963 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1377 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580004+0000", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.181e-06 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583837+0000", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038328939999999999 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583867+0000", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0301e-05 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583878+0000", 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1226999999999999e-05 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583952+0000", 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3411000000000006e-05 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584114+0000", 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016212400000000001 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:36.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584554+0000", 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044031700000000002 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.591179+0000", 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0066242760000000001 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597670+0000", 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0064910439999999996 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597727+0000", 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7361999999999997e-05 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597766+0000", 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9388999999999998e-05 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1394 3.23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:36.968 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6761155649999999, 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.043242203, 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1394 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:36.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193497+0000", 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1949999999999999e-06 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197756+0000", 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042592400000000001 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197790+0000", 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3831999999999997e-05 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197824+0000", 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3818e-05 2024-09-10T15:26:36.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197899+0000", 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5414000000000007e-05 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197905+0000", 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000003e-06 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.201937+0000", 2024-09-10T15:26:36.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040326889999999999 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202120+0000", 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182704 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202312+0000", 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019223299999999999 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.228030+0000", 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025717357999999999 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236643+0000", 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086134929999999998 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236699+0000", 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5407e-05 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236736+0000", 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7545000000000001e-05 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1395 3.18 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6672449169999997, 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033860491999999999, 2024-09-10T15:26:36.975 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1395 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202366+0000", 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.725e-06 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208089+0000", 2024-09-10T15:26:36.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057225280000000002 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208111+0000", 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663999999999998e-05 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208125+0000", 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3516000000000001e-05 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208199+0000", 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3677000000000006e-05 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208309+0000", 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011049599999999999 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208403+0000", 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4056999999999997e-05 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233736+0000", 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025333248999999999 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236043+0000", 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00230693 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236146+0000", 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102954 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236225+0000", 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8695999999999993e-05 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1403 3.1e 3:7aef99fe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.5271661139999999, 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021656937000000001, 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:36.981 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1403 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342447+0000", 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5260000000000002e-06 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346589+0000", 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041420600000000004 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346633+0000", 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3578999999999997e-05 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346652+0000", 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9177e-05 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346780+0000", 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012826999999999999 2024-09-10T15:26:36.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347012+0000", 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023154499999999999 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347236+0000", 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224429 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.353199+0000", 2024-09-10T15:26:36.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059633519999999999 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.363980+0000", 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010780811 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364047+0000", 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6611000000000003e-05 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:36.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364100+0000", 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3576999999999999e-05 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:36.987 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:36.988 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:36.989 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:36.982+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:37.089 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:37.086+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:37.161 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:37.161 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:37.161 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:37.161 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:37.175 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:37.185 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:26:37.225 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:37.222+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:37.291 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:37.286+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:37.293 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:37.293 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:37.293 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:37.294 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:37.294 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:37.307 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:37.391 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:37.390+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:37.478 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 81.634565174000002, 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.483 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.398086141, 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:37.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1188 3.25 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.216956489999999, 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019443585999999999, 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.489 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1188 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257377+0000", 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8700000000000001e-06 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261294+0000", 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039172979999999996 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261328+0000", 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3353999999999999e-05 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261342+0000", 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4174e-05 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261424+0000", 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2427000000000002e-05 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261555+0000", 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000130908 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261671+0000", 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115624 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.268433+0000", 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067620909999999996 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276721+0000", 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082879170000000005 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276771+0000", 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0328000000000003e-05 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276818+0000", 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6594999999999997e-05 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.494 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.146954835000001, 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.495 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.496 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:37.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.500 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1193 3.15 e62/23 3:a820acfb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_20:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.095800801999999, 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014435465, 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378532+0000", 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6980000000000001e-06 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383652+0000", 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051201090000000003 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383673+0000", 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1319e-05 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383684+0000", 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0899e-05 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383770+0000", 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6142000000000003e-05 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383802+0000", 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2295000000000002e-05 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392895+0000", 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090925280000000008 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392965+0000", 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0475000000000005e-05 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.4383812339999995, 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:37.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:37.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:37.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.510 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.4191116949999998, 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:37.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.2785686950000006, 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.517 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:37.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:37.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1223 3.24 3:24dc70f2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.2053115660000007, 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017503632000000002, 2024-09-10T15:26:37.523 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1223 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269022+0000", 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272893+0000", 2024-09-10T15:26:37.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038702099999999998 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272926+0000", 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3612000000000003e-05 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272944+0000", 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8043e-05 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273031+0000", 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6278000000000003e-05 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273152+0000", 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121564 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273254+0000", 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101519 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.280527+0000", 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072731979999999998 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286154+0000", 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005627656 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286358+0000", 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020398200000000001 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286523+0000", 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016425000000000001 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1224 3.1 3:83c983e8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.1952782099999997, 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017784127, 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.529 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1224 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:37.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279076+0000", 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3538000000000001e-05 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282896+0000", 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038197539999999999 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282917+0000", 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1274e-05 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282928+0000", 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1032999999999999e-05 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283047+0000", 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011906899999999999 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283274+0000", 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000226994 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283497+0000", 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022311499999999999 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.291660+0000", 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081630839999999993 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296660+0000", 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049993119999999997 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296759+0000", 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9698000000000007e-05 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296837+0000", 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7255999999999994e-05 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.534 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.1741465199999999, 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.535 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.0099458090000004, 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:37.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:37.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.0008951259999996, 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.545 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:37.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:37.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1370 3.12 3:49cd0d62:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.9791121499999997, 2024-09-10T15:26:37.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018546729000000001, 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1370 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495230+0000", 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1396999999999999e-05 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499293+0000", 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040634 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499311+0000", 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8114e-05 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499320+0000", 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0329999999999997e-06 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499392+0000", 2024-09-10T15:26:37.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1928000000000007e-05 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499531+0000", 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013831999999999999 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499658+0000", 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012751900000000001 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509514+0000", 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098560490000000004 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513599+0000", 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040848880000000001 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513689+0000", 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9530000000000005e-05 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513765+0000", 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6551000000000006e-05 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1371 3.1 3:823dae61:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.96437682, 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019092687000000001, 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.555 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1371 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509956+0000", 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.215e-06 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514247+0000", 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042912860000000001 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514261+0000", 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3957e-05 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514269+0000", 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.593e-06 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514335+0000", 2024-09-10T15:26:37.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5692999999999996e-05 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514511+0000", 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017681700000000001 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514695+0000", 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018357000000000001 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.521453+0000", 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067582440000000001 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528786+0000", 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073324499999999999 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528929+0000", 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014385400000000001 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.529046+0000", 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000117008 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1372 3.1 3:83c0d5fc:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.9547226039999996, 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017231015999999998, 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.561 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1372 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519610+0000", 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9230000000000001e-06 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524843+0000", 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052327449999999996 2024-09-10T15:26:37.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524862+0000", 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9377000000000001e-05 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524872+0000", 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0308e-05 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524949+0000", 2024-09-10T15:26:37.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6465999999999996e-05 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.525144+0000", 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000194792 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.525317+0000", 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017317499999999999 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.534366+0000", 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090490669999999992 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536695+0000", 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023289029999999998 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536777+0000", 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2358e-05 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536839+0000", 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1902000000000005e-05 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1374 3.25 3:a5c592a7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.9298692580000001, 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018460776000000002, 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.567 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1374 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544495+0000", 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3989000000000003e-05 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548835+0000", 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043393219999999996 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548872+0000", 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7138999999999998e-05 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548890+0000", 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8006999999999999e-05 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549005+0000", 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115166 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549217+0000", 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021217 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549415+0000", 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019820999999999999 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562491+0000", 2024-09-10T15:26:37.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013075765 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562833+0000", 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034160000000000001 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562881+0000", 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8439000000000002e-05 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562922+0000", 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0969e-05 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.452726975, 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.573 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:37.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.2656960220000002, 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:37.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:37.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:37.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.237282854, 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.583 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:37.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:37.589 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.589 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.589 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.589 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.589 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.589 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:37.590 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:37.591 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:37.590+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:37.692 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:37.690+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1665 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.012040258999999999, 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012100951, 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "started", 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:37.727 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1665 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:37.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714988+0000", 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9999999999999995e-07 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714992+0000", 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.233e-06 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:37.729 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715005+0000", 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2272999999999999e-05 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715014+0000", 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8629999999999997e-06 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.720909+0000", 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058948999999999998 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:37.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.721218+0000", 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030987099999999997 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 1 2024-09-10T15:26:37.731 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:37.744 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:37.792 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:37.790+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:37.860 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:37.860 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:37.860 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:37.860 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:37.860 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:37.875 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:37.909 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:37.925 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:37.918+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:37.994 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:37.990+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:38.001 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.055453586, 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.002 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:38.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1205 3.23 e62/23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.9826354649999995, 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014669375, 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.008 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015688+0000", 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.993e-06 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017637+0000", 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019491269999999999 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017679+0000", 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2738999999999999e-05 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017706+0000", 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6395999999999999e-05 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017927+0000", 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221241 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017968+0000", 2024-09-10T15:26:38.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1213e-05 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030244+0000", 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012276001999999999 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030354+0000", 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109664 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1206 3.c e62/23 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.9706472060000007, 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015827707999999999, 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027675+0000", 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:38.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035053+0000", 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073779279999999997 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035089+0000", 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5979000000000002e-05 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035105+0000", 2024-09-10T15:26:38.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6290000000000002e-05 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035198+0000", 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2367000000000005e-05 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035217+0000", 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9066e-05 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043398+0000", 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081812329999999996 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043501+0000", 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010237499999999999 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1207 3.25 e62/23 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.9572520739999995, 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014971961000000001, 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.018 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041070+0000", 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.019 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043463+0000", 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023929699999999999 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043496+0000", 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3506000000000001e-05 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043518+0000", 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1806000000000001e-05 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.020 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043666+0000", 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000147913 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043705+0000", 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9199000000000002e-05 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055912+0000", 2024-09-10T15:26:38.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012207310000000001 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056040+0000", 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012743699999999999 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:38.022 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.8751799840000007, 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.023 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:38.025 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:38.026 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.027 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:38.028 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.8493561889999999, 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.029 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.030 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:38.031 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.032 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.033 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.034 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7399729369999992, 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.035 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.036 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.037 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:38.038 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1225 3.8 e62/23 3:12daa5c3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_24:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.295613+0000", 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7027069279999996, 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014544065, 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295613+0000", 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295613+0000", 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295615+0000", 2024-09-10T15:26:38.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0279999999999999e-06 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298554+0000", 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0029391349999999998 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298603+0000", 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9122999999999997e-05 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298631+0000", 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7566e-05 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298749+0000", 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118557 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.298776+0000", 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6587000000000001e-05 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310049+0000", 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011273025000000001 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310157+0000", 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108044 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.6840539440000004, 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:38.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:38.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.050 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1237 3.b 3:d20aacec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.2730211689999997, 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017229367999999998, 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.051 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1237 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725302+0000", 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2480000000000001e-06 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729641+0000", 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043387460000000001 2024-09-10T15:26:38.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729670+0000", 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.955e-05 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729684+0000", 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3172e-05 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729774+0000", 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0729999999999994e-05 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729975+0000", 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000200504 2024-09-10T15:26:38.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730111+0000", 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013626099999999999 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.740994+0000", 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010883163 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742446+0000", 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014518560000000001 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742485+0000", 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742528+0000", 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2873000000000001e-05 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.057 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1240 3.2e 3:74a4e6e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.2415310700000006, 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016415019999999999, 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1240 2024-09-10T15:26:38.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756792+0000", 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7630000000000001e-06 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760797+0000", 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004004896 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760840+0000", 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3618999999999997e-05 2024-09-10T15:26:38.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760859+0000", 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9032e-05 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760952+0000", 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2856999999999995e-05 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761077+0000", 2024-09-10T15:26:38.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125327 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761176+0000", 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8424999999999994e-05 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767159+0000", 2024-09-10T15:26:38.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059834450000000004 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773081+0000", 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059217380000000002 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773150+0000", 2024-09-10T15:26:38.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.9305000000000001e-05 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773204+0000", 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3613000000000003e-05 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:38.064 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.5978181469999999, 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:26:38.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:38.069 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.5738422539999997, 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.072 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:26:38.074 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.075 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:26:38.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.077 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.078 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1365 3.8 e63/23 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.444284+0000", 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.5540361369999998, 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015389119999999999, 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444284+0000", 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444284+0000", 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444286+0000", 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2390000000000001e-06 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447713+0000", 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034268789999999999 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447739+0000", 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5633e-05 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447751+0000", 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2693e-05 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447836+0000", 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4460000000000001e-05 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447864+0000", 2024-09-10T15:26:38.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8728999999999999e-05 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459610+0000", 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011745692 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459673+0000", 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2794999999999998e-05 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.083 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1369 3.3 3:c1f9dd82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 6.5173723280000004, 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016568007999999999, 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.084 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1369 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480951+0000", 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1520000000000001e-06 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484789+0000", 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038383150000000001 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484816+0000", 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6546999999999998e-05 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484827+0000", 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1616e-05 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484923+0000", 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5519999999999993e-05 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.485075+0000", 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015246500000000001 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.485212+0000", 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013663299999999999 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495712+0000", 2024-09-10T15:26:38.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010500127 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497386+0000", 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016739260000000001 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497458+0000", 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2292000000000005e-05 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.089 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497516+0000", 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7414999999999998e-05 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.7953688860000003, 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.090 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.7785039060000001, 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.095 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:26:38.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:26:38.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.101 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.7395811490000002, 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:26:38.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:26:38.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:26:38.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:26:38.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:26:38.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.108 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.7274256770000003, 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:26:38.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:26:38.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:26:38.114 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1665 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.283332743, 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016081472999999999, 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "started", 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:38.115 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1665 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:38.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714988+0000", 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9999999999999995e-07 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714992+0000", 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.233e-06 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715005+0000", 2024-09-10T15:26:38.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2272999999999999e-05 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715014+0000", 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8629999999999997e-06 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.720909+0000", 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058948999999999998 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.721218+0000", 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030987099999999997 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.731069+0000", 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098503329999999993 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.119 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.120 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:38.120 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:38.120 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:38.121 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:38.121 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:38.122 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:38.122 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:38.123 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:38.124 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:38.124 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:38.124 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:38.125 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:38.125 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:38.125 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:38.126 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:38.118+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:38.134 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:38.134 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:38.155 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:38.155 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:38.177 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:38.178 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:38.178 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:26:38.223 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:38.218+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:38.248 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:38.248 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:38.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:38.323 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:38.318+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:38.419 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:38.420 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:38.424 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:38.422+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:38.434 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:38.525 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:38.518+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:38.600 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:38.601 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:38.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:38.658 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:38.658+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:38.726 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:38.722+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:38.728 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:38.728 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:38.742 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:38.830 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:38.830+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:38.913 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:38.913 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:38.926 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:38.970 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:38.970+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:39.029 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:39.022+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:39.093 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:39.094 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:39.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:39.154 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:39.154+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:39.230 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:39.230+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:39.233 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:39.233 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:39.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:39.331 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:39.326+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:39.414 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:39.414 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:39.427 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:39.474 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:39.474+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:39.533 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:39.530+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:39.553 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:39.553 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:39.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:39.634 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:39.634+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:39.729 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:39.729 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:39.735 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:39.734+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:39.743 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:39.836 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:39.834+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:39.908 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:39.908 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:39.921 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:39.966 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:39.966+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:40.038 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:40.034+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:40.092 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:40.092 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:40.105 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:40.149 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:40.146+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:40.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:40.201 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:26:40.239 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:40.239 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:40.246 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:40.246+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:40.252 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:40.336 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:40.337 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:40.340 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:40.338+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:40.355 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:40.355 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:40.372 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:40.372 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:40.388 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:40.388 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:40.408 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:40.408 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:40.423 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:40.423 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:40.423 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:40.423 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:40.424 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:40.428 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:40.428 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:40.438 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:40.440 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:40.438+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:40.448 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:40.449 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:40.469 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:40.469 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:40.541 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:40.538+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:40.557 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:40.557 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:40.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:40.557 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:40.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.557 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1177 3.3a e62/23 3:5f641ecd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_4:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.513821902, 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020497457, 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041372+0000", 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.041404+0000", 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1856000000000001e-05 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050019+0000", 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086145660000000006 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050058+0000", 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9289000000000003e-05 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050081+0000", 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2748999999999999e-05 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050218+0000", 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013712300000000001 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.050239+0000", 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0784999999999998e-05 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.061763+0000", 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011523805 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.061870+0000", 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107284 2024-09-10T15:26:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1181 3.19 3:98ecfd30:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.450466887999999, 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024964212, 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.562 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1181 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104732+0000", 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2200000000000003e-06 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111913+0000", 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00718171 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111956+0000", 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2855999999999998e-05 2024-09-10T15:26:40.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111988+0000", 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1415999999999999e-05 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112135+0000", 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014741600000000001 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112393+0000", 2024-09-10T15:26:40.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025839 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112642+0000", 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024873400000000002 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.125741+0000", 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013098487000000001 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129377+0000", 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036366760000000001 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129582+0000", 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020458499999999999 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129692+0000", 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109722 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1182 3.2b 3:d6877f0f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.428479809000001, 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023699754999999999, 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1182 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.568 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126718+0000", 2024-09-10T15:26:40.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131768+0000", 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050503650000000002 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131795+0000", 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7361000000000001e-05 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131809+0000", 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4106e-05 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131933+0000", 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012341500000000001 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132188+0000", 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025496999999999998 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132440+0000", 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025235399999999999 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.145720+0000", 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013279699000000001 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150294+0000", 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045736780000000003 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150348+0000", 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4840999999999999e-05 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150414+0000", 2024-09-10T15:26:40.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5763e-05 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1186 3.2b 3:d6908ca0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.341338863000001, 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021761591, 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.574 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1186 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213858+0000", 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8159999999999998e-06 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217781+0000", 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039231550000000002 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217819+0000", 2024-09-10T15:26:40.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7577000000000003e-05 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217831+0000", 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1751e-05 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217955+0000", 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124017 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218199+0000", 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024441099999999999 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218430+0000", 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230461 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.227085+0000", 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086550289999999998 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235393+0000", 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083088959999999996 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235489+0000", 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5778000000000004e-05 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235617+0000", 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012769999999999999 2024-09-10T15:26:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1194 3.1b 3:db05cc66:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.155039690000001, 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019807701, 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1194 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400155+0000", 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.400157+0000", 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4650000000000001e-06 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404841+0000", 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046836760000000003 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404869+0000", 2024-09-10T15:26:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7920999999999999e-05 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404880+0000", 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0947999999999999e-05 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.404951+0000", 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1477999999999996e-05 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.405087+0000", 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000135704 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.405201+0000", 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011396 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.412024+0000", 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068235470000000001 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419890+0000", 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078657390000000001 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419930+0000", 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0253999999999998e-05 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.419962+0000", 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2008999999999998e-05 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1199 3.1b 3:dae099b0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.018384359000001, 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022241449999999999, 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1199 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.589 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536813+0000", 2024-09-10T15:26:40.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.54e-06 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540890+0000", 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040768100000000002 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540934+0000", 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4155e-05 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540954+0000", 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9366000000000001e-05 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541095+0000", 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014104699999999999 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541348+0000", 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025277999999999998 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541945+0000", 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059730099999999995 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.552388+0000", 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01044308 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.558941+0000", 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065525849999999997 2024-09-10T15:26:40.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559008+0000", 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7175000000000007e-05 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559051+0000", 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3611e-05 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1209 3.1b 3:d9c2a680:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.594 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.478608692, 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019290194, 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1209 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:40.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076586+0000", 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.076589+0000", 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084343+0000", 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077541559999999999 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084384+0000", 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1158999999999997e-05 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084410+0000", 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6308999999999998e-05 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084508+0000", 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7405999999999995e-05 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084634+0000", 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012651399999999999 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.084738+0000", 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010309700000000001 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.092599+0000", 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078618309999999997 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095801+0000", 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0032015960000000001 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095839+0000", 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8535999999999998e-05 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.095876+0000", 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6269999999999997e-05 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1210 3.2b 3:d428ccbb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.4560455, 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024418312000000001, 2024-09-10T15:26:40.600 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1210 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099151+0000", 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.43e-06 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.103964+0000", 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048127949999999999 2024-09-10T15:26:40.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104006+0000", 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2391999999999997e-05 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104033+0000", 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.616e-05 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104145+0000", 2024-09-10T15:26:40.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011285099999999999 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104365+0000", 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021917 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104567+0000", 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020294399999999999 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.114085+0000", 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095177730000000002 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123440+0000", 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009354757 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123510+0000", 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0127000000000001e-05 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123567+0000", 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6913000000000002e-05 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1212 3.3a e62/23 3:5fff66ed:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_11:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.412667218999999, 2024-09-10T15:26:40.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014868973000000001, 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142527+0000", 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.142529+0000", 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2330000000000001e-06 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147323+0000", 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047936130000000004 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147363+0000", 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9765000000000003e-05 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147389+0000", 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6316e-05 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.609 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147498+0000", 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010914 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.147516+0000", 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8232000000000001e-05 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.157295+0000", 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097791570000000001 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.157396+0000", 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100517 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1225 3.8 3:12daa5c3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:40.611 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.265698134999999, 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021292011, 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1225 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289499+0000", 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3129999999999999e-06 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294420+0000", 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049203329999999998 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294459+0000", 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511999999999997e-05 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294478+0000", 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8369999999999999e-05 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294642+0000", 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164253 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295016+0000", 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000374201 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295405+0000", 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038931099999999999 2024-09-10T15:26:40.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.308446+0000", 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013040754 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310510+0000", 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020643010000000002 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310674+0000", 2024-09-10T15:26:40.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016396299999999999 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310788+0000", 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0001137 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1230 3.7 3:e0a54a53:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:40.617 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.903235699, 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020686421, 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1230 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651962+0000", 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656858+0000", 2024-09-10T15:26:40.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048953039999999996 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656897+0000", 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9345999999999999e-05 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656915+0000", 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7836e-05 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657097+0000", 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018200200000000001 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657504+0000", 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000407284 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657936+0000", 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043207599999999999 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.667656+0000", 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097194099999999995 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672492+0000", 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048363399999999997 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672577+0000", 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4812e-05 2024-09-10T15:26:40.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672645+0000", 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8077999999999994e-05 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1233 3.2b 3:d6e77df5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.871264685, 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018296130000000001, 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.623 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1233 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683930+0000", 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.683932+0000", 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.379e-06 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687803+0000", 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038709840000000001 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687829+0000", 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6480999999999999e-05 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687843+0000", 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3706999999999999e-05 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.687924+0000", 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0508999999999998e-05 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.688093+0000", 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169426 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.688245+0000", 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015193300000000001 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.695010+0000", 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067654489999999998 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702145+0000", 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0071349769999999998 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702188+0000", 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2833999999999997e-05 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.702226+0000", 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7450999999999998e-05 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.628 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1236 3.7 3:e25c0c35:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 11.839522200999999, 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017002278999999999, 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1236 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715672+0000", 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.715674+0000", 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3530000000000002e-06 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719555+0000", 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038807630000000002 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719580+0000", 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4649000000000001e-05 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719591+0000", 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0818999999999999e-05 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719661+0000", 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0203999999999994e-05 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719775+0000", 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011458199999999999 2024-09-10T15:26:40.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.719875+0000", 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9611999999999994e-05 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730347+0000", 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010472415000000001 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732512+0000", 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021641220000000001 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732607+0000", 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5049000000000004e-05 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.732674+0000", 2024-09-10T15:26:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7711000000000003e-05 2024-09-10T15:26:40.635 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.635 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.635 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1359 3.39 e63/23 3:9d7627ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_8:head v 63'1, mlcod=0'0)", 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.1900437749999995, 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015266238999999999, 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365150+0000", 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.365158+0000", 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.678e-06 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369551+0000", 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043930929999999998 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369581+0000", 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9713000000000002e-05 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369593+0000", 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2147000000000001e-05 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369679+0000", 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5947999999999998e-05 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.369701+0000", 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2306999999999998e-05 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.380245+0000", 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010543235999999999 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.380417+0000", 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017211700000000001 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1360 3.3a e63/23 3:5e523b29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_9:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.1808288079999993, 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016175763999999999, 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.640 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374365+0000", 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.374369+0000", 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0970000000000002e-06 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381916+0000", 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075478890000000003 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381949+0000", 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2892000000000003e-05 2024-09-10T15:26:40.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.381966+0000", 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6330000000000001e-05 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.382066+0000", 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100852 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.382103+0000", 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6291000000000002e-05 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.390438+0000", 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083354080000000007 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.390541+0000", 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010300499999999999 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1365 3.8 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.1202434409999995, 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025243808999999999, 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1365 2024-09-10T15:26:40.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434955+0000", 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7139999999999999e-06 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443391+0000", 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0084368099999999994 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443430+0000", 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8189000000000003e-05 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443446+0000", 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6900000000000001e-05 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443570+0000", 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012320399999999999 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443821+0000", 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025176099999999998 2024-09-10T15:26:40.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444043+0000", 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022190900000000001 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459249+0000", 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015206040000000001 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460027+0000", 2024-09-10T15:26:40.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077740299999999997 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460123+0000", 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6053999999999999e-05 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460195+0000", 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1824999999999998e-05 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1381 3.2b 3:d6ca9a27:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.6013278839999998, 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.028008075, 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1381 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.651 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953870+0000", 2024-09-10T15:26:40.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3569999999999998e-06 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957911+0000", 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040408420000000002 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957947+0000", 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6801999999999998e-05 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957965+0000", 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7473e-05 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958102+0000", 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137181 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958354+0000", 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025186400000000003 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958590+0000", 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000236445 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.970044+0000", 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011453502000000001 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981461+0000", 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011417418 2024-09-10T15:26:40.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981714+0000", 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000252434 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981874+0000", 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016075700000000001 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1383 3.39 e63/23 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head v 63'2, mlcod=0'0)", 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.993970+0000", 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.5612247010000004, 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016938682, 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.993970+0000", 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.993970+0000", 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.993972+0000", 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998058+0000", 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040860150000000001 2024-09-10T15:26:40.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998096+0000", 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7452e-05 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998113+0000", 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7776000000000001e-05 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998223+0000", 2024-09-10T15:26:40.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010963099999999999 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.998262+0000", 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8668999999999999e-05 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.010797+0000", 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012535121999999999 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.010908+0000", 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011144100000000001 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1387 3.2b 3:d54d5f84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.064699+0000", 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.4904954329999995, 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018141995000000001, 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.661 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1387 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.064699+0000", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.064699+0000", 2024-09-10T15:26:40.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.064701+0000", 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.339e-06 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068521+0000", 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038198519999999999 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068551+0000", 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0161000000000001e-05 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068570+0000", 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8941999999999999e-05 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068690+0000", 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012016800000000001 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.068949+0000", 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000258621 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.069175+0000", 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022640200000000001 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.080471+0000", 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011296082000000001 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.082674+0000", 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0022030779999999998 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.082766+0000", 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1294999999999999e-05 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.082841+0000", 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5055000000000006e-05 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.666 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1396 3.9 e64/23 3:90cc0258:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_17:head v 64'6, mlcod=63'4)", 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.3425496250000002, 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.030549334000000001, 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:40.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.39e-07 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.668 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217600+0000", 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049551860000000003 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217620+0000", 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9928e-05 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217629+0000", 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2660000000000007e-06 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217770+0000", 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000140798 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217836+0000", 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6278000000000005e-05 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243052+0000", 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025215339 2024-09-10T15:26:40.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243194+0000", 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014219999999999999 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:40.671 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:40.673 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:40.673 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:40.666+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:40.773 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:40.774+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:40.843 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:40.844 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:40.844 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:40.844 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:40.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:40.874 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:40.874+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:40.975 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:40.974+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:40.977 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:40.977 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:40.977 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:40.977 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:40.977 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:40.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:41.076 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:41.070+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:41.117 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:41.118 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:41.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:41.118 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:41.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.118 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1179 3.4 e62/23 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.030770835, 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016361245999999999, 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.119 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082867+0000", 2024-09-10T15:26:41.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082868+0000", 2024-09-10T15:26:41.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7300000000000005e-07 2024-09-10T15:26:41.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085770+0000", 2024-09-10T15:26:41.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002901945 2024-09-10T15:26:41.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085822+0000", 2024-09-10T15:26:41.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2089000000000002e-05 2024-09-10T15:26:41.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.124 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.085841+0000", 2024-09-10T15:26:41.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9119000000000001e-05 2024-09-10T15:26:41.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086000+0000", 2024-09-10T15:26:41.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015898999999999999 2024-09-10T15:26:41.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.086040+0000", 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9972000000000003e-05 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099137+0000", 2024-09-10T15:26:41.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013096813000000001 2024-09-10T15:26:41.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099228+0000", 2024-09-10T15:26:41.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1545000000000005e-05 2024-09-10T15:26:41.128 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.128 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.128 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.128 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1180 3.10 e62/23 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:41.129 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:41.129 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.01690792, 2024-09-10T15:26:41.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018493124, 2024-09-10T15:26:41.129 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.129 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.130 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.130 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:41.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:41.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096733+0000", 2024-09-10T15:26:41.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7499999999999999e-06 2024-09-10T15:26:41.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103771+0000", 2024-09-10T15:26:41.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070384489999999996 2024-09-10T15:26:41.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103806+0000", 2024-09-10T15:26:41.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4798999999999997e-05 2024-09-10T15:26:41.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103832+0000", 2024-09-10T15:26:41.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6013e-05 2024-09-10T15:26:41.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103956+0000", 2024-09-10T15:26:41.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124194 2024-09-10T15:26:41.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103998+0000", 2024-09-10T15:26:41.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1841999999999997e-05 2024-09-10T15:26:41.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115130+0000", 2024-09-10T15:26:41.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011132246 2024-09-10T15:26:41.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115223+0000", 2024-09-10T15:26:41.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2831000000000006e-05 2024-09-10T15:26:41.139 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.139 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.139 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.139 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.87788851, 2024-09-10T15:26:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:26:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.140 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.141 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.141 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.141 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.141 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:41.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.142 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.142 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:41.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:41.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:41.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:41.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:41.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:41.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:41.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:41.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:41.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:41.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:41.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:41.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:41.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:41.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:41.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:41.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:41.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:26:41.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:26:41.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:26:41.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:26:41.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:26:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:26:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1192 3.38 3:1fd275ab:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.761852013, 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01700991, 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.154 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1192 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351789+0000", 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.531e-06 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355811+0000", 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040222690000000002 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355839+0000", 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.864e-05 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355851+0000", 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1776e-05 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355926+0000", 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.4318000000000002e-05 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356068+0000", 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260999999999999 2024-09-10T15:26:41.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356198+0000", 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012937800000000001 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.364011+0000", 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078136939999999995 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368681+0000", 2024-09-10T15:26:41.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046692440000000003 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368733+0000", 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2085e-05 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368796+0000", 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3365000000000001e-05 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1195 3.3d 3:bc04a9f1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.690830432, 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016842467999999999, 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1195 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.162 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422810+0000", 2024-09-10T15:26:41.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1500000000000002e-06 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426623+0000", 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038136469999999999 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426651+0000", 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7543e-05 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426662+0000", 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0937999999999999e-05 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426734+0000", 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2465000000000005e-05 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426849+0000", 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011429099999999999 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426960+0000", 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111266 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.437403+0000", 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010442811 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439351+0000", 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019481609999999999 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439523+0000", 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000172549 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439650+0000", 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126647 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.167 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1205 3.23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.102815242, 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020233378, 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1205 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010826+0000", 2024-09-10T15:26:41.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.689e-06 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015077+0000", 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042514229999999998 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015112+0000", 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5275999999999999e-05 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015134+0000", 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1687000000000001e-05 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015257+0000", 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012268500000000001 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015400+0000", 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014325300000000001 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015516+0000", 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115757 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030382+0000", 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014866890000000001 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030952+0000", 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00056960500000000005 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031011+0000", 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8972999999999999e-05 2024-09-10T15:26:41.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031056+0000", 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5139999999999998e-05 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1215 3.1f 3:faffbb4f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.940423523, 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018963486000000002, 2024-09-10T15:26:41.174 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1215 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173218+0000", 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8929999999999998e-06 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177338+0000", 2024-09-10T15:26:41.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004119592 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177376+0000", 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7558999999999997e-05 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177394+0000", 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8277000000000001e-05 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177507+0000", 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011278299999999999 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177702+0000", 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019584299999999999 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177884+0000", 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000181134 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185658+0000", 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077739660000000002 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.191981+0000", 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063235940000000001 2024-09-10T15:26:41.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192071+0000", 2024-09-10T15:26:41.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0051999999999998e-05 2024-09-10T15:26:41.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192178+0000", 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679300000000001 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.182 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1216 3.17 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.182 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:41.182 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.928499636, 2024-09-10T15:26:41.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024358715999999999, 2024-09-10T15:26:41.182 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.183 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.183 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.183 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.183 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.183 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.183 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1216 2024-09-10T15:26:41.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.184 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:41.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185142+0000", 2024-09-10T15:26:41.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7000000000000002e-06 2024-09-10T15:26:41.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189137+0000", 2024-09-10T15:26:41.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039947480000000002 2024-09-10T15:26:41.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189170+0000", 2024-09-10T15:26:41.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3402999999999999e-05 2024-09-10T15:26:41.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189188+0000", 2024-09-10T15:26:41.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7385999999999999e-05 2024-09-10T15:26:41.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189357+0000", 2024-09-10T15:26:41.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016903299999999999 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189760+0000", 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040378099999999998 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:41.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.190175+0000", 2024-09-10T15:26:41.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041465300000000002 2024-09-10T15:26:41.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.205685+0000", 2024-09-10T15:26:41.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015510098 2024-09-10T15:26:41.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209323+0000", 2024-09-10T15:26:41.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036379149999999998 2024-09-10T15:26:41.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209424+0000", 2024-09-10T15:26:41.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101303 2024-09-10T15:26:41.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209497+0000", 2024-09-10T15:26:41.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2695999999999997e-05 2024-09-10T15:26:41.194 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.195 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.195 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.195 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1222 3.23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.195 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:41.196 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.860296118000001, 2024-09-10T15:26:41.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029186541999999999, 2024-09-10T15:26:41.196 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.196 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.196 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.197 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.197 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.197 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.197 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1222 2024-09-10T15:26:41.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.197 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:41.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:41.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253345+0000", 2024-09-10T15:26:41.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.954e-06 2024-09-10T15:26:41.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257398+0000", 2024-09-10T15:26:41.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040527439999999996 2024-09-10T15:26:41.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257431+0000", 2024-09-10T15:26:41.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3513000000000003e-05 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257447+0000", 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6022e-05 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257579+0000", 2024-09-10T15:26:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000132187 2024-09-10T15:26:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257866+0000", 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028712300000000002 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258110+0000", 2024-09-10T15:26:41.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243248 2024-09-10T15:26:41.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269782+0000", 2024-09-10T15:26:41.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011672342 2024-09-10T15:26:41.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282341+0000", 2024-09-10T15:26:41.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012558613 2024-09-10T15:26:41.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282439+0000", 2024-09-10T15:26:41.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8688000000000001e-05 2024-09-10T15:26:41.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282528+0000", 2024-09-10T15:26:41.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9108000000000001e-05 2024-09-10T15:26:41.208 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.208 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.208 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.209 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1231 3.0 3:016afb57:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.209 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:41.209 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.449514840999999, 2024-09-10T15:26:41.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017421782, 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1231 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664127+0000", 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3000000000000002e-06 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669087+0000", 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049601000000000003 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669128+0000", 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1362000000000001e-05 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669146+0000", 2024-09-10T15:26:41.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7663e-05 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669294+0000", 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014813000000000001 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669544+0000", 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025002100000000001 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669770+0000", 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022583400000000001 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.680977+0000", 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011207178 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681448+0000", 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047145500000000002 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681500+0000", 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1264000000000002e-05 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681545+0000", 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5475000000000001e-05 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1241 3.29 3:97ec7333:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:41.215 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.346236634, 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018815331000000001, 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1241 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767404+0000", 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2259999999999999e-06 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771530+0000", 2024-09-10T15:26:41.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041263999999999997 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771574+0000", 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4143000000000001e-05 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771594+0000", 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9409e-05 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771685+0000", 2024-09-10T15:26:41.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1252e-05 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771798+0000", 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113206 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771894+0000", 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.611e-05 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778783+0000", 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068883809999999998 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786070+0000", 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072874050000000003 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786158+0000", 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7947000000000003e-05 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786217+0000", 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8851999999999998e-05 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1242 3.38 3:1d12f6dd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.335363367999999, 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024298450999999999, 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.221 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1242 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:41.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778277+0000", 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5639999999999999e-06 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783335+0000", 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050581660000000002 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783370+0000", 2024-09-10T15:26:41.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5012999999999998e-05 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783400+0000", 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9142e-05 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783528+0000", 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012881700000000001 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783864+0000", 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00033515200000000002 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.784288+0000", 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042494000000000001 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.798794+0000", 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014505980999999999 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802363+0000", 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035688579999999998 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802491+0000", 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012784299999999999 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802573+0000", 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1975e-05 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.226 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1243 3.22 e62/23 3:456b4d20:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_14:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.321602605000001, 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017000360999999999, 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792038+0000", 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.097e-06 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797587+0000", 2024-09-10T15:26:41.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055492659999999997 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797619+0000", 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2372000000000001e-05 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797635+0000", 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.575e-05 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797769+0000", 2024-09-10T15:26:41.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013404000000000001 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797830+0000", 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0835000000000003e-05 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.808891+0000", 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011061161 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.809036+0000", 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014484 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1353 3.4 e63/23 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.8076924509999994, 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015921056999999999, 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305946+0000", 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305948+0000", 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:41.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309743+0000", 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037948280000000001 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309783+0000", 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0039000000000001e-05 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309815+0000", 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2316e-05 2024-09-10T15:26:41.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.309987+0000", 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017165299999999999 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.310052+0000", 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.4931999999999994e-05 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.321702+0000", 2024-09-10T15:26:41.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01165007 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.321867+0000", 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016470300000000001 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1355 3.3d 3:bf2d92a6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7929878250000009, 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020864745000000001, 2024-09-10T15:26:41.235 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1355 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320655+0000", 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3540000000000002e-06 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326192+0000", 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055377869999999997 2024-09-10T15:26:41.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326232+0000", 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0012999999999998e-05 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326251+0000", 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8975e-05 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326396+0000", 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014415399999999999 2024-09-10T15:26:41.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326561+0000", 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016593099999999999 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326707+0000", 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014573599999999999 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.333446+0000", 2024-09-10T15:26:41.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067385800000000001 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341424+0000", 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079780619999999993 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341474+0000", 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0661999999999997e-05 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341515+0000", 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0491000000000002e-05 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1363 3.1f 3:f8d0acf1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7036133319999998, 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020666087999999999, 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.241 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1363 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410030+0000", 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9660000000000004e-06 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414404+0000", 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043742260000000002 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414446+0000", 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1579000000000003e-05 2024-09-10T15:26:41.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414472+0000", 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414682+0000", 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020987600000000001 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414921+0000", 2024-09-10T15:26:41.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000239304 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.415143+0000", 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221776 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424445+0000", 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093022169999999998 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430518+0000", 2024-09-10T15:26:41.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006072694 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430615+0000", 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7725000000000004e-05 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430691+0000", 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5581999999999996e-05 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1377 3.3e 3:7f7ea93f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.5336361969999999, 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017764525999999999, 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1377 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580004+0000", 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.181e-06 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583837+0000", 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038328939999999999 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583867+0000", 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0301e-05 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583878+0000", 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1226999999999999e-05 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583952+0000", 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3411000000000006e-05 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584114+0000", 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016212400000000001 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584554+0000", 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044031700000000002 2024-09-10T15:26:41.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.591179+0000", 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0066242760000000001 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597670+0000", 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0064910439999999996 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597727+0000", 2024-09-10T15:26:41.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7361999999999997e-05 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597766+0000", 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9388999999999998e-05 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1394 3.23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:41.252 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.9201441330000009, 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.043242203, 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1394 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:41.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193497+0000", 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1949999999999999e-06 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197756+0000", 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042592400000000001 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197790+0000", 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3831999999999997e-05 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197824+0000", 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3818e-05 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197899+0000", 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5414000000000007e-05 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197905+0000", 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000003e-06 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.201937+0000", 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040326889999999999 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202120+0000", 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182704 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202312+0000", 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019223299999999999 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.228030+0000", 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025717357999999999 2024-09-10T15:26:41.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236643+0000", 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086134929999999998 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236699+0000", 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5407e-05 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236736+0000", 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7545000000000001e-05 2024-09-10T15:26:41.258 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1395 3.18 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.9112734850000006, 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033860491999999999, 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.259 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1395 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202366+0000", 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.725e-06 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208089+0000", 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057225280000000002 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208111+0000", 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663999999999998e-05 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208125+0000", 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3516000000000001e-05 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208199+0000", 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3677000000000006e-05 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208309+0000", 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011049599999999999 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208403+0000", 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4056999999999997e-05 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233736+0000", 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025333248999999999 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236043+0000", 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00230693 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236146+0000", 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102954 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236225+0000", 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8695999999999993e-05 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1403 3.1e 3:7aef99fe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:41.264 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.7711946820000009, 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021656937000000001, 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1403 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342447+0000", 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5260000000000002e-06 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346589+0000", 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041420600000000004 2024-09-10T15:26:41.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346633+0000", 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3578999999999997e-05 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346652+0000", 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9177e-05 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346780+0000", 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012826999999999999 2024-09-10T15:26:41.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347012+0000", 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023154499999999999 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347236+0000", 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224429 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.353199+0000", 2024-09-10T15:26:41.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059633519999999999 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.363980+0000", 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010780811 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364047+0000", 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6611000000000003e-05 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.269 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364100+0000", 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3576999999999999e-05 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.270 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:41.271 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:41.272 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:41.270+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:41.372 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:41.366+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:41.387 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_25: 100Mb.10 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 2024-09-10T15:26:41.396 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 2024-09-10T15:26:41.397 INFO:tasks.workunit.client.0.smithi099.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T15:26:41.397 INFO:tasks.workunit.client.0.smithi099.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-09-10T15:26:41.397 INFO:tasks.workunit.client.0.smithi099.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T15:26:41.441 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:41.441 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:41.441 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:41.441 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:41.455 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:41.498 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:41.494+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:41.574 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:41.574+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:41.629 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:41.629 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:41.629 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:41.629 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:41.629 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:41.645 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:41.675 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:41.674+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:41.741 INFO:tasks.workunit.client.0.smithi099.stdout:user 0.646502013857575 deleted 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4355.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e28)", 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 85.931214143999995, 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016605145000000002, 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.773 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "reached pg", 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4355", 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/2565047345", 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.774 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839765+0000", 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839769+0000", 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1429999999999998e-06 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839783+0000", 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4037e-05 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.775 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839811+0000", 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8195999999999999e-05 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839838+0000", 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6706000000000001e-05 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.839990+0000", 2024-09-10T15:26:41.776 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015252199999999999 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.840001+0000", 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1199999999999999e-05 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841399+0000", 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0013973659999999999 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for peered", 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.841417+0000", 2024-09-10T15:26:41.777 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8743e-05 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856112+0000", 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014694654 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:25:15.856371+0000", 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025857799999999998 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.778 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.694735111, 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:41.779 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.780 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:41.781 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:41.782 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.784 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1188 3.25 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.513605460000001, 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019443585999999999, 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1188 2024-09-10T15:26:41.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257377+0000", 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8700000000000001e-06 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261294+0000", 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039172979999999996 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261328+0000", 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3353999999999999e-05 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261342+0000", 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4174e-05 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261424+0000", 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2427000000000002e-05 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261555+0000", 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000130908 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261671+0000", 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115624 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.268433+0000", 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067620909999999996 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276721+0000", 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082879170000000005 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276771+0000", 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0328000000000003e-05 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276818+0000", 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6594999999999997e-05 2024-09-10T15:26:41.790 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.443603805, 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.791 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:41.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:41.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.794 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.794 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:41.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:41.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:41.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.798 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1193 3.15 e62/23 3:a820acfb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_20:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:41.799 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:41.799 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.392449771999999, 2024-09-10T15:26:41.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014435465, 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378530+0000", 2024-09-10T15:26:41.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.378532+0000", 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6980000000000001e-06 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383652+0000", 2024-09-10T15:26:41.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051201090000000003 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383673+0000", 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1319e-05 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383684+0000", 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0899e-05 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383770+0000", 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6142000000000003e-05 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.383802+0000", 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2295000000000002e-05 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392895+0000", 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090925280000000008 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.392965+0000", 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0475000000000005e-05 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.735030203999999, 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:41.804 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:41.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.808 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.808 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:41.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:41.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.808 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:41.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:41.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.715760664999999, 2024-09-10T15:26:41.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:41.813 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.813 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.813 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.816 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.816 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:41.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:41.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:41.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:41.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:41.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:41.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:41.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:41.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:41.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:41.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.575217665, 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.830 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:41.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:41.835 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1223 3.24 3:24dc70f2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.501960536, 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017503632000000002, 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.836 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1223 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269022+0000", 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272893+0000", 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038702099999999998 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272926+0000", 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3612000000000003e-05 2024-09-10T15:26:41.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272944+0000", 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8043e-05 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273031+0000", 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6278000000000003e-05 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273152+0000", 2024-09-10T15:26:41.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121564 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273254+0000", 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101519 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.280527+0000", 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072731979999999998 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286154+0000", 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005627656 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286358+0000", 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020398200000000001 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286523+0000", 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016425000000000001 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.841 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1224 3.1 3:83c983e8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.491927179999999, 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017784127, 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1224 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.842 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279076+0000", 2024-09-10T15:26:41.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3538000000000001e-05 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282896+0000", 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038197539999999999 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282917+0000", 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1274e-05 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282928+0000", 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1032999999999999e-05 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283047+0000", 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011906899999999999 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283274+0000", 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000226994 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283497+0000", 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022311499999999999 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.291660+0000", 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081630839999999993 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296660+0000", 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049993119999999997 2024-09-10T15:26:41.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296759+0000", 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9698000000000007e-05 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296837+0000", 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7255999999999994e-05 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.47079549, 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:41.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:41.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.853 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.306594778999999, 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:41.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:41.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:41.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:41.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.858 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.297544095999999, 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:41.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:41.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.863 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1370 3.12 3:49cd0d62:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.27576112, 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018546729000000001, 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1370 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495230+0000", 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1396999999999999e-05 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499293+0000", 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040634 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499311+0000", 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8114e-05 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499320+0000", 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0329999999999997e-06 2024-09-10T15:26:41.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499392+0000", 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1928000000000007e-05 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499531+0000", 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013831999999999999 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499658+0000", 2024-09-10T15:26:41.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012751900000000001 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509514+0000", 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098560490000000004 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513599+0000", 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040848880000000001 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513689+0000", 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9530000000000005e-05 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513765+0000", 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6551000000000006e-05 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.869 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1371 3.1 3:823dae61:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.26102579, 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019092687000000001, 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1371 2024-09-10T15:26:41.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509956+0000", 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.215e-06 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514247+0000", 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042912860000000001 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514261+0000", 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3957e-05 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514269+0000", 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.593e-06 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514335+0000", 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5692999999999996e-05 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514511+0000", 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017681700000000001 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514695+0000", 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018357000000000001 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.521453+0000", 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067582440000000001 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528786+0000", 2024-09-10T15:26:41.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073324499999999999 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528929+0000", 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014385400000000001 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.529046+0000", 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000117008 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1372 3.1 3:83c0d5fc:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.251371574, 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017231015999999998, 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.876 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1372 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519608+0000", 2024-09-10T15:26:41.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.519610+0000", 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9230000000000001e-06 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524843+0000", 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052327449999999996 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524862+0000", 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9377000000000001e-05 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524872+0000", 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0308e-05 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.524949+0000", 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6465999999999996e-05 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.525144+0000", 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000194792 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.525317+0000", 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017317499999999999 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.534366+0000", 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090490669999999992 2024-09-10T15:26:41.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536695+0000", 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023289029999999998 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536777+0000", 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2358e-05 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.536839+0000", 2024-09-10T15:26:41.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.1902000000000005e-05 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1374 3.25 3:a5c592a7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.226518228, 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018460776000000002, 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.882 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1374 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544495+0000", 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3989000000000003e-05 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548835+0000", 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043393219999999996 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548872+0000", 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7138999999999998e-05 2024-09-10T15:26:41.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548890+0000", 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8006999999999999e-05 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549005+0000", 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115166 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549217+0000", 2024-09-10T15:26:41.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021217 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549415+0000", 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019820999999999999 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562491+0000", 2024-09-10T15:26:41.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013075765 2024-09-10T15:26:41.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562833+0000", 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034160000000000001 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562881+0000", 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8439000000000002e-05 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562922+0000", 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0969e-05 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.888 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.7493759450000006, 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.889 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:41.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:41.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.5623449919999999, 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.895 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.899 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.5339318239999997, 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:41.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:41.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:41.907 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:41.902+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:41.909 INFO:tasks.workunit.client.0.smithi099.stdout:Bucket Created: buck_2024_08_10_15_26_41 2024-09-10T15:26:41.909 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 1 2024-09-10T15:26:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00883161 s, 1.2 GB/s 2024-09-10T15:26:42.008 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:42.006+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:42.024 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.1 2024-09-10T15:26:42.024 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.024 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 2 2024-09-10T15:26:42.037 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.038 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.038 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108596 s, 966 MB/s 2024-09-10T15:26:42.083 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:42.084 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:42.084 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:42.084 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:42.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:42.109 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:42.106+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:42.180 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.2 2024-09-10T15:26:42.180 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.180 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 3 2024-09-10T15:26:42.194 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.194 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.194 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118535 s, 885 MB/s 2024-09-10T15:26:42.210 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:42.210+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:42.224 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:42.224 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:42.225 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:42.225 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:42.225 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:42.236 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:42.258 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-10T15:26:42.258 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-10T15:26:42.258 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-09-10T15:26:42.258 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-10T15:26:42.258 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-10T15:26:42.258 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-09-10T15:26:42.311 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:42.306+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:42.333 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.3 2024-09-10T15:26:42.333 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.333 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 4 2024-09-10T15:26:42.345 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.346 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.346 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108286 s, 968 MB/s 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:42.371 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.424650479, 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:42.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:42.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:42.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1205 3.23 e62/23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:42.377 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.351832357999999, 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014669375, 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:42.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015685+0000", 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015688+0000", 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.993e-06 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017637+0000", 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019491269999999999 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017679+0000", 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2738999999999999e-05 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017706+0000", 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6395999999999999e-05 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017927+0000", 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221241 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.017968+0000", 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1213e-05 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030244+0000", 2024-09-10T15:26:42.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012276001999999999 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030354+0000", 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109664 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1206 3.c e62/23 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:42.382 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.339844099, 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015827707999999999, 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027675+0000", 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035053+0000", 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073779279999999997 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035089+0000", 2024-09-10T15:26:42.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5979000000000002e-05 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035105+0000", 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6290000000000002e-05 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035198+0000", 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2367000000000005e-05 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.385 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035217+0000", 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9066e-05 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043398+0000", 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081812329999999996 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043501+0000", 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010237499999999999 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.386 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1207 3.25 e62/23 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head v 62'3, mlcod=61'1)", 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.326448966999999, 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014971961000000001, 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:42.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041068+0000", 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.041070+0000", 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8199999999999999e-06 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043463+0000", 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023929699999999999 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043496+0000", 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3506000000000001e-05 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043518+0000", 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1806000000000001e-05 2024-09-10T15:26:42.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043666+0000", 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000147913 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043705+0000", 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9199000000000002e-05 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055912+0000", 2024-09-10T15:26:42.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012207310000000001 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056040+0000", 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012743699999999999 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.244376877000001, 2024-09-10T15:26:42.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:42.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:42.397 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.218553082, 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.398 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:42.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.403 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.109169830000001, 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:42.404 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.405 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.407 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.053250837, 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:42.408 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:42.410 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.411 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.412 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:42.413 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1237 3.b 3:d20aacec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.642218062, 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017229367999999998, 2024-09-10T15:26:42.414 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1237 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.415 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725302+0000", 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2480000000000001e-06 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729641+0000", 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043387460000000001 2024-09-10T15:26:42.416 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729670+0000", 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.955e-05 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729684+0000", 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3172e-05 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729774+0000", 2024-09-10T15:26:42.417 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0729999999999994e-05 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729975+0000", 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000200504 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730111+0000", 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013626099999999999 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.418 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.740994+0000", 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010883163 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742446+0000", 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014518560000000001 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742485+0000", 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:26:42.419 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742528+0000", 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2873000000000001e-05 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1240 3.2e 3:74a4e6e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.610727963, 2024-09-10T15:26:42.420 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016415019999999999, 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1240 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.421 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756792+0000", 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7630000000000001e-06 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760797+0000", 2024-09-10T15:26:42.422 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004004896 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760840+0000", 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3618999999999997e-05 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760859+0000", 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9032e-05 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760952+0000", 2024-09-10T15:26:42.423 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2856999999999995e-05 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761077+0000", 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125327 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761176+0000", 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8424999999999994e-05 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.424 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767159+0000", 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059834450000000004 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773081+0000", 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059217380000000002 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773150+0000", 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.9305000000000001e-05 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.425 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773204+0000", 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3613000000000003e-05 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.96701504, 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.426 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.427 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:26:42.428 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.429 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.431 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.943039147, 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.432 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:42.433 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.434 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.435 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.436 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.437 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1365 3.8 e63/23 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head v 63'3, mlcod=62'1)", 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.444284+0000", 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.92323303, 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015389119999999999, 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.438 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444284+0000", 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444284+0000", 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444286+0000", 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2390000000000001e-06 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.439 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447713+0000", 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0034268789999999999 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447739+0000", 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5633e-05 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447751+0000", 2024-09-10T15:26:42.440 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2693e-05 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447836+0000", 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4460000000000001e-05 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.447864+0000", 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8728999999999999e-05 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.441 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459610+0000", 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011745692 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459673+0000", 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2794999999999998e-05 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1369 3.3 3:c1f9dd82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:42.442 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.886569221, 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016568007999999999, 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1369 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:42.443 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480951+0000", 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1520000000000001e-06 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.444 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484789+0000", 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038383150000000001 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484816+0000", 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6546999999999998e-05 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484827+0000", 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1616e-05 2024-09-10T15:26:42.445 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484923+0000", 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5519999999999993e-05 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.485075+0000", 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015246500000000001 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.485212+0000", 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013663299999999999 2024-09-10T15:26:42.446 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495712+0000", 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010500127 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497386+0000", 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016739260000000001 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497458+0000", 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2292000000000005e-05 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.447 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497516+0000", 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7414999999999998e-05 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.164565779, 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.448 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.449 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.450 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.451 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.147700799000001, 2024-09-10T15:26:42.452 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.453 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:26:42.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:26:42.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:26:42.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.108778042000001, 2024-09-10T15:26:42.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:42.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:26:42.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:26:42.463 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:42.464 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 10.096622569999999, 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:26:42.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:26:42.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1665 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6525296359999997, 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016081472999999999, 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "started", 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1665 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.471 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714988+0000", 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9999999999999995e-07 2024-09-10T15:26:42.472 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714992+0000", 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.233e-06 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715005+0000", 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2272999999999999e-05 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715014+0000", 2024-09-10T15:26:42.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8629999999999997e-06 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.720909+0000", 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058948999999999998 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.721218+0000", 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030987099999999997 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.731069+0000", 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098503329999999993 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.39170265900000001, 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:42.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:26:42.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:42.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:42.479 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:42.480 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:42.482 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:42.482 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-10T15:26:42.482 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:42.482 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.4 2024-09-10T15:26:42.482 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.482 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 5 2024-09-10T15:26:42.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:42.483 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:42.478+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:42.486 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:42.493 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.493 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.493 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121656 s, 862 MB/s 2024-09-10T15:26:42.582 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:42.578+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:42.592 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.5 2024-09-10T15:26:42.592 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.592 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 6 2024-09-10T15:26:42.604 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.604 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.604 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103111 s, 1.0 GB/s 2024-09-10T15:26:42.632 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:42.633 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:42.633 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:42.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:42.649 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:42.649 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:42.670 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:42.671 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:42.683 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:42.678+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:42.691 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:42.692 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:42.708 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:42.708 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:42.715 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.6 2024-09-10T15:26:42.715 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.715 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 7 2024-09-10T15:26:42.726 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.726 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.726 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00911142 s, 1.2 GB/s 2024-09-10T15:26:42.729 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:42.729 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:42.750 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:42.750 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:42.772 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:42.773 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:42.775 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:42.775 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:42.784 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:42.778+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:42.796 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:42.797 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:42.797 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:42.821 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.7 2024-09-10T15:26:42.821 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.821 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 8 2024-09-10T15:26:42.831 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.831 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.832 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00927913 s, 1.1 GB/s 2024-09-10T15:26:42.885 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:42.882+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:42.921 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:42.921 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:42.934 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:42.936 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.8 2024-09-10T15:26:42.936 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:42.936 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 9 2024-09-10T15:26:42.947 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:42.947 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:42.947 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00917873 s, 1.1 GB/s 2024-09-10T15:26:42.986 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:42.982+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:43.051 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.9 2024-09-10T15:26:43.052 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.052 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 10 2024-09-10T15:26:43.060 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:43.060 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:43.064 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.064 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.064 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104974 s, 999 MB/s 2024-09-10T15:26:43.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:43.087 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:43.082+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:43.186 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.10 2024-09-10T15:26:43.186 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.186 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 11 2024-09-10T15:26:43.187 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:43.186+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:43.198 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.199 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.199 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108108 s, 970 MB/s 2024-09-10T15:26:43.245 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:43.245 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:43.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:43.302 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:43.302+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:43.317 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.11 2024-09-10T15:26:43.317 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.317 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 12 2024-09-10T15:26:43.330 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.330 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.331 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113686 s, 922 MB/s 2024-09-10T15:26:43.389 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:43.386+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:43.407 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:26:43.432 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:43.432 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:43.434 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.12 2024-09-10T15:26:43.435 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.435 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 13 2024-09-10T15:26:43.445 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.445 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.445 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00917123 s, 1.1 GB/s 2024-09-10T15:26:43.451 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:43.490 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:43.486+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:43.541 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.13 2024-09-10T15:26:43.542 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.542 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 14 2024-09-10T15:26:43.552 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.552 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.553 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00938245 s, 1.1 GB/s 2024-09-10T15:26:43.591 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:43.590+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:43.630 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:43.630 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:43.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:43.654 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.14 2024-09-10T15:26:43.654 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.654 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 15 2024-09-10T15:26:43.665 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.665 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.665 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0092298 s, 1.1 GB/s 2024-09-10T15:26:43.692 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:43.690+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:43.771 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.15 2024-09-10T15:26:43.771 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.771 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 16 2024-09-10T15:26:43.782 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.782 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.782 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00927481 s, 1.1 GB/s 2024-09-10T15:26:43.791 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:43.792 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:43.793 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:43.790+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:43.806 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:43.894 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:43.890+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:43.899 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.16 2024-09-10T15:26:43.899 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:43.899 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 17 2024-09-10T15:26:43.912 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:43.912 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:43.913 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113118 s, 927 MB/s 2024-09-10T15:26:43.983 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:43.983 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:43.995 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:43.990+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:43.997 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:44.039 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.17 2024-09-10T15:26:44.040 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.040 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 18 2024-09-10T15:26:44.052 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.052 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.052 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104678 s, 1.0 GB/s 2024-09-10T15:26:44.096 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:44.094+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:44.121 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:44.121 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:44.140 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:44.162 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.18 2024-09-10T15:26:44.162 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.162 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 19 2024-09-10T15:26:44.174 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.174 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.174 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108835 s, 963 MB/s 2024-09-10T15:26:44.197 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:44.194+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:44.281 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.19 2024-09-10T15:26:44.281 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.281 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 20 2024-09-10T15:26:44.293 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.293 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.293 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010701 s, 980 MB/s 2024-09-10T15:26:44.298 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:44.298+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:44.299 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:44.299 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:44.313 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:44.388 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:26:44.399 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:44.398+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:44.409 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.20 2024-09-10T15:26:44.409 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.409 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 21 2024-09-10T15:26:44.421 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.421 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.421 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103005 s, 1.0 GB/s 2024-09-10T15:26:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:44.497 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:44.500 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:44.494+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:44.517 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:44.546 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.21 2024-09-10T15:26:44.546 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.546 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 22 2024-09-10T15:26:44.557 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.557 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.557 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00936382 s, 1.1 GB/s 2024-09-10T15:26:44.601 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:44.594+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:44.645 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:44.646 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:44.661 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:44.698 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.22 2024-09-10T15:26:44.699 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.699 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 23 2024-09-10T15:26:44.702 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:44.701+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:44.714 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.714 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.714 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128965 s, 813 MB/s 2024-09-10T15:26:44.803 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:44.798+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:44.821 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:44.832 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:44.832 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:44.836 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.23 2024-09-10T15:26:44.836 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.837 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 24 2024-09-10T15:26:44.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:44.849 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.849 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.849 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110701 s, 947 MB/s 2024-09-10T15:26:44.934 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:44.930+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:44.961 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.24 2024-09-10T15:26:44.961 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:44.961 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 25 2024-09-10T15:26:44.970 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:44.971 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:44.971 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:44.971 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:44.971 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00913358 s, 1.1 GB/s 2024-09-10T15:26:44.988 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:44.988 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:45.004 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:45.001+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:45.006 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:45.007 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:45.020 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:45.020 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:45.028 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:45.028 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:45.035 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:45.049 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:45.049 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:45.066 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.25 2024-09-10T15:26:45.066 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.066 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 26 2024-09-10T15:26:45.075 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:45.076 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:45.077 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.077 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.077 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00921985 s, 1.1 GB/s 2024-09-10T15:26:45.094 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:45.094 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:45.104 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:45.101+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:45.116 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:45.116 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:45.176 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.26 2024-09-10T15:26:45.176 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.176 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 27 2024-09-10T15:26:45.188 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.188 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.188 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106867 s, 981 MB/s 2024-09-10T15:26:45.206 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:45.205+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:45.206 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:45.206 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:45.206 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:45.206 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:45.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:45.307 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:45.305+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:45.310 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.27 2024-09-10T15:26:45.310 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.310 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 28 2024-09-10T15:26:45.323 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.323 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.324 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112656 s, 931 MB/s 2024-09-10T15:26:45.349 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:45.349 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:45.350 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:45.350 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:45.350 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:45.364 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:45.409 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:45.405+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:45.449 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.28 2024-09-10T15:26:45.449 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.449 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 29 2024-09-10T15:26:45.465 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.465 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.466 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131519 s, 797 MB/s 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1180 3.10 e62/23 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:45.499 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.397574666000001, 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018493124, 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096733+0000", 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7499999999999999e-06 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103771+0000", 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070384489999999996 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103806+0000", 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4798999999999997e-05 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103832+0000", 2024-09-10T15:26:45.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6013e-05 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103956+0000", 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124194 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103998+0000", 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1841999999999997e-05 2024-09-10T15:26:45.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115130+0000", 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011132246 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115223+0000", 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2831000000000006e-05 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.504 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.258555256000001, 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.505 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.506 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:45.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:45.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:26:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.511 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1192 3.38 3:1fd275ab:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.142518759000001, 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01700991, 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.512 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1192 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:45.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351786+0000", 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.351789+0000", 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.531e-06 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355811+0000", 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040222690000000002 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355839+0000", 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.864e-05 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355851+0000", 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1776e-05 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.355926+0000", 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.4318000000000002e-05 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356068+0000", 2024-09-10T15:26:45.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260999999999999 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.356198+0000", 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012937800000000001 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.364011+0000", 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0078136939999999995 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368681+0000", 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046692440000000003 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368733+0000", 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2085e-05 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.368796+0000", 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3365000000000001e-05 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1195 3.3d 3:bc04a9f1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.071497178000001, 2024-09-10T15:26:45.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016842467999999999, 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1195 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422808+0000", 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.422810+0000", 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1500000000000002e-06 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426623+0000", 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038136469999999999 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426651+0000", 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7543e-05 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426662+0000", 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0937999999999999e-05 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426734+0000", 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2465000000000005e-05 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426849+0000", 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011429099999999999 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.426960+0000", 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111266 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.437403+0000", 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010442811 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.525 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439351+0000", 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019481609999999999 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439523+0000", 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000172549 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.439650+0000", 2024-09-10T15:26:45.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126647 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1205 3.23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.483481988000001, 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020233378, 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.527 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1205 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:45.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010826+0000", 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.689e-06 2024-09-10T15:26:45.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015077+0000", 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042514229999999998 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015112+0000", 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5275999999999999e-05 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015134+0000", 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1687000000000001e-05 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015257+0000", 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012268500000000001 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015400+0000", 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014325300000000001 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015516+0000", 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115757 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030382+0000", 2024-09-10T15:26:45.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014866890000000001 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030952+0000", 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00056960500000000005 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031011+0000", 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8972999999999999e-05 2024-09-10T15:26:45.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031056+0000", 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5139999999999998e-05 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1215 3.1f 3:faffbb4f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:45.534 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.321090268999999, 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018963486000000002, 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1215 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173218+0000", 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8929999999999998e-06 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177338+0000", 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004119592 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177376+0000", 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7558999999999997e-05 2024-09-10T15:26:45.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177394+0000", 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8277000000000001e-05 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177507+0000", 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011278299999999999 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177702+0000", 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019584299999999999 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177884+0000", 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000181134 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185658+0000", 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077739660000000002 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.191981+0000", 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063235940000000001 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192071+0000", 2024-09-10T15:26:45.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0051999999999998e-05 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192178+0000", 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679300000000001 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1216 3.17 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.541 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.309166382000001, 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024358715999999999, 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1216 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185142+0000", 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7000000000000002e-06 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189137+0000", 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039947480000000002 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189170+0000", 2024-09-10T15:26:45.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3402999999999999e-05 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189188+0000", 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7385999999999999e-05 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189357+0000", 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016903299999999999 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189760+0000", 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040378099999999998 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.190175+0000", 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041465300000000002 2024-09-10T15:26:45.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.205685+0000", 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015510098 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209323+0000", 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036379149999999998 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209424+0000", 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101303 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209497+0000", 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2695999999999997e-05 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.548 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1222 3.23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.240962864, 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029186541999999999, 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.549 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1222 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253345+0000", 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.954e-06 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257398+0000", 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040527439999999996 2024-09-10T15:26:45.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257431+0000", 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3513000000000003e-05 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257447+0000", 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6022e-05 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257579+0000", 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000132187 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257866+0000", 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028712300000000002 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:45.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258110+0000", 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243248 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269782+0000", 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011672342 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282341+0000", 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012558613 2024-09-10T15:26:45.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282439+0000", 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8688000000000001e-05 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282528+0000", 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9108000000000001e-05 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.555 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1231 3.0 3:016afb57:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.830181586999998, 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017421782, 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.556 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1231 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664123+0000", 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.664127+0000", 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3000000000000002e-06 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669087+0000", 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049601000000000003 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669128+0000", 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1362000000000001e-05 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669146+0000", 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7663e-05 2024-09-10T15:26:45.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669294+0000", 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014813000000000001 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669544+0000", 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025002100000000001 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.669770+0000", 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022583400000000001 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.680977+0000", 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011207178 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681448+0000", 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00047145500000000002 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681500+0000", 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1264000000000002e-05 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.681545+0000", 2024-09-10T15:26:45.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5475000000000001e-05 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1241 3.29 3:97ec7333:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.72690338, 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018815331000000001, 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.563 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1241 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767404+0000", 2024-09-10T15:26:45.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2259999999999999e-06 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771530+0000", 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041263999999999997 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771574+0000", 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4143000000000001e-05 2024-09-10T15:26:45.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771594+0000", 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9409e-05 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771685+0000", 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1252e-05 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771798+0000", 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113206 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771894+0000", 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.611e-05 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778783+0000", 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068883809999999998 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786070+0000", 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072874050000000003 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786158+0000", 2024-09-10T15:26:45.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7947000000000003e-05 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786217+0000", 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8851999999999998e-05 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.570 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1242 3.38 3:1d12f6dd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.716030113999999, 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024298450999999999, 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1242 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778277+0000", 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5639999999999999e-06 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783335+0000", 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050581660000000002 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783370+0000", 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5012999999999998e-05 2024-09-10T15:26:45.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783400+0000", 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9142e-05 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783528+0000", 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012881700000000001 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783864+0000", 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00033515200000000002 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.784288+0000", 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042494000000000001 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.798794+0000", 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014505980999999999 2024-09-10T15:26:45.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802363+0000", 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035688579999999998 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802491+0000", 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012784299999999999 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802573+0000", 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1975e-05 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1243 3.22 e62/23 3:456b4d20:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_14:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.702269350999998, 2024-09-10T15:26:45.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017000360999999999, 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792035+0000", 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.792038+0000", 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.097e-06 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797587+0000", 2024-09-10T15:26:45.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055492659999999997 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797619+0000", 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2372000000000001e-05 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797635+0000", 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.575e-05 2024-09-10T15:26:45.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797769+0000", 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013404000000000001 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.797830+0000", 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.0835000000000003e-05 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.808891+0000", 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011061161 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.809036+0000", 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014484 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1355 3.3d 3:bf2d92a6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.173654571, 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020864745000000001, 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.583 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1355 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320655+0000", 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3540000000000002e-06 2024-09-10T15:26:45.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326192+0000", 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055377869999999997 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326232+0000", 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0012999999999998e-05 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326251+0000", 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8975e-05 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326396+0000", 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014415399999999999 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326561+0000", 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016593099999999999 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326707+0000", 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014573599999999999 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.333446+0000", 2024-09-10T15:26:45.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067385800000000001 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341424+0000", 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079780619999999993 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341474+0000", 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0661999999999997e-05 2024-09-10T15:26:45.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341515+0000", 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0491000000000002e-05 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.590 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1363 3.1f 3:f8d0acf1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.084280078000001, 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020666087999999999, 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.591 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1363 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:45.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410030+0000", 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9660000000000004e-06 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414404+0000", 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043742260000000002 2024-09-10T15:26:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414446+0000", 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1579000000000003e-05 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414472+0000", 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414682+0000", 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020987600000000001 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414921+0000", 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000239304 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.415143+0000", 2024-09-10T15:26:45.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221776 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424445+0000", 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093022169999999998 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430518+0000", 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006072694 2024-09-10T15:26:45.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430615+0000", 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7725000000000004e-05 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430691+0000", 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5581999999999996e-05 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.597 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1377 3.3e 3:7f7ea93f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.914302942999999, 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017764525999999999, 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.598 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1377 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580004+0000", 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.181e-06 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583837+0000", 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038328939999999999 2024-09-10T15:26:45.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583867+0000", 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0301e-05 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583878+0000", 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1226999999999999e-05 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583952+0000", 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3411000000000006e-05 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584114+0000", 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016212400000000001 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584554+0000", 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044031700000000002 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.591179+0000", 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0066242760000000001 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597670+0000", 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0064910439999999996 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597727+0000", 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7361999999999997e-05 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597766+0000", 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9388999999999998e-05 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1394 3.23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:45.605 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.300810879, 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.043242203, 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1394 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193497+0000", 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1949999999999999e-06 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197756+0000", 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042592400000000001 2024-09-10T15:26:45.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.609 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.609 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197790+0000", 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3831999999999997e-05 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197824+0000", 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3818e-05 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197899+0000", 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5414000000000007e-05 2024-09-10T15:26:45.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197905+0000", 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000003e-06 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.201937+0000", 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040326889999999999 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202120+0000", 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182704 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202312+0000", 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019223299999999999 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.228030+0000", 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025717357999999999 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236643+0000", 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086134929999999998 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236699+0000", 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5407e-05 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236736+0000", 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7545000000000001e-05 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1395 3.18 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:45.614 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.291940231, 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033860491999999999, 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1395 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.615 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202366+0000", 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.725e-06 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208089+0000", 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057225280000000002 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208111+0000", 2024-09-10T15:26:45.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663999999999998e-05 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208125+0000", 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3516000000000001e-05 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208199+0000", 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3677000000000006e-05 2024-09-10T15:26:45.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208309+0000", 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011049599999999999 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208403+0000", 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4056999999999997e-05 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233736+0000", 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025333248999999999 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236043+0000", 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00230693 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236146+0000", 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102954 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236225+0000", 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8695999999999993e-05 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1403 3.1e 3:7aef99fe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.151861428, 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021656937000000001, 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1403 2024-09-10T15:26:45.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342447+0000", 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5260000000000002e-06 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346589+0000", 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041420600000000004 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346633+0000", 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3578999999999997e-05 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346652+0000", 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9177e-05 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346780+0000", 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012826999999999999 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347012+0000", 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023154499999999999 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:45.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347236+0000", 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224429 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.353199+0000", 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059633519999999999 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.363980+0000", 2024-09-10T15:26:45.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010780811 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364047+0000", 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6611000000000003e-05 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364100+0000", 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3576999999999999e-05 2024-09-10T15:26:45.628 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1862 3.0 3:020c4851:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.t3q9ebjFIverapvsYhwHl7lw37rUgYt_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.259817+0000", 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.23448809000000001, 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018649051, 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1862 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.259817+0000", 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.259817+0000", 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.259819+0000", 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.385e-06 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263535+0000", 2024-09-10T15:26:45.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037155270000000002 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263563+0000", 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8807999999999999e-05 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263580+0000", 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6784999999999999e-05 2024-09-10T15:26:45.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263713+0000", 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013278899999999999 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263863+0000", 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015009100000000001 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.264072+0000", 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020937399999999999 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.275452+0000", 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011379970999999999 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.278305+0000", 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028522769999999999 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.278392+0000", 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7546999999999994e-05 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.278466+0000", 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3497000000000005e-05 2024-09-10T15:26:45.635 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1865 3.17 3:e91fa98c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.27:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.20771835199999999, 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022170427999999999, 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:45.636 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1865 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286589+0000", 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0590000000000001e-06 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291289+0000", 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047002529999999997 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291315+0000", 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5763e-05 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:45.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291325+0000", 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0706999999999999e-05 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291419+0000", 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.344e-05 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291619+0000", 2024-09-10T15:26:45.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019992799999999999 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.292213+0000", 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059466300000000005 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.300908+0000", 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086945549999999996 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308674+0000", 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007766032 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308722+0000", 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8576999999999999e-05 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:45.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308757+0000", 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4450999999999999e-05 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:45.643 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:45.644 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.29 2024-09-10T15:26:45.644 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.644 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 30 2024-09-10T15:26:45.645 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.645 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.645 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127995 s, 819 MB/s 2024-09-10T15:26:45.646 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:45.646 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:45.638+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:45.746 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:45.745+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:45.762 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.30 2024-09-10T15:26:45.762 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.762 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 31 2024-09-10T15:26:45.776 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.777 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.777 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124448 s, 843 MB/s 2024-09-10T15:26:45.819 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:45.819 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:45.820 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:45.820 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:45.834 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:45.847 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:45.845+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:45.893 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.31 2024-09-10T15:26:45.893 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:45.893 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 32 2024-09-10T15:26:45.909 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:45.909 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:45.909 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011963 s, 877 MB/s 2024-09-10T15:26:45.947 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:45.942+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:45.965 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:45.965 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:45.965 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:45.965 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:45.965 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:45.979 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:46.044 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.32 2024-09-10T15:26:46.045 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.045 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 33 2024-09-10T15:26:46.048 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:46.045+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:46.059 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.060 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.060 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124452 s, 843 MB/s 2024-09-10T15:26:46.149 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:46.145+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.073051559, 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:46.154 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:46.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:46.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1188 3.25 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.161 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.891921908, 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019443585999999999, 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.162 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1188 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257377+0000", 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8700000000000001e-06 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261294+0000", 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039172979999999996 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261328+0000", 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3353999999999999e-05 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261342+0000", 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4174e-05 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261424+0000", 2024-09-10T15:26:46.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2427000000000002e-05 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261555+0000", 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000130908 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261671+0000", 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115624 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.268433+0000", 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067620909999999996 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276721+0000", 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082879170000000005 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276771+0000", 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0328000000000003e-05 2024-09-10T15:26:46.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276818+0000", 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6594999999999997e-05 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.821920253000002, 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:46.168 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:46.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:46.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:46.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.113346652000001, 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.174 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:46.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:46.180 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.094077113000001, 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:46.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:46.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.953534113, 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.188 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:46.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:46.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1223 3.24 3:24dc70f2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.880276983999998, 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017503632000000002, 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1223 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269019+0000", 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269022+0000", 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272893+0000", 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038702099999999998 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272926+0000", 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3612000000000003e-05 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.272944+0000", 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8043e-05 2024-09-10T15:26:46.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273031+0000", 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.6278000000000003e-05 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273152+0000", 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000121564 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.273254+0000", 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101519 2024-09-10T15:26:46.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.280527+0000", 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072731979999999998 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286154+0000", 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005627656 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286358+0000", 2024-09-10T15:26:46.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020398200000000001 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.286523+0000", 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016425000000000001 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1224 3.1 3:83c983e8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.870243628000001, 2024-09-10T15:26:46.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017784127, 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1224 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279052+0000", 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.279076+0000", 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3538000000000001e-05 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282896+0000", 2024-09-10T15:26:46.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038197539999999999 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282917+0000", 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1274e-05 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282928+0000", 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1032999999999999e-05 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283047+0000", 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011906899999999999 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283274+0000", 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000226994 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.283497+0000", 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022311499999999999 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.291660+0000", 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081630839999999993 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296660+0000", 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049993119999999997 2024-09-10T15:26:46.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296759+0000", 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9698000000000007e-05 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.296837+0000", 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7255999999999994e-05 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.206 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.849111938, 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.207 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:46.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:46.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:46.213 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.684911227000001, 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:46.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:46.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.218 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.675860544000001, 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:46.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.224 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1370 3.12 3:49cd0d62:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.654077568, 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018546729000000001, 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1370 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.225 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495218+0000", 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495230+0000", 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1396999999999999e-05 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499293+0000", 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040634 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499311+0000", 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8114e-05 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499320+0000", 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0329999999999997e-06 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499392+0000", 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1928000000000007e-05 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499531+0000", 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013831999999999999 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.499658+0000", 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012751900000000001 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509514+0000", 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098560490000000004 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513599+0000", 2024-09-10T15:26:46.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040848880000000001 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513689+0000", 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9530000000000005e-05 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.513765+0000", 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6551000000000006e-05 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1371 3.1 3:823dae61:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.639342237999999, 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019092687000000001, 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1371 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.231 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509954+0000", 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.509956+0000", 2024-09-10T15:26:46.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.215e-06 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514247+0000", 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042912860000000001 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514261+0000", 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3957e-05 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514269+0000", 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.593e-06 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514335+0000", 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5692999999999996e-05 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514511+0000", 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017681700000000001 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.514695+0000", 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018357000000000001 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.521453+0000", 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067582440000000001 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528786+0000", 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073324499999999999 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.528929+0000", 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014385400000000001 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.529046+0000", 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000117008 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1374 3.25 3:a5c592a7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.236 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.604834675999999, 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018460776000000002, 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1374 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544461+0000", 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.544495+0000", 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3989000000000003e-05 2024-09-10T15:26:46.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548835+0000", 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043393219999999996 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548872+0000", 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7138999999999998e-05 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.548890+0000", 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8006999999999999e-05 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549005+0000", 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115166 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549217+0000", 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021217 2024-09-10T15:26:46.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.549415+0000", 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019820999999999999 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562491+0000", 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013075765 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562833+0000", 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00034160000000000001 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562881+0000", 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8439000000000002e-05 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.562922+0000", 2024-09-10T15:26:46.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0969e-05 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.127692393, 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.243 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:46.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:46.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:46.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:46.250 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.94066144, 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:46.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:46.255 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.912248271999999, 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.256 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.257 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:46.258 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:46.259 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.260 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.261 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1721 3.33 3:cfb68b2a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.8376313240000002, 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020343915000000001, 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1721 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.262 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311667+0000", 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3910000000000001e-06 2024-09-10T15:26:46.263 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316763+0000", 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050959029999999997 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316790+0000", 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6727999999999999e-05 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.264 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316802+0000", 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2153999999999999e-05 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316888+0000", 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5977999999999996e-05 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317094+0000", 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020637499999999999 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.265 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317643+0000", 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054915499999999996 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.329834+0000", 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012190278000000001 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.266 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331874+0000", 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020404440000000002 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331950+0000", 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5819e-05 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.332009+0000", 2024-09-10T15:26:46.267 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8690000000000002e-05 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1724 3.4 3:203b9278:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.U2tLU59DNduvi7Dw7_6LkcaIJjGttfg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.7151559089999999, 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021171696, 2024-09-10T15:26:46.268 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1724 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.269 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434143+0000", 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2370000000000001e-06 2024-09-10T15:26:46.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439034+0000", 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048902920000000001 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439072+0000", 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8787e-05 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.271 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439092+0000", 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9108999999999999e-05 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439188+0000", 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6487e-05 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.272 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439322+0000", 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013430500000000001 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439420+0000", 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7343000000000006e-05 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.447315+0000", 2024-09-10T15:26:46.273 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007895394 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455236+0000", 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079208339999999999 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455277+0000", 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1248000000000002e-05 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.274 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455312+0000", 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4659999999999997e-05 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1877 3.b e68/23 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head v 68'6, mlcod=67'4)", 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.575192+0000", 2024-09-10T15:26:46.275 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.57410426999999997, 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017300203, 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575192+0000", 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.276 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575192+0000", 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575194+0000", 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.277 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.579521+0000", 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043270679999999999 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.579566+0000", 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4583999999999999e-05 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.579585+0000", 2024-09-10T15:26:46.278 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9562e-05 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.579746+0000", 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000160154 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.579788+0000", 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.227e-05 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.279 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592347+0000", 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012559539999999999 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592492+0000", 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014455499999999999 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.280 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.281 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.281 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.281 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:46.282 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.33 2024-09-10T15:26:46.282 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.282 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 34 2024-09-10T15:26:46.283 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.283 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.283 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118209 s, 887 MB/s 2024-09-10T15:26:46.284 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:46.284 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:46.282+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:46.354 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.34 2024-09-10T15:26:46.354 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.354 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 35 2024-09-10T15:26:46.369 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.369 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.369 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126258 s, 831 MB/s 2024-09-10T15:26:46.383 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:46.381+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:46.420 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:26:46.450 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:46.450 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:46.450 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:46.450 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:46.468 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:46.486 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.35 2024-09-10T15:26:46.487 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.487 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 36 2024-09-10T15:26:46.500 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.501 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.501 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111911 s, 937 MB/s 2024-09-10T15:26:46.513 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:46.510+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:46.585 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:46.581+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:46.594 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:46.594 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:46.595 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:46.595 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:46.595 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:46.611 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.36 2024-09-10T15:26:46.611 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.611 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 37 2024-09-10T15:26:46.613 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:46.622 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.622 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.622 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00904748 s, 1.2 GB/s 2024-09-10T15:26:46.697 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:46.694+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:46.723 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.37 2024-09-10T15:26:46.723 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.723 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 38 2024-09-10T15:26:46.735 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.736 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.736 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100748 s, 1.0 GB/s 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.836122763999999, 2024-09-10T15:26:46.781 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.782 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:46.783 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:46.784 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.785 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.786 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:46.787 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1206 3.c e62/23 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head v 62'2, mlcod=0'0)", 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:46.788 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.751316383999999, 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015827707999999999, 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.789 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027673+0000", 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.027675+0000", 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.790 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035053+0000", 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0073779279999999997 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035089+0000", 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5979000000000002e-05 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035105+0000", 2024-09-10T15:26:46.791 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6290000000000002e-05 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035198+0000", 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2367000000000005e-05 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035217+0000", 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9066e-05 2024-09-10T15:26:46.792 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043398+0000", 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0081812329999999996 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.043501+0000", 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010237499999999999 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.793 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.655849161999999, 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.794 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.795 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:46.796 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:46.797 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.798 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:46.799 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:46.800 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.630025367000002, 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.801 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.803 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.804 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.805 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.806 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.807 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.520642115000001, 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:46.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:46.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.814 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.464723121999999, 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.815 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:46.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:46.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1237 3.b 3:d20aacec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.053690347, 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017229367999999998, 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1237 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.822 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725302+0000", 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2480000000000001e-06 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729641+0000", 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043387460000000001 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729670+0000", 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.955e-05 2024-09-10T15:26:46.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729684+0000", 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3172e-05 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729774+0000", 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0729999999999994e-05 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729975+0000", 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000200504 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730111+0000", 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013626099999999999 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.740994+0000", 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010883163 2024-09-10T15:26:46.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742446+0000", 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014518560000000001 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742485+0000", 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742528+0000", 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2873000000000001e-05 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1240 3.2e 3:74a4e6e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.022200248000001, 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016415019999999999, 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.828 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1240 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756789+0000", 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.756792+0000", 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7630000000000001e-06 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760797+0000", 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004004896 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760840+0000", 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3618999999999997e-05 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760859+0000", 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9032e-05 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.760952+0000", 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2856999999999995e-05 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761077+0000", 2024-09-10T15:26:46.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000125327 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.761176+0000", 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8424999999999994e-05 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767159+0000", 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059834450000000004 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773081+0000", 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059217380000000002 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773150+0000", 2024-09-10T15:26:46.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.9305000000000001e-05 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.773204+0000", 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3613000000000003e-05 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.378487325, 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.836 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:46.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:26:46.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:26:46.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:26:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.354511432000001, 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.843 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:26:46.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:26:46.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:26:46.848 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1369 3.3 3:c1f9dd82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 15.298041506000001, 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016568007999999999, 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1369 2024-09-10T15:26:46.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480948+0000", 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.480951+0000", 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1520000000000001e-06 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484789+0000", 2024-09-10T15:26:46.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038383150000000001 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484816+0000", 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6546999999999998e-05 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484827+0000", 2024-09-10T15:26:46.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1616e-05 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.484923+0000", 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5519999999999993e-05 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.485075+0000", 2024-09-10T15:26:46.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015246500000000001 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.485212+0000", 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013663299999999999 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495712+0000", 2024-09-10T15:26:46.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010500127 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497386+0000", 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0016739260000000001 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497458+0000", 2024-09-10T15:26:46.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2292000000000005e-05 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.497516+0000", 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7414999999999998e-05 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.857 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.576038064, 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:26:46.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.862 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.559173083999999, 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.863 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.865 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:26:46.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.520250326999999, 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.870 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:26:46.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.876 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.508094855, 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.877 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.882 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:26:46.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.884 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1665 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e65)", 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.0640019209999991, 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016081472999999999, 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "started", 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1665 2024-09-10T15:26:46.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714987+0000", 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714988+0000", 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9999999999999995e-07 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.714992+0000", 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.233e-06 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715005+0000", 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2272999999999999e-05 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.715014+0000", 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8629999999999997e-06 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.720909+0000", 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0058948999999999998 2024-09-10T15:26:46.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.721218+0000", 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030987099999999997 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:37.731069+0000", 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0098503329999999993 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.889 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.8031749440000002, 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.890 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:26:46.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:26:46.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:26:46.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.895 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1739 3.8 e67/23 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head v 67'4, mlcod=63'2)", 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.083339015, 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018473534, 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695653+0000", 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7039999999999999e-06 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699886+0000", 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042333459999999998 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699927+0000", 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0457999999999998e-05 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699951+0000", 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4754999999999999e-05 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700106+0000", 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015423699999999999 2024-09-10T15:26:46.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700152+0000", 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6802999999999999e-05 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.713994+0000", 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013841579 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714124+0000", 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012965200000000001 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1877 3.b 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 1.209709892, 2024-09-10T15:26:46.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023807905000000001, 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1877 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:46.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569281+0000", 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.024e-06 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573676+0000", 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043950930000000001 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573702+0000", 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5802000000000001e-05 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573713+0000", 2024-09-10T15:26:46.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0386e-05 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573906+0000", 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000193742 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.574173+0000", 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000266884 2024-09-10T15:26:46.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575041+0000", 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086814499999999996 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592140+0000", 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017098242 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592884+0000", 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074462200000000001 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592997+0000", 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011323 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.593087+0000", 2024-09-10T15:26:46.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9734999999999994e-05 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1892 3.c e68/23 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head v 68'8, mlcod=67'6)", 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.78983201800000002, 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024892474000000001, 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:46.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:46.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989159+0000", 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1100000000000001e-06 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994450+0000", 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052911779999999997 2024-09-10T15:26:46.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994487+0000", 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6563999999999998e-05 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994504+0000", 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6906e-05 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994695+0000", 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019078500000000001 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994745+0000", 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0583e-05 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:46.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.013894+0000", 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019148603 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.014050+0000", 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015574499999999999 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:46.913 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:46.914 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:46.916 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:26:46.916 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.38 2024-09-10T15:26:46.916 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.916 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 39 2024-09-10T15:26:46.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:46.917 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:46.917 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:46.917 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119055 s, 881 MB/s 2024-09-10T15:26:46.917 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:46.913+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:46.989 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.39 2024-09-10T15:26:46.990 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:46.990 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 40 2024-09-10T15:26:47.000 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.000 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.001 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0091011 s, 1.2 GB/s 2024-09-10T15:26:47.016 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:47.013+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:47.102 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:47.102 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1950 3.1b e69/23 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head v 69'11, mlcod=68'9)", 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.0073771799999999997, 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0074021529999999999, 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095963+0000", 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0599999999999999e-07 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103130+0000", 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007167606 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103155+0000", 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5177999999999998e-05 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103166+0000", 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1027e-05 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103252+0000", 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5555000000000003e-05 2024-09-10T15:26:47.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103271+0000", 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9106999999999998e-05 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-10T15:26:47.106 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:47.117 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:47.110+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:47.121 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:47.137 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:47.143 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.40 2024-09-10T15:26:47.143 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.143 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 41 2024-09-10T15:26:47.158 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.158 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.158 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121538 s, 863 MB/s 2024-09-10T15:26:47.217 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:47.213+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:47.269 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:47.269 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:47.269 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:47.269 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:47.280 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.41 2024-09-10T15:26:47.280 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.280 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 42 2024-09-10T15:26:47.286 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:47.291 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.291 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.291 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00925086 s, 1.1 GB/s 2024-09-10T15:26:47.291 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:47.292 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:47.308 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:47.308 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:47.318 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:47.317+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:47.327 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:47.327 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:47.345 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:47.346 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:47.369 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:47.369 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:47.391 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:47.391 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:47.397 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.42 2024-09-10T15:26:47.397 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.397 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 43 2024-09-10T15:26:47.407 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.407 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.407 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00905514 s, 1.2 GB/s 2024-09-10T15:26:47.412 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:47.412 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:47.413 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:47.413 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:47.420 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:47.417+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:47.429 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:47.433 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:47.433 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:47.517 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.43 2024-09-10T15:26:47.517 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.517 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 44 2024-09-10T15:26:47.520 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:47.517+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.527 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00911574 s, 1.2 GB/s 2024-09-10T15:26:47.551 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:47.552 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:47.567 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:47.632 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.44 2024-09-10T15:26:47.632 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.632 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 45 2024-09-10T15:26:47.632 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:47.629+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:47.642 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.642 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.642 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00884162 s, 1.2 GB/s 2024-09-10T15:26:47.722 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:47.721+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:47.732 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:47.732 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:47.749 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:47.761 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.45 2024-09-10T15:26:47.761 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.761 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 46 2024-09-10T15:26:47.774 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.774 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.774 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109334 s, 959 MB/s 2024-09-10T15:26:47.824 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:47.818+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:47.882 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.46 2024-09-10T15:26:47.883 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.883 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 47 2024-09-10T15:26:47.894 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:47.895 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:47.896 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:47.896 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:47.896 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114633 s, 915 MB/s 2024-09-10T15:26:47.908 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:47.924 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:47.918+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:47.997 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.47 2024-09-10T15:26:47.998 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:47.998 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 48 2024-09-10T15:26:48.009 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.009 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.009 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00963656 s, 1.1 GB/s 2024-09-10T15:26:48.025 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:48.022+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:48.075 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:48.076 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:48.094 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:48.119 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.48 2024-09-10T15:26:48.119 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.119 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 49 2024-09-10T15:26:48.126 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:48.122+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:48.131 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.131 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.131 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106849 s, 981 MB/s 2024-09-10T15:26:48.217 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:48.217 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:48.226 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:48.222+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:48.231 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:48.242 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.49 2024-09-10T15:26:48.243 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.243 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 50 2024-09-10T15:26:48.253 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.253 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.253 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00929007 s, 1.1 GB/s 2024-09-10T15:26:48.327 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:48.325+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:48.365 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.50 2024-09-10T15:26:48.366 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.366 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 51 2024-09-10T15:26:48.377 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:48.377 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:48.378 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.378 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.378 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105374 s, 995 MB/s 2024-09-10T15:26:48.392 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:48.438 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:48.437+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:48.505 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.51 2024-09-10T15:26:48.505 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.505 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 52 2024-09-10T15:26:48.517 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.517 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.518 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108848 s, 963 MB/s 2024-09-10T15:26:48.528 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:48.525+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:48.570 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:48.570 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:48.589 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:48.634 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:48.633+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:48.636 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.52 2024-09-10T15:26:48.636 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.636 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 53 2024-09-10T15:26:48.649 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.649 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.649 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109594 s, 957 MB/s 2024-09-10T15:26:48.730 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:48.729+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:48.767 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:48.768 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:48.778 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.53 2024-09-10T15:26:48.778 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.778 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 54 2024-09-10T15:26:48.782 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:48.792 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.792 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.792 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116526 s, 900 MB/s 2024-09-10T15:26:48.831 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:48.826+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:48.912 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.54 2024-09-10T15:26:48.912 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:48.912 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 55 2024-09-10T15:26:48.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:26:48.926 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:48.926 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:48.926 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115396 s, 909 MB/s 2024-09-10T15:26:48.931 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:48.929+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:48.933 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:48.933 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:48.948 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:49.031 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.55 2024-09-10T15:26:49.032 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.032 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 56 2024-09-10T15:26:49.032 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:49.029+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:49.042 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.043 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.043 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00942148 s, 1.1 GB/s 2024-09-10T15:26:49.084 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:49.084 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:49.098 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:49.130 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.56 2024-09-10T15:26:49.130 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.131 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 57 2024-09-10T15:26:49.133 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:49.129+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:49.141 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.141 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.141 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00931791 s, 1.1 GB/s 2024-09-10T15:26:49.223 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:49.223 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:49.234 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:49.230+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:49.240 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:49.256 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.57 2024-09-10T15:26:49.256 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.256 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 58 2024-09-10T15:26:49.269 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.269 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.269 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105516 s, 994 MB/s 2024-09-10T15:26:49.335 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:49.333+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:49.385 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.58 2024-09-10T15:26:49.385 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.385 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 59 2024-09-10T15:26:49.398 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.398 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.398 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114475 s, 916 MB/s 2024-09-10T15:26:49.413 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:49.413 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:49.428 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:49.436 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:49.433+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:49.457 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:49.518 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.59 2024-09-10T15:26:49.518 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.518 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 60 2024-09-10T15:26:49.530 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.530 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.530 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106111 s, 988 MB/s 2024-09-10T15:26:49.537 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:49.530+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:49.555 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:49.555 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:49.570 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:49.610 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:49.611 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:49.629 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:49.630 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:49.637 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:49.633+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:49.640 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.60 2024-09-10T15:26:49.640 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.640 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 61 2024-09-10T15:26:49.646 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:49.646 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:49.652 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.652 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.652 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010429 s, 1.0 GB/s 2024-09-10T15:26:49.663 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:49.664 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:49.682 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:49.682 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:49.702 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:49.702 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:49.722 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:49.723 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:49.737 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:49.737 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:49.737 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:49.737 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:49.737 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:49.738 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:49.737+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:49.744 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:49.744 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:49.752 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:49.763 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.61 2024-09-10T15:26:49.763 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:49.763 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 62 2024-09-10T15:26:49.774 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:49.774 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:49.774 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0094724 s, 1.1 GB/s 2024-09-10T15:26:49.839 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:49.837+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1180 3.10 e62/23 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head v 62'1, mlcod=0'0)", 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:49.896 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.791313415000001, 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018493124, 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096730+0000", 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.096733+0000", 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7499999999999999e-06 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103771+0000", 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0070384489999999996 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103806+0000", 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4798999999999997e-05 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103832+0000", 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6013e-05 2024-09-10T15:26:49.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103956+0000", 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124194 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.103998+0000", 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1841999999999997e-05 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115130+0000", 2024-09-10T15:26:49.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011132246 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.115223+0000", 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2831000000000006e-05 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:49.901 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.652294005000002, 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:49.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.903 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:26:49.904 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:26:49.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:26:49.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1205 3.23 3:c562f369:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:49.908 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.877220737000002, 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020233378, 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1205 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:49.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010823+0000", 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.010826+0000", 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.689e-06 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015077+0000", 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042514229999999998 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015112+0000", 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5275999999999999e-05 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015134+0000", 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1687000000000001e-05 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015257+0000", 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012268500000000001 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015400+0000", 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014325300000000001 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.015516+0000", 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115757 2024-09-10T15:26:49.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030382+0000", 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014866890000000001 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.030952+0000", 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00056960500000000005 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031011+0000", 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8972999999999999e-05 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.031056+0000", 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5139999999999998e-05 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1215 3.1f 3:faffbb4f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.714829018, 2024-09-10T15:26:49.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018963486000000002, 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1215 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173215+0000", 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.173218+0000", 2024-09-10T15:26:49.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8929999999999998e-06 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177338+0000", 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004119592 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177376+0000", 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7558999999999997e-05 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177394+0000", 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8277000000000001e-05 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177507+0000", 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011278299999999999 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177702+0000", 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019584299999999999 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.177884+0000", 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000181134 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185658+0000", 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077739660000000002 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.191981+0000", 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063235940000000001 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192071+0000", 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0051999999999998e-05 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.192178+0000", 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010679300000000001 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1216 3.17 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.702905131000001, 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024358715999999999, 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1216 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185142+0000", 2024-09-10T15:26:49.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7000000000000002e-06 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189137+0000", 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039947480000000002 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189170+0000", 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3402999999999999e-05 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189188+0000", 2024-09-10T15:26:49.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7385999999999999e-05 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189357+0000", 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016903299999999999 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189760+0000", 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040378099999999998 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.190175+0000", 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041465300000000002 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.205685+0000", 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015510098 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209323+0000", 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036379149999999998 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209424+0000", 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101303 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209497+0000", 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2695999999999997e-05 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.926 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1222 3.23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.634701613000001, 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029186541999999999, 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.927 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1222 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253345+0000", 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.954e-06 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257398+0000", 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040527439999999996 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257431+0000", 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3513000000000003e-05 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257447+0000", 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6022e-05 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257579+0000", 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000132187 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257866+0000", 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028712300000000002 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258110+0000", 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243248 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269782+0000", 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011672342 2024-09-10T15:26:49.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282341+0000", 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012558613 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282439+0000", 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8688000000000001e-05 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282528+0000", 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9108000000000001e-05 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1241 3.29 3:97ec7333:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.120642129, 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018815331000000001, 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.933 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1241 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767401+0000", 2024-09-10T15:26:49.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.767404+0000", 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2259999999999999e-06 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771530+0000", 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041263999999999997 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771574+0000", 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4143000000000001e-05 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771594+0000", 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9409e-05 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771685+0000", 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1252e-05 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771798+0000", 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113206 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.771894+0000", 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.611e-05 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778783+0000", 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0068883809999999998 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786070+0000", 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072874050000000003 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786158+0000", 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7947000000000003e-05 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.786217+0000", 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8851999999999998e-05 2024-09-10T15:26:49.938 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1242 3.38 3:1d12f6dd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.109768862999999, 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024298450999999999, 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.939 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1242 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:26:49.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778277+0000", 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5639999999999999e-06 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783335+0000", 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050581660000000002 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783370+0000", 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5012999999999998e-05 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783400+0000", 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9142e-05 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783528+0000", 2024-09-10T15:26:49.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012881700000000001 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783864+0000", 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00033515200000000002 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.784288+0000", 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042494000000000001 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.798794+0000", 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014505980999999999 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802363+0000", 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035688579999999998 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802491+0000", 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012784299999999999 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802573+0000", 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1975e-05 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1355 3.3d 3:bf2d92a6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.567393320000001, 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020864745000000001, 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.945 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1355 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.946 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320650+0000", 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.320655+0000", 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3540000000000002e-06 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326192+0000", 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055377869999999997 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326232+0000", 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0012999999999998e-05 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326251+0000", 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8975e-05 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326396+0000", 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014415399999999999 2024-09-10T15:26:49.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326561+0000", 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016593099999999999 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.326707+0000", 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014573599999999999 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.333446+0000", 2024-09-10T15:26:49.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067385800000000001 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341424+0000", 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079780619999999993 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341474+0000", 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0661999999999997e-05 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.341515+0000", 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0491000000000002e-05 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1363 3.1f 3:f8d0acf1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.478018827, 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020666087999999999, 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.951 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1363 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.952 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410025+0000", 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.410030+0000", 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9660000000000004e-06 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414404+0000", 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043742260000000002 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414446+0000", 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1579000000000003e-05 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414472+0000", 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6143e-05 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414682+0000", 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020987600000000001 2024-09-10T15:26:49.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.414921+0000", 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000239304 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.415143+0000", 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000221776 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424445+0000", 2024-09-10T15:26:49.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093022169999999998 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430518+0000", 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006072694 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430615+0000", 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7725000000000004e-05 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.430691+0000", 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5581999999999996e-05 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1377 3.3e 3:7f7ea93f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.9:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.308041692, 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017764525999999999, 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.957 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1377 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580002+0000", 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.580004+0000", 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.181e-06 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583837+0000", 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038328939999999999 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583867+0000", 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0301e-05 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583878+0000", 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1226999999999999e-05 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.583952+0000", 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3411000000000006e-05 2024-09-10T15:26:49.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584114+0000", 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016212400000000001 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.584554+0000", 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044031700000000002 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.591179+0000", 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0066242760000000001 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597670+0000", 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0064910439999999996 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597727+0000", 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7361999999999997e-05 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.597766+0000", 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9388999999999998e-05 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1394 3.23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.694549628000001, 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.043242203, 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.963 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1394 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193497+0000", 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1949999999999999e-06 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197756+0000", 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042592400000000001 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197790+0000", 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3831999999999997e-05 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197824+0000", 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3818e-05 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197899+0000", 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5414000000000007e-05 2024-09-10T15:26:49.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197905+0000", 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000003e-06 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.201937+0000", 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040326889999999999 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202120+0000", 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182704 2024-09-10T15:26:49.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202312+0000", 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019223299999999999 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.228030+0000", 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025717357999999999 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236643+0000", 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086134929999999998 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236699+0000", 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5407e-05 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236736+0000", 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7545000000000001e-05 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.969 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1395 3.18 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.685678979999999, 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033860491999999999, 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1395 2024-09-10T15:26:49.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202366+0000", 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.725e-06 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208089+0000", 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057225280000000002 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208111+0000", 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663999999999998e-05 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208125+0000", 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3516000000000001e-05 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208199+0000", 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3677000000000006e-05 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208309+0000", 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011049599999999999 2024-09-10T15:26:49.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208403+0000", 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4056999999999997e-05 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233736+0000", 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025333248999999999 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236043+0000", 2024-09-10T15:26:49.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00230693 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236146+0000", 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102954 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236225+0000", 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8695999999999993e-05 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1403 3.1e 3:7aef99fe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.545600177000001, 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021656937000000001, 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1403 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.976 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342447+0000", 2024-09-10T15:26:49.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5260000000000002e-06 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346589+0000", 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041420600000000004 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346633+0000", 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3578999999999997e-05 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346652+0000", 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9177e-05 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346780+0000", 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012826999999999999 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347012+0000", 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023154499999999999 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347236+0000", 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224429 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.353199+0000", 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059633519999999999 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.363980+0000", 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010780811 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364047+0000", 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6611000000000003e-05 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364100+0000", 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3576999999999999e-05 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1862 3.0 3:020c4851:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.t3q9ebjFIverapvsYhwHl7lw37rUgYt_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.259817+0000", 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6282268389999999, 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018649051, 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1862 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.259817+0000", 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.259817+0000", 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.259819+0000", 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.385e-06 2024-09-10T15:26:49.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263535+0000", 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0037155270000000002 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263563+0000", 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8807999999999999e-05 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263580+0000", 2024-09-10T15:26:49.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6784999999999999e-05 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263713+0000", 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013278899999999999 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.263863+0000", 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015009100000000001 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:49.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.264072+0000", 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020937399999999999 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.275452+0000", 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011379970999999999 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.278305+0000", 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0028522769999999999 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.278392+0000", 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7546999999999994e-05 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.278466+0000", 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3497000000000005e-05 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1865 3.17 3:e91fa98c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.27:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:49.987 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.6014571010000003, 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022170427999999999, 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1865 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286589+0000", 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0590000000000001e-06 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.989 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291289+0000", 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047002529999999997 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291315+0000", 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5763e-05 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291325+0000", 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0706999999999999e-05 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291419+0000", 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.344e-05 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291619+0000", 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019992799999999999 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.292213+0000", 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059466300000000005 2024-09-10T15:26:49.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.300908+0000", 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086945549999999996 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308674+0000", 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007766032 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308722+0000", 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8576999999999999e-05 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308757+0000", 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4450999999999999e-05 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1889 3.1e 3:7a0e2d59:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.870279+0000", 2024-09-10T15:26:49.993 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.0177647519999997, 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021110397999999999, 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1889 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.870279+0000", 2024-09-10T15:26:49.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.870279+0000", 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.870281+0000", 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8929999999999999e-06 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:49.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874239+0000", 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039579649999999999 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874256+0000", 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7292e-05 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874267+0000", 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0730999999999999e-05 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874335+0000", 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8269999999999995e-05 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874561+0000", 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000226498 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.875189+0000", 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00062743399999999996 2024-09-10T15:26:49.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.883989+0000", 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0087996770000000005 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.891277+0000", 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007288826 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:49.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.891344+0000", 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7065999999999998e-05 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.891389+0000", 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4746000000000002e-05 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1926 3.31 3:8c96e924:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.fQnswT84zQu2JRPYIoOG8d0PdiW_v3R_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.570180+0000", 2024-09-10T15:26:49.999 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.3178633230000001, 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018609434000000001, 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1926 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.570180+0000", 2024-09-10T15:26:50.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.570180+0000", 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.570182+0000", 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2469999999999998e-06 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.574633+0000", 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044509550000000004 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.574666+0000", 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2190999999999997e-05 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.574679+0000", 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2986000000000001e-05 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.574756+0000", 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7117e-05 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.574901+0000", 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014567900000000001 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.575027+0000", 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000126024 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.584804+0000", 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097766160000000001 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.588475+0000", 2024-09-10T15:26:50.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003670927 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.588652+0000", 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017736 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.588790+0000", 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013733199999999999 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1956 3.18 3:1875c112:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.qJG5m4HxH-FypGMc1JuFE5G9RkYfZL2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.219116+0000", 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 2.6689271840000002, 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029217868000000001, 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1956 2024-09-10T15:26:50.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.219116+0000", 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.219116+0000", 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.219119+0000", 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2299999999999998e-06 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227132+0000", 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0080133519999999996 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227175+0000", 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3065000000000002e-05 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227194+0000", 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8706e-05 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227334+0000", 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014008900000000001 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227585+0000", 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000251656 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227817+0000", 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231917 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248070+0000", 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020252728000000001 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248114+0000", 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3511999999999999e-05 2024-09-10T15:26:50.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248211+0000", 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7046999999999994e-05 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248334+0000", 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000123566 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1959 3.17 3:e832a3fd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.251866+0000", 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 2.6361771709999999, 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.026970971999999999, 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1959 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.012 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.251866+0000", 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.251866+0000", 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.251870+0000", 2024-09-10T15:26:50.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1439999999999999e-06 2024-09-10T15:26:50.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256709+0000", 2024-09-10T15:26:50.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048394789999999998 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256748+0000", 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9079000000000003e-05 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.021 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256764+0000", 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5809999999999999e-05 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256907+0000", 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260499999999999 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.257190+0000", 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028390199999999999 2024-09-10T15:26:50.022 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.258092+0000", 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090200299999999996 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.273198+0000", 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015105511 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.023 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.278554+0000", 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0053559740000000003 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.278692+0000", 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013803599999999999 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.278837+0000", 2024-09-10T15:26:50.024 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014542900000000001 2024-09-10T15:26:50.025 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.025 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.025 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.025 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.025 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.025 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:50.026 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.62 2024-09-10T15:26:50.026 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.026 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 63 2024-09-10T15:26:50.026 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.027 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.027 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124534 s, 842 MB/s 2024-09-10T15:26:50.027 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:26:50.028 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:50.028 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:50.022+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:50.066 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.63 2024-09-10T15:26:50.067 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.067 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 64 2024-09-10T15:26:50.079 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.079 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.079 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106272 s, 987 MB/s 2024-09-10T15:26:50.127 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:50.122+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:50.197 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:50.197 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:50.198 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:50.198 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:50.212 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:50.222 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.64 2024-09-10T15:26:50.223 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.223 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 65 2024-09-10T15:26:50.228 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:50.225+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:50.238 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.238 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.238 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0125963 s, 832 MB/s 2024-09-10T15:26:50.330 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:50.329+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:50.385 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.65 2024-09-10T15:26:50.385 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.385 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 66 2024-09-10T15:26:50.386 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:50.386 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:50.386 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:50.386 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:50.386 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:50.402 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:50.403 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.403 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.403 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132419 s, 792 MB/s 2024-09-10T15:26:50.449 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:50.446+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:50.532 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:50.526+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.454554857000002, 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.534 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:50.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1188 3.25 3:a7694c2c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.273425205999999, 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019443585999999999, 2024-09-10T15:26:50.540 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1188 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257374+0000", 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.257377+0000", 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8700000000000001e-06 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261294+0000", 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039172979999999996 2024-09-10T15:26:50.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261328+0000", 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3353999999999999e-05 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261342+0000", 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4174e-05 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261424+0000", 2024-09-10T15:26:50.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2427000000000002e-05 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261555+0000", 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000130908 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.261671+0000", 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115624 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.268433+0000", 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0067620909999999996 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276721+0000", 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082879170000000005 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276771+0000", 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0328000000000003e-05 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.276818+0000", 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6594999999999997e-05 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.203423551, 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.546 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:50.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:50.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.494849949999999, 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.552 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:50.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.475580410999999, 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.558 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:50.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:50.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:50.563 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.335037410999998, 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.564 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:50.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:50.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.230615235999998, 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:50.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:50.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.066414524999999, 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:50.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:50.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.057363842000001, 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.580 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:50.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:50.584 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.509195690999999, 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.588 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.66 2024-09-10T15:26:50.588 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.589 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 67 2024-09-10T15:26:50.589 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.589 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.589 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124388 s, 843 MB/s 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.592 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.322164738000001, 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:50.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:50.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.293751570000001, 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.597 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:50.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:50.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.602 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1721 3.33 3:cfb68b2a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.2191346220000003, 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020343915000000001, 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.603 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1721 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311667+0000", 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3910000000000001e-06 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316763+0000", 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050959029999999997 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316790+0000", 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6727999999999999e-05 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316802+0000", 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2153999999999999e-05 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316888+0000", 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5977999999999996e-05 2024-09-10T15:26:50.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317094+0000", 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020637499999999999 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317643+0000", 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054915499999999996 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.329834+0000", 2024-09-10T15:26:50.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012190278000000001 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331874+0000", 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020404440000000002 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331950+0000", 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5819e-05 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.332009+0000", 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8690000000000002e-05 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1724 3.4 3:203b9278:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.U2tLU59DNduvi7Dw7_6LkcaIJjGttfg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.0966592070000001, 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021171696, 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1724 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:50.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434143+0000", 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2370000000000001e-06 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439034+0000", 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048902920000000001 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439072+0000", 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8787e-05 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439092+0000", 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9108999999999999e-05 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439188+0000", 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6487e-05 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439322+0000", 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013430500000000001 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439420+0000", 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7343000000000006e-05 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.447315+0000", 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007895394 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455236+0000", 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079208339999999999 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455277+0000", 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1248000000000002e-05 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455312+0000", 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4659999999999997e-05 2024-09-10T15:26:50.614 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1909 3.24 3:27a2e717:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.bEh9hCKsxr8uubu13gXHdP3NKsc9b___2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.3943237689999997, 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020638806999999999, 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1909 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136479+0000", 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9960000000000002e-06 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138833+0000", 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023546610000000001 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138859+0000", 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5616999999999999e-05 2024-09-10T15:26:50.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138871+0000", 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139035+0000", 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016393199999999999 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139394+0000", 2024-09-10T15:26:50.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035952599999999999 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139610+0000", 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021574100000000001 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.143897+0000", 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042874660000000002 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.156917+0000", 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013019519 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157010+0000", 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2857999999999998e-05 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157114+0000", 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104731 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.620 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1917 3.24 3:24837641:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.1999340260000002, 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021840252000000001, 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.621 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1917 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330868+0000", 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5399999999999998e-06 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335714+0000", 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00484594 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335754+0000", 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0175000000000001e-05 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335780+0000", 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5678e-05 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335921+0000", 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141085 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.336222+0000", 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030169300000000001 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.337135+0000", 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091279700000000002 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352078+0000", 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014942337 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352534+0000", 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045644199999999999 2024-09-10T15:26:50.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352637+0000", 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103398 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352706+0000", 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8167e-05 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1929 3.24 3:259692f9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.36:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.939898506, 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019827279, 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1929 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590905+0000", 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4700000000000004e-06 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597424+0000", 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065183810000000002 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597470+0000", 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6811000000000003e-05 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597491+0000", 2024-09-10T15:26:50.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597622+0000", 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000131834 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597783+0000", 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016109100000000001 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:50.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.598360+0000", 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00057640399999999998 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.609671+0000", 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011310661 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610525+0000", 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085494 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610650+0000", 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012418299999999999 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610728+0000", 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8459000000000002e-05 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.632 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1953 3.25 3:a444f990:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.40:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.4104263980000002, 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021829541000000001, 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1953 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120376+0000", 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3330000000000001e-06 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124380+0000", 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040035380000000001 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124417+0000", 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7492e-05 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124435+0000", 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8122999999999999e-05 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124627+0000", 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019198800000000001 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124910+0000", 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000282198 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.125832+0000", 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00092200300000000002 2024-09-10T15:26:50.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.139934+0000", 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01410264 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.141879+0000", 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019445059999999999 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142069+0000", 2024-09-10T15:26:50.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018991799999999999 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142202+0000", 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133802 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1956 3.18 e69/23 3:1875c112:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.qJG5m4HxH-FypGMc1JuFE5G9RkYfZL2_1:head v 69'7, mlcod=68'5)", 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.228169+0000", 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 3.3026298679999999, 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019462659, 2024-09-10T15:26:50.638 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.228169+0000", 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.228169+0000", 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.228170+0000", 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2699999999999999e-07 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.232651+0000", 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044804629999999996 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.232703+0000", 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2806000000000002e-05 2024-09-10T15:26:50.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.232731+0000", 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7402e-05 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.232909+0000", 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017860799999999999 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.232978+0000", 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8734999999999998e-05 2024-09-10T15:26:50.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.247542+0000", 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01456383 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.247632+0000", 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0087999999999995e-05 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2085 3.25 3:a5fb1ce4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.65618298600000002, 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023491656999999999, 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2085 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:50.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874619+0000", 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5100000000000001e-06 2024-09-10T15:26:50.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879012+0000", 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043931630000000003 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879049+0000", 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7279e-05 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879067+0000", 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7447000000000001e-05 2024-09-10T15:26:50.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879207+0000", 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014021899999999999 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879489+0000", 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028163800000000002 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.880391+0000", 2024-09-10T15:26:50.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090249099999999995 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.894924+0000", 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01453337 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.897971+0000", 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030460660000000001 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898053+0000", 2024-09-10T15:26:50.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2109999999999998e-05 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898108+0000", 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5364000000000001e-05 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:50.648 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:50.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:50.650 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:50.646+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:50.702 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.67 2024-09-10T15:26:50.702 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.702 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 68 2024-09-10T15:26:50.718 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.718 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.718 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012966 s, 809 MB/s 2024-09-10T15:26:50.751 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:50.746+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:50.777 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:50.777 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:50.777 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:50.777 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:50.791 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:50.852 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:50.849+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:50.866 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.68 2024-09-10T15:26:50.866 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:50.866 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 69 2024-09-10T15:26:50.882 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:50.882 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:50.882 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128324 s, 817 MB/s 2024-09-10T15:26:50.953 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:50.946+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:50.954 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:50.954 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:50.954 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:50.955 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:50.955 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:50.969 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:51.019 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.69 2024-09-10T15:26:51.019 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.019 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 70 2024-09-10T15:26:51.034 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.034 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.034 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120301 s, 872 MB/s 2024-09-10T15:26:51.053 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:51.049+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:51.137 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.192640058999999, 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.138 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:51.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.143 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.012366456999999, 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.144 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:51.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.986542662000002, 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:51.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:51.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:51.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.877159410000001, 2024-09-10T15:26:51.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:51.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:51.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.821240416999999, 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.160 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:51.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:51.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:51.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1237 3.b 3:d20aacec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.165 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.410207642, 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017229367999999998, 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1237 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:51.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725299+0000", 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.725302+0000", 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2480000000000001e-06 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729641+0000", 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043387460000000001 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729670+0000", 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.955e-05 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729684+0000", 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3172e-05 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729774+0000", 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0729999999999994e-05 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.729975+0000", 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000200504 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.730111+0000", 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013626099999999999 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.740994+0000", 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010883163 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742446+0000", 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0014518560000000001 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742485+0000", 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:26:51.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.742528+0000", 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2873000000000001e-05 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.735004620000002, 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.171 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:26:51.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:26:51.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:26:51.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.711028726999999, 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:26:51.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:26:51.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.932555358999998, 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:26:51.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.915690379000001, 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.187 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:51.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.192 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.876767621999999, 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.193 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:26:51.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:26:51.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:51.198 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.864612149999999, 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:51.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:26:51.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:51.204 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.159692239, 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:51.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:26:51.208 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1739 3.8 e67/23 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head v 67'4, mlcod=63'2)", 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.4398563099999997, 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018473534, 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695653+0000", 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7039999999999999e-06 2024-09-10T15:26:51.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699886+0000", 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042333459999999998 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699927+0000", 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0457999999999998e-05 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699951+0000", 2024-09-10T15:26:51.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4754999999999999e-05 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700106+0000", 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015423699999999999 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700152+0000", 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6802999999999999e-05 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.713994+0000", 2024-09-10T15:26:51.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013841579 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714124+0000", 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012965200000000001 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1877 3.b 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:51.213 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.566227187, 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023807905000000001, 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1877 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569281+0000", 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.024e-06 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573676+0000", 2024-09-10T15:26:51.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043950930000000001 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573702+0000", 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5802000000000001e-05 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573713+0000", 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0386e-05 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573906+0000", 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000193742 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.574173+0000", 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000266884 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575041+0000", 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086814499999999996 2024-09-10T15:26:51.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592140+0000", 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017098242 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592884+0000", 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074462200000000001 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592997+0000", 2024-09-10T15:26:51.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011323 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.593087+0000", 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9734999999999994e-05 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1892 3.c e68/23 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head v 68'8, mlcod=67'6)", 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 5.146349313, 2024-09-10T15:26:51.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024892474000000001, 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:51.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989159+0000", 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1100000000000001e-06 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994450+0000", 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052911779999999997 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994487+0000", 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6563999999999998e-05 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994504+0000", 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6906e-05 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994695+0000", 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019078500000000001 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994745+0000", 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0583e-05 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.013894+0000", 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019148603 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.014050+0000", 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015574499999999999 2024-09-10T15:26:51.223 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1947 3.c e69/23 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head v 69'9, mlcod=68'7)", 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.1682204570000003, 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020674089999999999, 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967287+0000", 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4700000000000001e-07 2024-09-10T15:26:51.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974827+0000", 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075409240000000001 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974856+0000", 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8119e-05 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974871+0000", 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5189e-05 2024-09-10T15:26:51.226 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974968+0000", 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7460999999999994e-05 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.975009+0000", 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0268000000000001e-05 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987873+0000", 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01286399 2024-09-10T15:26:51.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987960+0000", 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7591999999999998e-05 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2109 3.23 e70/23 3:c4c10ed7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.66:head v 70'14, mlcod=67'12)", 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.62295226100000001, 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020231979000000001, 2024-09-10T15:26:51.228 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512557+0000", 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517394+0000", 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048370799999999997 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517433+0000", 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8982e-05 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517451+0000", 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7672999999999998e-05 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517620+0000", 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169409 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517685+0000", 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5240999999999994e-05 2024-09-10T15:26:51.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532706+0000", 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015020436 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532786+0000", 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0581999999999995e-05 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2112 3.c e70/23 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head v 70'10, mlcod=68'8)", 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.48512951300000001, 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017546361, 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:26:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650378+0000", 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6700000000000003e-07 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656693+0000", 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063148220000000003 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656733+0000", 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9981999999999998e-05 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656751+0000", 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8853000000000001e-05 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656852+0000", 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100608 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656881+0000", 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9377999999999999e-05 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667779+0000", 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010897232 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667923+0000", 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014471899999999999 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2118 3.3f 3:fd7c3aaf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.6OutWCbOnJUoR6EgAd38lwPhVbxENPy_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.32939862199999997, 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031726504000000003, 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2118 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806111+0000", 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4570000000000001e-06 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811285+0000", 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051735699999999997 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811321+0000", 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6455000000000002e-05 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811340+0000", 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8887000000000001e-05 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811478+0000", 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137362 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811749+0000", 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027095 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811968+0000", 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021936699999999999 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.828291+0000", 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016322691 2024-09-10T15:26:51.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837605+0000", 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093144179999999997 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837701+0000", 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6033999999999996e-05 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837834+0000", 2024-09-10T15:26:51.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133313 2024-09-10T15:26:51.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.243 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:51.243 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:51.243 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:51.244 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.70 2024-09-10T15:26:51.244 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.244 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 71 2024-09-10T15:26:51.244 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.244 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.245 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129007 s, 813 MB/s 2024-09-10T15:26:51.245 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:51.241+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:51.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:51.332 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.71 2024-09-10T15:26:51.332 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.332 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 72 2024-09-10T15:26:51.345 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:51.338+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:51.346 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.346 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.346 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109226 s, 960 MB/s 2024-09-10T15:26:51.377 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:51.377 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:51.377 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:51.391 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:51.445 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:51.442+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:51.467 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.72 2024-09-10T15:26:51.467 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.468 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 73 2024-09-10T15:26:51.479 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.479 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.479 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100858 s, 1.0 GB/s 2024-09-10T15:26:51.516 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:51.516 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:51.516 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:51.516 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:51.516 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:51.533 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:51.578 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:51.577+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:51.589 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.73 2024-09-10T15:26:51.589 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.589 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 74 2024-09-10T15:26:51.600 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.600 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.600 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00946616 s, 1.1 GB/s 2024-09-10T15:26:51.647 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:51.645+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:51.663 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 91.796023872000006, 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.664 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:51.665 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:26:51.666 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:51.667 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.668 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:26:51.669 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:26:51.670 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1174 3.34 3:2edb9bfe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.683599090000001, 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024623020999999998, 2024-09-10T15:26:51.671 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1174 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.672 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978206+0000", 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3940000000000004e-06 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.982994+0000", 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047887839999999999 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.673 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983055+0000", 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0418999999999999e-05 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983076+0000", 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0752999999999999e-05 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983249+0000", 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017358299999999999 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.674 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983639+0000", 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038977100000000002 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.984055+0000", 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041571000000000002 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.997740+0000", 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013685235 2024-09-10T15:26:51.675 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002491+0000", 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047511860000000001 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002696+0000", 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204706 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002823+0000", 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012747999999999999 2024-09-10T15:26:51.676 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1184 3.34 3:2ecbe870:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.175435+0000", 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.486364514000002, 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019046837, 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.677 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1184 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175435+0000", 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175435+0000", 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175439+0000", 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4329999999999997e-06 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.178275+0000", 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028354230000000001 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.178326+0000", 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1595999999999999e-05 2024-09-10T15:26:51.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.178349+0000", 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2489000000000001e-05 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.178518+0000", 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016876599999999999 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.178771+0000", 2024-09-10T15:26:51.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025361099999999999 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.179124+0000", 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035275600000000002 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.193497+0000", 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014372922999999999 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194245+0000", 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00074852899999999995 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194365+0000", 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119394 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.194482+0000", 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011691700000000001 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.682 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1193 3.15 3:a820acfb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.375295+0000", 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.286504623999999, 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019125607999999999, 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1193 2024-09-10T15:26:51.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.375295+0000", 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.375295+0000", 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.375298+0000", 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.473e-06 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.378113+0000", 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028148930000000002 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.378161+0000", 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7695000000000003e-05 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.378181+0000", 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0380000000000001e-05 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.378364+0000", 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000183112 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.378720+0000", 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00035606199999999998 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.379002+0000", 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028171000000000001 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.390882+0000", 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011879529999999999 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.394122+0000", 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032409130000000002 2024-09-10T15:26:51.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.394296+0000", 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017350300000000001 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.394420+0000", 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000124337 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1203 3.32 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.696764639000001, 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025222162999999999, 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1203 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965038+0000", 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:26:51.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969717+0000", 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046785730000000001 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969764+0000", 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7676000000000002e-05 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969785+0000", 2024-09-10T15:26:51.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0616e-05 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969895+0000", 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109728 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970109+0000", 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000214553 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970302+0000", 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019275800000000001 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.978686+0000", 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083835560000000003 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989954+0000", 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01126866 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990123+0000", 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016891000000000001 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990257+0000", 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013365299999999999 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1206 3.c 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:51.694 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.637842279000001, 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020855684999999999, 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1206 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023962+0000", 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8099999999999997e-06 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.696 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027160+0000", 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031981259999999999 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027205+0000", 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5460000000000002e-05 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027233+0000", 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7118999999999999e-05 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027404+0000", 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017182300000000001 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027701+0000", 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029708099999999998 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.028039+0000", 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033788900000000002 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.037510+0000", 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094706579999999999 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044590+0000", 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070796729999999999 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044739+0000", 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014925999999999999 2024-09-10T15:26:51.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044813+0000", 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3786000000000001e-05 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1383 3.39 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.672509832999999, 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022778762000000001, 2024-09-10T15:26:51.700 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1383 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989293+0000", 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0599999999999999e-06 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993369+0000", 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040763070000000004 2024-09-10T15:26:51.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993410+0000", 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1038999999999998e-05 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993428+0000", 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7771e-05 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993550+0000", 2024-09-10T15:26:51.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000122576 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993846+0000", 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029542799999999998 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.994081+0000", 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235641 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.009893+0000", 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0158113 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.011974+0000", 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020813630000000001 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012020+0000", 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5734e-05 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012068+0000", 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8542999999999999e-05 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1384 3.2c 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.662031748, 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020364463999999999, 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.706 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1384 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:26:51.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999770+0000", 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4260000000000002e-06 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002633+0000", 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028625120000000002 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.708 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002658+0000", 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5537999999999998e-05 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002674+0000", 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5877000000000001e-05 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002819+0000", 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014549300000000001 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003193+0000", 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037408599999999998 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003510+0000", 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031606700000000001 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.015405+0000", 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011895279 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020063+0000", 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046583550000000003 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020100+0000", 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6780999999999999e-05 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020132+0000", 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.205e-05 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.711 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1709 3.34 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.6604991859999991, 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022337223999999999, 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.712 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1709 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001303+0000", 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9830000000000001e-06 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004358+0000", 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030546330000000002 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004394+0000", 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6616000000000003e-05 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004409+0000", 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5129e-05 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004573+0000", 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016369099999999999 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.005006+0000", 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043294999999999998 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006178+0000", 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011721640000000001 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023441+0000", 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017262323 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023464+0000", 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3828e-05 2024-09-10T15:26:51.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023567+0000", 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102847 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023637+0000", 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0060000000000003e-05 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1718 3.c 3:328a3854:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.xA_hHjoo7scrwl59lEhs4AnaT1c9BOR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.3717345250000008, 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019371422999999999, 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1718 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290068+0000", 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6660000000000001e-06 2024-09-10T15:26:51.719 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292551+0000", 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024821600000000002 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292578+0000", 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6981000000000001e-05 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292590+0000", 2024-09-10T15:26:51.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2105e-05 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292755+0000", 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016553499999999999 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293164+0000", 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040894899999999998 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:51.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293571+0000", 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040694199999999998 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.308210+0000", 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01463879 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309290+0000", 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010800860000000001 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309378+0000", 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7632000000000004e-05 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309436+0000", 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8576999999999998e-05 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1883 3.32 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:51.723 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.922872291, 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021961523, 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1883 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738931+0000", 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741686+0000", 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027550740000000002 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741744+0000", 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.804e-05 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741767+0000", 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2651999999999999e-05 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741908+0000", 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140922 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.742202+0000", 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029458400000000002 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743119+0000", 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091704199999999997 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.754582+0000", 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011462764 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760672+0000", 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006089878 2024-09-10T15:26:51.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760812+0000", 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000139722 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760889+0000", 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6859000000000004e-05 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1892 3.c 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.6755136979999996, 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029189914000000001, 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1892 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986290+0000", 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4870000000000004e-06 2024-09-10T15:26:51.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989074+0000", 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002784361 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989123+0000", 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8331000000000002e-05 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989151+0000", 2024-09-10T15:26:51.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8551000000000002e-05 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989296+0000", 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989452+0000", 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156692 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:51.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989582+0000", 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012952800000000001 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.999285+0000", 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009703181 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.734 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015308+0000", 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016022656 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015406+0000", 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8152000000000005e-05 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015476+0000", 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9512999999999997e-05 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.735 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1905 3.3b 3:dc76b4ec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.32:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.64184076, 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024023249999999999, 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1905 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.736 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019961+0000", 2024-09-10T15:26:51.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6000000000000001e-06 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022708+0000", 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027468420000000002 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022749+0000", 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0791000000000003e-05 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022768+0000", 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9046e-05 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022895+0000", 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126897 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.023194+0000", 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029916699999999998 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.024121+0000", 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092692399999999998 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.038705+0000", 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014584185 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043638+0000", 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049327429999999999 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043847+0000", 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020970200000000001 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043982+0000", 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013435300000000001 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.741 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1947 3.c 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.6964531950000001, 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023953879000000001, 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1947 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965349+0000", 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1e-06 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967022+0000", 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016730709999999999 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967083+0000", 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0693999999999999e-05 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967103+0000", 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9879000000000001e-05 2024-09-10T15:26:51.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967196+0000", 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3284999999999999e-05 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967335+0000", 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138882 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967738+0000", 2024-09-10T15:26:51.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040259999999999997 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.978781+0000", 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011043078 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989144+0000", 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01036346 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989239+0000", 2024-09-10T15:26:51.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5130999999999994e-05 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989300+0000", 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0699000000000003e-05 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1950 3.1b e69/23 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head v 69'11, mlcod=68'9)", 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.5658368730000003, 2024-09-10T15:26:51.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020694515, 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:51.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095963+0000", 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0599999999999999e-07 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103130+0000", 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007167606 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103155+0000", 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5177999999999998e-05 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103166+0000", 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1027e-05 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103252+0000", 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5555000000000003e-05 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103271+0000", 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9106999999999998e-05 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116534+0000", 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013263074999999999 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116657+0000", 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012276100000000001 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2097 3.1c e70/23 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head v 70'8, mlcod=67'6)", 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.4599638699999999, 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019625252999999999, 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201838+0000", 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.553e-06 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206019+0000", 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041808970000000003 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206065+0000", 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5955000000000003e-05 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206084+0000", 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9052e-05 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206282+0000", 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019853399999999999 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206325+0000", 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2117999999999999e-05 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221343+0000", 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015018323 2024-09-10T15:26:51.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221461+0000", 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117821 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2103 3.15 3:a805735b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.300329375, 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022718693000000002, 2024-09-10T15:26:51.756 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2103 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361473+0000", 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2399999999999999e-06 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364075+0000", 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002601885 2024-09-10T15:26:51.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364106+0000", 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0445000000000001e-05 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364118+0000", 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2729e-05 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364284+0000", 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016567700000000001 2024-09-10T15:26:51.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364737+0000", 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045284900000000001 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.365933+0000", 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011964790000000001 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.380849+0000", 2024-09-10T15:26:51.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014915517999999999 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.383771+0000", 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029221669999999998 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384056+0000", 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028503399999999998 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.761 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384189+0000", 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013266999999999999 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2112 3.c 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.0145199199999999, 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021998597000000002, 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.762 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2112 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:26:51.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647284+0000", 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2649999999999998e-06 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649669+0000", 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002385688 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649717+0000", 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7797000000000003e-05 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649738+0000", 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1005999999999998e-05 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649908+0000", 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016979199999999999 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650330+0000", 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042203599999999998 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650750+0000", 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041985699999999999 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.662847+0000", 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012097139999999999 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669092+0000", 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062450279999999997 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669200+0000", 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108378 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669278+0000", 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7609999999999997e-05 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.767 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2115 3.e e70/23 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head v 70'8, mlcod=67'6)", 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.98166758600000004, 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020482499000000001, 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680133+0000", 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.451e-06 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682900+0000", 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027672170000000002 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682934+0000", 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4005999999999999e-05 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682952+0000", 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7608000000000001e-05 2024-09-10T15:26:51.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683128+0000", 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017570300000000001 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683190+0000", 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2507000000000003e-05 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700468+0000", 2024-09-10T15:26:51.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017277682999999999 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700614+0000", 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146324 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2124 3.15 3:aa28aa43:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.GCb3ey1gJiZZ0JvS2IR_yrJtE_qQhyg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.689348497, 2024-09-10T15:26:51.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023070721999999998, 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2124 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972455+0000", 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8360000000000002e-06 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976710+0000", 2024-09-10T15:26:51.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042554769999999997 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976751+0000", 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1307999999999998e-05 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976771+0000", 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:51.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976971+0000", 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019981799999999999 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977371+0000", 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039999099999999999 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977782+0000", 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041056000000000003 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.993874+0000", 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016091668999999999 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995173+0000", 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001299571 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995362+0000", 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018902400000000001 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:51.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995522+0000", 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015942300000000001 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:51.778 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:51.779 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:51.780 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:51.774+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:51.780 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:51.781 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.74 2024-09-10T15:26:51.781 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.781 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 75 2024-09-10T15:26:51.781 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.781 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.781 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00965183 s, 1.1 GB/s 2024-09-10T15:26:51.878 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.75 2024-09-10T15:26:51.879 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:51.879 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 76 2024-09-10T15:26:51.880 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:51.877+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:51.890 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:51.890 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:51.890 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00933956 s, 1.1 GB/s 2024-09-10T15:26:51.979 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:51.979 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:51.979 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:51.979 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:51.980 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:51.974+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:51.982 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:51.982 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:51.994 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:52.000 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:52.000 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:52.020 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:52.021 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:52.037 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.76 2024-09-10T15:26:52.037 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.038 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 77 2024-09-10T15:26:52.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:26:52.048 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:52.049 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:52.049 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.049 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.049 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00926727 s, 1.1 GB/s 2024-09-10T15:26:52.067 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:52.067 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:52.081 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:52.078+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:52.094 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:52.094 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:52.119 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:52.119 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:52.134 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:52.134 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:52.142 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:52.143 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:52.151 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.77 2024-09-10T15:26:52.151 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.151 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 78 2024-09-10T15:26:52.161 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:52.162 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.162 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.162 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00933272 s, 1.1 GB/s 2024-09-10T15:26:52.206 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:52.205+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:52.283 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:52.281+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:52.286 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:52.287 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:52.301 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:52.302 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.78 2024-09-10T15:26:52.302 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.302 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 79 2024-09-10T15:26:52.315 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.315 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.315 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112496 s, 932 MB/s 2024-09-10T15:26:52.385 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:52.382+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:52.423 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:52.423 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:52.437 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:52.445 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.79 2024-09-10T15:26:52.445 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.445 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 80 2024-09-10T15:26:52.455 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.456 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.456 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00888122 s, 1.2 GB/s 2024-09-10T15:26:52.486 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:52.485+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:52.568 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:52.568 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:52.570 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.80 2024-09-10T15:26:52.570 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.570 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 81 2024-09-10T15:26:52.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:52.584 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.584 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.584 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110492 s, 949 MB/s 2024-09-10T15:26:52.634 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:52.633+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:52.688 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:52.685+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:52.697 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.81 2024-09-10T15:26:52.698 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.698 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 82 2024-09-10T15:26:52.711 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.711 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.711 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110484 s, 949 MB/s 2024-09-10T15:26:52.711 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:52.711 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:52.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:52.789 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:52.782+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:52.831 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.82 2024-09-10T15:26:52.831 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.831 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 83 2024-09-10T15:26:52.842 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.842 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.842 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00953073 s, 1.1 GB/s 2024-09-10T15:26:52.886 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:52.887 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:52.889 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:52.885+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:52.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:52.966 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.83 2024-09-10T15:26:52.966 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:52.966 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 84 2024-09-10T15:26:52.976 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:52.976 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:52.976 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00880624 s, 1.2 GB/s 2024-09-10T15:26:52.990 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:52.985+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:53.032 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:26:53.079 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:53.079 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:53.090 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.84 2024-09-10T15:26:53.090 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.090 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 85 2024-09-10T15:26:53.091 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:53.086+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:53.096 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:53.101 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.101 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.101 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00946623 s, 1.1 GB/s 2024-09-10T15:26:53.191 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:53.186+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:53.219 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.85 2024-09-10T15:26:53.219 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.219 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 86 2024-09-10T15:26:53.222 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:53.223 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:53.232 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.233 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.233 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112879 s, 929 MB/s 2024-09-10T15:26:53.239 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:53.292 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:53.286+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:53.337 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.86 2024-09-10T15:26:53.337 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.337 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 87 2024-09-10T15:26:53.352 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.353 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.353 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124338 s, 843 MB/s 2024-09-10T15:26:53.373 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:53.373 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:53.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:53.393 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:53.389+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:53.483 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.87 2024-09-10T15:26:53.483 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.483 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 88 2024-09-10T15:26:53.494 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:53.490+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:53.498 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.498 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.498 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124034 s, 845 MB/s 2024-09-10T15:26:53.555 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:53.555 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:53.569 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:53.596 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:53.593+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:53.633 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.88 2024-09-10T15:26:53.633 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.633 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 89 2024-09-10T15:26:53.651 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.651 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.651 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0142731 s, 735 MB/s 2024-09-10T15:26:53.697 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:53.690+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:53.737 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:53.737 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:53.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:53.798 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:53.793+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:53.803 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.89 2024-09-10T15:26:53.803 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.803 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 90 2024-09-10T15:26:53.817 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.817 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.817 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114128 s, 919 MB/s 2024-09-10T15:26:53.898 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:53.894+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:53.919 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:53.920 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:53.938 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:53.946 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.90 2024-09-10T15:26:53.946 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:53.946 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 91 2024-09-10T15:26:53.961 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:53.962 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:53.962 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127157 s, 825 MB/s 2024-09-10T15:26:53.999 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:53.997+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:54.094 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.91 2024-09-10T15:26:54.095 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.095 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 92 2024-09-10T15:26:54.100 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:54.094+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:54.110 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.110 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.110 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129181 s, 812 MB/s 2024-09-10T15:26:54.118 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:54.119 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:54.133 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:54.165 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:54.222 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:54.218+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:54.232 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.92 2024-09-10T15:26:54.232 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.233 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 93 2024-09-10T15:26:54.243 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.243 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.243 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00931034 s, 1.1 GB/s 2024-09-10T15:26:54.302 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:54.298+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:54.306 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:54.306 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:54.320 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:54.320 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:54.321 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:54.337 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:54.338 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:54.351 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.93 2024-09-10T15:26:54.351 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.351 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 94 2024-09-10T15:26:54.358 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:54.358 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:54.361 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.361 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.362 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00899549 s, 1.2 GB/s 2024-09-10T15:26:54.375 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:54.375 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:54.393 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:54.394 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:54.403 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:54.401+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:54.424 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:54.425 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:54.445 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:54.445 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:54.463 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.94 2024-09-10T15:26:54.463 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.463 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 95 2024-09-10T15:26:54.465 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:54.466 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:54.477 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.477 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.477 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122615 s, 855 MB/s 2024-09-10T15:26:54.489 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:54.489 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:54.489 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:54.489 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:54.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:54.504 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:54.498+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:54.580 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.95 2024-09-10T15:26:54.580 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.580 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 96 2024-09-10T15:26:54.594 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.594 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.594 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113006 s, 928 MB/s 2024-09-10T15:26:54.604 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:54.598+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:54.619 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:54.619 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:54.619 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:54.619 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:54.619 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:54.633 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:54.721 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:54.718+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:54.743 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.96 2024-09-10T15:26:54.743 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.743 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 97 2024-09-10T15:26:54.758 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.758 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.758 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124894 s, 840 MB/s 2024-09-10T15:26:54.806 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:54.805+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:54.807 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:54.807 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:54.807 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.726559049999999, 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.808 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.809 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:54.810 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.811 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.812 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:54.813 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.475427744000001, 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.814 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.815 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:54.816 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.817 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.818 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:54.819 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 26.766854143, 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.820 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.821 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.822 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:54.823 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:54.824 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.825 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:54.826 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 26.747584604, 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:54.827 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:54.828 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.829 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:54.830 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:54.830 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.830 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.830 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.830 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.831 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.832 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:54.833 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 26.607041603999999, 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:54.834 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:54.835 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.836 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.837 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.838 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.839 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.502619428999999, 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.840 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:54.841 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.842 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.843 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.844 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:54.844 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:54.844 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.844 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.844 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:54.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:54.845 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:54.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.845 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.845 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.845 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:54.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:54.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.846 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.846 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.846 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:54.846 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.847 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:54.848 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.338418718, 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.849 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:54.850 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:54.851 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.852 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.329368035000002, 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.853 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.854 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.857 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.858 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.781199883999999, 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.859 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.860 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:54.861 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:54.862 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:54.863 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:54.864 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.594168930999999, 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.865 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:54.866 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:54.867 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.868 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.869 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.565755762999999, 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.870 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.871 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:54.872 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:54.873 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.874 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.875 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1721 3.33 3:cfb68b2a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.491138814999999, 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020343915000000001, 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.876 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1721 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.877 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311667+0000", 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3910000000000001e-06 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316763+0000", 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050959029999999997 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316790+0000", 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6727999999999999e-05 2024-09-10T15:26:54.878 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316802+0000", 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2153999999999999e-05 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316888+0000", 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5977999999999996e-05 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317094+0000", 2024-09-10T15:26:54.879 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020637499999999999 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317643+0000", 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054915499999999996 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.329834+0000", 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012190278000000001 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.880 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331874+0000", 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020404440000000002 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331950+0000", 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5819e-05 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.332009+0000", 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8690000000000002e-05 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.881 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1724 3.4 3:203b9278:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.U2tLU59DNduvi7Dw7_6LkcaIJjGttfg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.368663399999999, 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021171696, 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.882 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1724 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.883 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434143+0000", 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2370000000000001e-06 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439034+0000", 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048902920000000001 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439072+0000", 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8787e-05 2024-09-10T15:26:54.884 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439092+0000", 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9108999999999999e-05 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439188+0000", 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6487e-05 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439322+0000", 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013430500000000001 2024-09-10T15:26:54.885 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439420+0000", 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7343000000000006e-05 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.447315+0000", 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007895394 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.886 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455236+0000", 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079208339999999999 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455277+0000", 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1248000000000002e-05 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455312+0000", 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4659999999999997e-05 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.887 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1909 3.24 3:27a2e717:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.bEh9hCKsxr8uubu13gXHdP3NKsc9b___2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.6663279620000004, 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020638806999999999, 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.888 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1909 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.889 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136479+0000", 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9960000000000002e-06 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138833+0000", 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023546610000000001 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138859+0000", 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5616999999999999e-05 2024-09-10T15:26:54.890 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138871+0000", 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139035+0000", 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016393199999999999 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.891 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139394+0000", 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035952599999999999 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139610+0000", 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021574100000000001 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.143897+0000", 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042874660000000002 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.156917+0000", 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013019519 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157010+0000", 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2857999999999998e-05 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157114+0000", 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104731 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.893 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1917 3.24 3:24837641:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.4719382190000001, 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021840252000000001, 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1917 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.894 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.895 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330868+0000", 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5399999999999998e-06 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335714+0000", 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00484594 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335754+0000", 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0175000000000001e-05 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.896 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335780+0000", 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5678e-05 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335921+0000", 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141085 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.336222+0000", 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030169300000000001 2024-09-10T15:26:54.897 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.337135+0000", 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091279700000000002 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352078+0000", 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014942337 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352534+0000", 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045644199999999999 2024-09-10T15:26:54.898 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352637+0000", 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103398 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352706+0000", 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8167e-05 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.899 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1929 3.24 3:259692f9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.36:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.2119026989999995, 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019827279, 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1929 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.900 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.901 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590905+0000", 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4700000000000004e-06 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597424+0000", 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065183810000000002 2024-09-10T15:26:54.902 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.904 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.904 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.904 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597470+0000", 2024-09-10T15:26:54.904 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6811000000000003e-05 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597491+0000", 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597622+0000", 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000131834 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.905 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597783+0000", 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016109100000000001 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.598360+0000", 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00057640399999999998 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.609671+0000", 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011310661 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.906 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610525+0000", 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085494 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610650+0000", 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012418299999999999 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610728+0000", 2024-09-10T15:26:54.907 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8459000000000002e-05 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1953 3.25 3:a444f990:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.40:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.6824305910000001, 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021829541000000001, 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.908 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1953 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:54.909 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120376+0000", 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3330000000000001e-06 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124380+0000", 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040035380000000001 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.910 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124417+0000", 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7492e-05 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124435+0000", 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8122999999999999e-05 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124627+0000", 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019198800000000001 2024-09-10T15:26:54.911 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124910+0000", 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000282198 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.125832+0000", 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00092200300000000002 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.139934+0000", 2024-09-10T15:26:54.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01410264 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.141879+0000", 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019445059999999999 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142069+0000", 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018991799999999999 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142202+0000", 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133802 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2085 3.25 3:a5fb1ce4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.928187179, 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023491656999999999, 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.914 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2085 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874619+0000", 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5100000000000001e-06 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879012+0000", 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043931630000000003 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879049+0000", 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7279e-05 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879067+0000", 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7447000000000001e-05 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879207+0000", 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014021899999999999 2024-09-10T15:26:54.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879489+0000", 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028163800000000002 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.880391+0000", 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090249099999999995 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.894924+0000", 2024-09-10T15:26:54.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01453337 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.897971+0000", 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030460660000000001 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898053+0000", 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2109999999999998e-05 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898108+0000", 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5364000000000001e-05 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2170 3.24 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 2.9826492999999998, 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.028850750000000001, 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.920 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2170 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:26:54.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820158+0000", 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.16e-06 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826694+0000", 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065359559999999999 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826734+0000", 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9332000000000002e-05 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826752+0000", 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8249000000000001e-05 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826937+0000", 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018492500000000001 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.827362+0000", 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042493199999999999 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.827789+0000", 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000427601 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.846915+0000", 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019125362999999999 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.848838+0000", 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001923264 2024-09-10T15:26:54.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.848935+0000", 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6840000000000001e-05 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.849005+0000", 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0128000000000003e-05 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2176 3.33 3:cc56d434:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.H48R23l9n0VubS_yIX4DYDGVDMz265g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 2.843481664, 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020038224, 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2176 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.927 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959325+0000", 2024-09-10T15:26:54.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8930000000000001e-06 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963408+0000", 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040833370000000003 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963447+0000", 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8458999999999999e-05 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:54.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963465+0000", 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8236e-05 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963624+0000", 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015870899999999999 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963897+0000", 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027347599999999998 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.964130+0000", 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023336299999999999 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.973568+0000", 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094378980000000001 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979097+0000", 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055289939999999997 2024-09-10T15:26:54.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979245+0000", 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014776599999999999 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979360+0000", 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115093 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:54.932 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:54.933 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:54.934 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.97 2024-09-10T15:26:54.934 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:54.934 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 98 2024-09-10T15:26:54.934 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:54.934 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:54.935 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012329 s, 850 MB/s 2024-09-10T15:26:54.935 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:54.933+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:54.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:55.034 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:55.030+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:55.062 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.98 2024-09-10T15:26:55.062 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:55.062 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 99 2024-09-10T15:26:55.068 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:26:55.078 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:55.078 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:55.078 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127893 s, 820 MB/s 2024-09-10T15:26:55.114 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:55.115 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:55.115 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:55.115 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:55.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:55.135 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:55.133+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:55.197 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.99 2024-09-10T15:26:55.198 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:26:55.198 INFO:tasks.workunit.client.0.smithi099.stdout:uploading file - part 100 2024-09-10T15:26:55.212 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records in 2024-09-10T15:26:55.212 INFO:tasks.workunit.client.0.smithi099.stderr:1+0 records out 2024-09-10T15:26:55.212 INFO:tasks.workunit.client.0.smithi099.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117951 s, 889 MB/s 2024-09-10T15:26:55.236 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:55.233+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:55.302 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:55.302 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:55.303 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:55.303 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:55.303 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:55.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:55.337 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:55.333+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:55.438 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:55.434+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:55.453 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:55.453 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:55.453 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.506333305999998, 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.454 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:55.455 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.456 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.457 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.458 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.459 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:55.460 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:55.461 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.462 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.326059703999999, 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.463 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.464 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:55.465 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:55.466 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.467 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.468 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.469 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.470 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:55.471 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.300235909000001, 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.472 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.473 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.474 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.475 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:55.476 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:55.477 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:55.478 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.479 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:55.480 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.190852657000001, 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:55.481 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.482 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.483 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.484 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.485 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.486 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.134933663999998, 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.487 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.488 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.489 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.490 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.491 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.492 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:55.493 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:55.494 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.495 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.048697867000001, 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.496 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:26:55.498 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:26:55.499 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:26:55.500 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.501 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.501 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:26:55.501 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:26:55.501 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.501 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:55.502 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:26:55.502 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:26:55.502 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.502 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.502 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:26:55.503 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:26:55.503 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.503 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.503 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.503 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.504 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.505 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.024721973999998, 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.506 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:55.507 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.508 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.509 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.510 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:26:55.511 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.512 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.246248606000002, 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.513 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.514 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.515 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:26:55.516 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.229383626000001, 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:26:55.517 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.518 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:26:55.519 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:26:55.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.520 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.520 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.520 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:26:55.520 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:26:55.520 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:26:55.521 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.522 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:26:55.523 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.524 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.190460868999999, 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.525 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.526 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:26:55.527 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.529 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:26:55.530 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.178305396999999, 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.531 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.532 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.533 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:26:55.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.535 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:26:55.536 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.473385486, 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:26:55.537 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.538 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.539 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.540 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1739 3.8 e67/23 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head v 67'4, mlcod=63'2)", 2024-09-10T15:26:55.541 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.753549556999999, 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018473534, 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:55.542 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695653+0000", 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7039999999999999e-06 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699886+0000", 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042333459999999998 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.543 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699927+0000", 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0457999999999998e-05 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699951+0000", 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4754999999999999e-05 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700106+0000", 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015423699999999999 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.544 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700152+0000", 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6802999999999999e-05 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.713994+0000", 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013841579 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714124+0000", 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012965200000000001 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.545 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1877 3.b 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.8799204340000006, 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023807905000000001, 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1877 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.546 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.547 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569281+0000", 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.024e-06 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573676+0000", 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043950930000000001 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573702+0000", 2024-09-10T15:26:55.548 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5802000000000001e-05 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573713+0000", 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0386e-05 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.549 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573906+0000", 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000193742 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.574173+0000", 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000266884 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575041+0000", 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086814499999999996 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.550 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592140+0000", 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017098242 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592884+0000", 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074462200000000001 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592997+0000", 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011323 2024-09-10T15:26:55.551 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.593087+0000", 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9734999999999994e-05 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1892 3.c e68/23 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head v 68'8, mlcod=67'6)", 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.4600425599999998, 2024-09-10T15:26:55.552 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024892474000000001, 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.553 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989159+0000", 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1100000000000001e-06 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994450+0000", 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052911779999999997 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994487+0000", 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6563999999999998e-05 2024-09-10T15:26:55.554 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994504+0000", 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6906e-05 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994695+0000", 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019078500000000001 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994745+0000", 2024-09-10T15:26:55.555 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0583e-05 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.013894+0000", 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019148603 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.014050+0000", 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015574499999999999 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1947 3.c e69/23 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head v 69'9, mlcod=68'7)", 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.4819137040000001, 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020674089999999999, 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.557 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967287+0000", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4700000000000001e-07 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974827+0000", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075409240000000001 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.558 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974856+0000", 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8119e-05 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974871+0000", 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5189e-05 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974968+0000", 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7460999999999994e-05 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.559 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.975009+0000", 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0268000000000001e-05 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987873+0000", 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01286399 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987960+0000", 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7591999999999998e-05 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.560 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2109 3.23 e70/23 3:c4c10ed7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.66:head v 70'14, mlcod=67'12)", 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.9366455079999998, 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020231979000000001, 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.561 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512557+0000", 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.562 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517394+0000", 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048370799999999997 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517433+0000", 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8982e-05 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517451+0000", 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7672999999999998e-05 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.563 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517620+0000", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169409 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517685+0000", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5240999999999994e-05 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532706+0000", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015020436 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.564 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532786+0000", 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0581999999999995e-05 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2112 3.c e70/23 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head v 70'10, mlcod=68'8)", 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7988227600000002, 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017546361, 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.565 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650378+0000", 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6700000000000003e-07 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.566 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656693+0000", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063148220000000003 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656733+0000", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9981999999999998e-05 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656751+0000", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8853000000000001e-05 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.567 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656852+0000", 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100608 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656881+0000", 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9377999999999999e-05 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667779+0000", 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010897232 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667923+0000", 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014471899999999999 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2118 3.3f 3:fd7c3aaf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.6OutWCbOnJUoR6EgAd38lwPhVbxENPy_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.643091869, 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031726504000000003, 2024-09-10T15:26:55.569 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2118 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806111+0000", 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4570000000000001e-06 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811285+0000", 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051735699999999997 2024-09-10T15:26:55.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811321+0000", 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6455000000000002e-05 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811340+0000", 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8887000000000001e-05 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811478+0000", 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137362 2024-09-10T15:26:55.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811749+0000", 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027095 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811968+0000", 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021936699999999999 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.828291+0000", 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016322691 2024-09-10T15:26:55.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837605+0000", 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093144179999999997 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837701+0000", 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6033999999999996e-05 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837834+0000", 2024-09-10T15:26:55.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133313 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2317 3.3f 3:fe380e92:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.TMyG-M8R-iMnSIXgNMZF9cDGYU85EU6_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 0.29509758400000002, 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022281011999999999, 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:55.575 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2317 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:26:55.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154107+0000", 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5329999999999996e-06 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162076+0000", 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079692389999999995 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162115+0000", 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9569e-05 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162134+0000", 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8422000000000001e-05 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162310+0000", 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017659199999999999 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162481+0000", 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017045999999999999 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162645+0000", 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016447200000000001 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:55.579 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.172417+0000", 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097715030000000008 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176269+0000", 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003852014 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176334+0000", 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5055999999999995e-05 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:55.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176383+0000", 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9152e-05 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:55.581 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:55.582 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:26:55.583 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:55.581+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:55.683 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:55.678+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:55.710 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:55.710 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:55.710 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:55.725 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:26:55.784 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:55.781+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:55.845 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:55.845 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:55.845 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:55.860 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:26:55.902 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:55.901+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:55.986 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:55.982+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:56.041 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:56.041 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:26:56.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 96.171906973999995, 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.042 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.043 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:26:56.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:26:56.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:26:56.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1174 3.34 3:2edb9bfe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.059482192000001, 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024623020999999998, 2024-09-10T15:26:56.049 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1174 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978206+0000", 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3940000000000004e-06 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.982994+0000", 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047887839999999999 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983055+0000", 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0418999999999999e-05 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983076+0000", 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0752999999999999e-05 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983249+0000", 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017358299999999999 2024-09-10T15:26:56.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983639+0000", 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038977100000000002 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.984055+0000", 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041571000000000002 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.997740+0000", 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013685235 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002491+0000", 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047511860000000001 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002696+0000", 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204706 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002823+0000", 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012747999999999999 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1203 3.32 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.072647741000001, 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025222162999999999, 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.055 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1203 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965038+0000", 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969717+0000", 2024-09-10T15:26:56.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046785730000000001 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969764+0000", 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7676000000000002e-05 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969785+0000", 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0616e-05 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969895+0000", 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109728 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970109+0000", 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000214553 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970302+0000", 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019275800000000001 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.978686+0000", 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083835560000000003 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989954+0000", 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01126866 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990123+0000", 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016891000000000001 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990257+0000", 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013365299999999999 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1206 3.c 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.013725381, 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020855684999999999, 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.061 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1206 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023962+0000", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8099999999999997e-06 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027160+0000", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031981259999999999 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027205+0000", 2024-09-10T15:26:56.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5460000000000002e-05 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027233+0000", 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7118999999999999e-05 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027404+0000", 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017182300000000001 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027701+0000", 2024-09-10T15:26:56.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029708099999999998 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.028039+0000", 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033788900000000002 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.037510+0000", 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094706579999999999 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044590+0000", 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070796729999999999 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044739+0000", 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014925999999999999 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044813+0000", 2024-09-10T15:26:56.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3786000000000001e-05 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1383 3.39 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.048392934999999, 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022778762000000001, 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.067 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1383 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989293+0000", 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0599999999999999e-06 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993369+0000", 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040763070000000004 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993410+0000", 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1038999999999998e-05 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993428+0000", 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7771e-05 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993550+0000", 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000122576 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.070 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993846+0000", 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029542799999999998 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.994081+0000", 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235641 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.009893+0000", 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0158113 2024-09-10T15:26:56.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.011974+0000", 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020813630000000001 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012020+0000", 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5734e-05 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012068+0000", 2024-09-10T15:26:56.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8542999999999999e-05 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1384 3.2c 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.03791485, 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020364463999999999, 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.073 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1384 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:26:56.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999770+0000", 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4260000000000002e-06 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002633+0000", 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028625120000000002 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002658+0000", 2024-09-10T15:26:56.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5537999999999998e-05 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002674+0000", 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5877000000000001e-05 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002819+0000", 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014549300000000001 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003193+0000", 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037408599999999998 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003510+0000", 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031606700000000001 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.015405+0000", 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011895279 2024-09-10T15:26:56.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020063+0000", 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046583550000000003 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020100+0000", 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6780999999999999e-05 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020132+0000", 2024-09-10T15:26:56.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.205e-05 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1709 3.34 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.036382288, 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022337223999999999, 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1709 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:26:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001303+0000", 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9830000000000001e-06 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004358+0000", 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030546330000000002 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004394+0000", 2024-09-10T15:26:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6616000000000003e-05 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004409+0000", 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5129e-05 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004573+0000", 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016369099999999999 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.005006+0000", 2024-09-10T15:26:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043294999999999998 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006178+0000", 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011721640000000001 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023441+0000", 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017262323 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023464+0000", 2024-09-10T15:26:56.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3828e-05 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023567+0000", 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102847 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023637+0000", 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0060000000000003e-05 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1718 3.c 3:328a3854:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.xA_hHjoo7scrwl59lEhs4AnaT1c9BOR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.747617627, 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019371422999999999, 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1718 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290068+0000", 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6660000000000001e-06 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292551+0000", 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024821600000000002 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292578+0000", 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6981000000000001e-05 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292590+0000", 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2105e-05 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292755+0000", 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016553499999999999 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293164+0000", 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040894899999999998 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293571+0000", 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040694199999999998 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.308210+0000", 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01463879 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309290+0000", 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010800860000000001 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309378+0000", 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7632000000000004e-05 2024-09-10T15:26:56.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309436+0000", 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8576999999999998e-05 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1883 3.32 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.298755393, 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021961523, 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.090 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1883 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738931+0000", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741686+0000", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027550740000000002 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741744+0000", 2024-09-10T15:26:56.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.804e-05 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741767+0000", 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2651999999999999e-05 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741908+0000", 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140922 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.742202+0000", 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029458400000000002 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743119+0000", 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091704199999999997 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.754582+0000", 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011462764 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760672+0000", 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006089878 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760812+0000", 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000139722 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760889+0000", 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6859000000000004e-05 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.095 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1892 3.c 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.051396799999999, 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029189914000000001, 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1892 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.096 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986290+0000", 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4870000000000004e-06 2024-09-10T15:26:56.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989074+0000", 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002784361 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989123+0000", 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8331000000000002e-05 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989151+0000", 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8551000000000002e-05 2024-09-10T15:26:56.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989296+0000", 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989452+0000", 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156692 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989582+0000", 2024-09-10T15:26:56.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012952800000000001 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.999285+0000", 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009703181 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015308+0000", 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016022656 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015406+0000", 2024-09-10T15:26:56.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8152000000000005e-05 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015476+0000", 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9512999999999997e-05 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1905 3.3b 3:dc76b4ec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.32:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:26:56.101 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.017723862, 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024023249999999999, 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1905 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019961+0000", 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6000000000000001e-06 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022708+0000", 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027468420000000002 2024-09-10T15:26:56.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022749+0000", 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0791000000000003e-05 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022768+0000", 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9046e-05 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022895+0000", 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126897 2024-09-10T15:26:56.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.023194+0000", 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029916699999999998 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.024121+0000", 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092692399999999998 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.038705+0000", 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014584185 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043638+0000", 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049327429999999999 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043847+0000", 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020970200000000001 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043982+0000", 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013435300000000001 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1947 3.c 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:26:56.107 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.0723362969999997, 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023953879000000001, 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1947 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965349+0000", 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1e-06 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967022+0000", 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016730709999999999 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967083+0000", 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0693999999999999e-05 2024-09-10T15:26:56.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967103+0000", 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9879000000000001e-05 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967196+0000", 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3284999999999999e-05 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967335+0000", 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138882 2024-09-10T15:26:56.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967738+0000", 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040259999999999997 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.978781+0000", 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011043078 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989144+0000", 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01036346 2024-09-10T15:26:56.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989239+0000", 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5130999999999994e-05 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989300+0000", 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0699000000000003e-05 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.113 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1950 3.1b e69/23 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head v 69'11, mlcod=68'9)", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.9417199749999998, 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020694515, 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:26:56.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095963+0000", 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0599999999999999e-07 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103130+0000", 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007167606 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103155+0000", 2024-09-10T15:26:56.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5177999999999998e-05 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103166+0000", 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1027e-05 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103252+0000", 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5555000000000003e-05 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103271+0000", 2024-09-10T15:26:56.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9106999999999998e-05 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116534+0000", 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013263074999999999 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116657+0000", 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012276100000000001 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2097 3.1c e70/23 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head v 70'8, mlcod=67'6)", 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.8358469719999997, 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019625252999999999, 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201838+0000", 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.553e-06 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206019+0000", 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041808970000000003 2024-09-10T15:26:56.119 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206065+0000", 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5955000000000003e-05 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206084+0000", 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9052e-05 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206282+0000", 2024-09-10T15:26:56.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019853399999999999 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206325+0000", 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2117999999999999e-05 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221343+0000", 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015018323 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221461+0000", 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117821 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2103 3.15 3:a805735b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.676212477, 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022718693000000002, 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.122 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2103 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361473+0000", 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2399999999999999e-06 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364075+0000", 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002601885 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364106+0000", 2024-09-10T15:26:56.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0445000000000001e-05 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364118+0000", 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2729e-05 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364284+0000", 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016567700000000001 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364737+0000", 2024-09-10T15:26:56.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045284900000000001 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.365933+0000", 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011964790000000001 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.380849+0000", 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014915517999999999 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.383771+0000", 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029221669999999998 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384056+0000", 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028503399999999998 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384189+0000", 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013266999999999999 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.127 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2112 3.c 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.3904030220000001, 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021998597000000002, 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.128 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2112 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647284+0000", 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2649999999999998e-06 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649669+0000", 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002385688 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649717+0000", 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7797000000000003e-05 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649738+0000", 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1005999999999998e-05 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649908+0000", 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016979199999999999 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650330+0000", 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042203599999999998 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650750+0000", 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041985699999999999 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.662847+0000", 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012097139999999999 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669092+0000", 2024-09-10T15:26:56.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062450279999999997 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669200+0000", 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108378 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669278+0000", 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7609999999999997e-05 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2115 3.e e70/23 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head v 70'8, mlcod=67'6)", 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.3575506879999999, 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020482499000000001, 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:26:56.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680133+0000", 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.451e-06 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682900+0000", 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027672170000000002 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682934+0000", 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4005999999999999e-05 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682952+0000", 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7608000000000001e-05 2024-09-10T15:26:56.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683128+0000", 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017570300000000001 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683190+0000", 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2507000000000003e-05 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700468+0000", 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017277682999999999 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700614+0000", 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146324 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2124 3.15 3:aa28aa43:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.GCb3ey1gJiZZ0JvS2IR_yrJtE_qQhyg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:26:56.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.0652315989999996, 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023070721999999998, 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2124 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972455+0000", 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8360000000000002e-06 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976710+0000", 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042554769999999997 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976751+0000", 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1307999999999998e-05 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976771+0000", 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:26:56.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976971+0000", 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019981799999999999 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977371+0000", 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039999099999999999 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977782+0000", 2024-09-10T15:26:56.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041056000000000003 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.993874+0000", 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016091668999999999 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995173+0000", 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001299571 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995362+0000", 2024-09-10T15:26:56.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018902400000000001 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995522+0000", 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015942300000000001 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2170 3.24 e70/23 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head v 70'12, mlcod=68'10)", 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:26:56.146 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 4.2087764400000003, 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020388610000000001, 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828909+0000", 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840061+0000", 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011152072000000001 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840089+0000", 2024-09-10T15:26:56.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8186000000000001e-05 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840104+0000", 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4721e-05 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840209+0000", 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105283 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840244+0000", 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.502e-05 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849236+0000", 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089918459999999995 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849295+0000", 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8631999999999997e-05 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2311 3.38 e71/23 3:1f5d1b31:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.CbmyYpo0pl88KNJFZ0NLOldB0HRNzU2_1:head v 71'9, mlcod=71'7)", 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 1.024976551, 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024560713000000001, 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.151 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012708+0000", 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4590000000000001e-06 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017270+0000", 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045614360000000003 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017312+0000", 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1983000000000001e-05 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017333+0000", 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1324000000000001e-05 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017497+0000", 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016356899999999999 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017567+0000", 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0171000000000003e-05 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037115+0000", 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019548660999999998 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037267+0000", 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015111000000000001 2024-09-10T15:26:56.154 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:26:56.155 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:26:56.155 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:56.155 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:26:56.156 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:26:56.158 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:56.150+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:56.257 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:56.253+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:56.338 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:56.339 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:26:56.339 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:56.353 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:26:56.394 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:56.393+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:56.459 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:56.457+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:56.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:26:56.521 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:26:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:26:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:26:56.521 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:26:56.521 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:26:56.536 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:26:56.578 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:56.577+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:56.640 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:56.640 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:56.657 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:56.657 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:56.661 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:56.654+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:56.674 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:56.674 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:56.690 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:56.711 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:26:56.712 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:56.713 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:56.732 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:56.732 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:56.754 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:56.754 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:56.761 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:56.757+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:56.791 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:56.791 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:56.831 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:56.832 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:56.845 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:26:56.886 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:56.885+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:56.964 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:56.961+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:57.003 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:57.003 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:57.020 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:26:57.106 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:57.105+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:57.166 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:57.161+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:57.199 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:57.199 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:57.214 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:26:57.267 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:57.266+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:57.368 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:57.365+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:57.430 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:57.430 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:57.444 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:26:57.486 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:57.485+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:57.570 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:57.570+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:57.608 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:57.609 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:57.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:26:57.671 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:57.670+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:57.745 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:57.745 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:57.760 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:26:57.806 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:57.802+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:57.873 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:57.869+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:57.897 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:57.897 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:57.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:26:57.974 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:57.969+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:58.074 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:26:58.070+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:26:58.085 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:58.085 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:58.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:26:58.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-10T15:26:58.210 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:58.209+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:58.269 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:58.269 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:58.277 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:26:58.273+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:26:58.284 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:26:58.377 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:58.374+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:58.408 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:58.408 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:58.422 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:26:58.478 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:58.477+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:58.579 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:58.577+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:58.592 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:58.592 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:58.606 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:26:58.680 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:58.674+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:58.735 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:58.735 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:58.749 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:26:58.794 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:58.790+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:58.809 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:26:58.881 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:58.878+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:58.921 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:26:58.922 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:26:58.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:26:58.953 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:26:58.954 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:26:58.970 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:26:58.971 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:26:58.987 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:26:58.987 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:26:59.007 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:26:59.008 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:26:59.021 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:26:59.018+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:26:59.025 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:26:59.025 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:26:59.043 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:26:59.043 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:26:59.068 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:26:59.068 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:26:59.078 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is set 2024-09-10T15:26:59.083 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:59.081+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:59.092 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:26:59.092 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:26:59.101 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:59.101 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:59.102 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:59.102 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:59.102 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:59.115 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:26:59.202 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:59.198+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:59.285 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:59.281+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.207339763, 2024-09-10T15:26:59.288 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.289 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.290 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:26:59.291 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:26:59.292 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.293 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.956208456999999, 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.294 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:26:59.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:26:59.297 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.299 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.247634856000001, 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:26:59.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:26:59.301 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:26:59.302 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:26:59.303 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:26:59.304 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.228365317000002, 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.306 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.307 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.308 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.309 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:26:59.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.087822317000001, 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:26:59.311 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.312 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.313 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.314 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.315 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.316 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.983400142000001, 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.317 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:26:59.318 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:26:59.319 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:26:59.320 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:26:59.321 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.819199431000001, 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:26:59.322 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.323 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.324 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:26:59.325 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.326 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.810148748, 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.327 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:26:59.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:26:59.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:26:59.330 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.261980597000001, 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.331 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.332 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.333 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.334 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.335 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.336 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.074949644, 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.337 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:26:59.338 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.339 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.340 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.341 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.046536476, 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.342 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.343 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:26:59.344 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:26:59.345 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:26:59.346 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.347 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1721 3.33 3:cfb68b2a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.971919528000001, 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020343915000000001, 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1721 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.348 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311667+0000", 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3910000000000001e-06 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.349 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316763+0000", 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050959029999999997 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316790+0000", 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6727999999999999e-05 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316802+0000", 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2153999999999999e-05 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.350 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316888+0000", 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5977999999999996e-05 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317094+0000", 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020637499999999999 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317643+0000", 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054915499999999996 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.351 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.329834+0000", 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012190278000000001 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331874+0000", 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020404440000000002 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331950+0000", 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5819e-05 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.352 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.332009+0000", 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8690000000000002e-05 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1724 3.4 3:203b9278:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.U2tLU59DNduvi7Dw7_6LkcaIJjGttfg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.849444113000001, 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021171696, 2024-09-10T15:26:59.353 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1724 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.354 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434143+0000", 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2370000000000001e-06 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439034+0000", 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048902920000000001 2024-09-10T15:26:59.355 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439072+0000", 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8787e-05 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439092+0000", 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9108999999999999e-05 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.356 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439188+0000", 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6487e-05 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439322+0000", 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013430500000000001 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439420+0000", 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7343000000000006e-05 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.357 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.447315+0000", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007895394 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455236+0000", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079208339999999999 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455277+0000", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1248000000000002e-05 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455312+0000", 2024-09-10T15:26:59.358 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4659999999999997e-05 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1909 3.24 3:27a2e717:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.bEh9hCKsxr8uubu13gXHdP3NKsc9b___2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.147108675, 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020638806999999999, 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.359 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1909 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136479+0000", 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9960000000000002e-06 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138833+0000", 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023546610000000001 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138859+0000", 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5616999999999999e-05 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138871+0000", 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.362 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139035+0000", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016393199999999999 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139394+0000", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035952599999999999 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139610+0000", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021574100000000001 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.143897+0000", 2024-09-10T15:26:59.363 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042874660000000002 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.156917+0000", 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013019519 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157010+0000", 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2857999999999998e-05 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157114+0000", 2024-09-10T15:26:59.364 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104731 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1917 3.24 3:24837641:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.952718932, 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021840252000000001, 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.365 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1917 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330868+0000", 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5399999999999998e-06 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335714+0000", 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00484594 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335754+0000", 2024-09-10T15:26:59.367 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0175000000000001e-05 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335780+0000", 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5678e-05 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335921+0000", 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141085 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.336222+0000", 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030169300000000001 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.369 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.337135+0000", 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091279700000000002 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352078+0000", 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014942337 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352534+0000", 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045644199999999999 2024-09-10T15:26:59.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352637+0000", 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103398 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352706+0000", 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8167e-05 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1929 3.24 3:259692f9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.36:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.692683412000001, 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019827279, 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1929 2024-09-10T15:26:59.372 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.373 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590905+0000", 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4700000000000004e-06 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597424+0000", 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065183810000000002 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597470+0000", 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6811000000000003e-05 2024-09-10T15:26:59.374 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597491+0000", 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597622+0000", 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000131834 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.375 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597783+0000", 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016109100000000001 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.598360+0000", 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00057640399999999998 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.609671+0000", 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011310661 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.376 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610525+0000", 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085494 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610650+0000", 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012418299999999999 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610728+0000", 2024-09-10T15:26:59.377 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8459000000000002e-05 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1953 3.25 3:a444f990:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.40:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.163211304000001, 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021829541000000001, 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.378 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1953 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.379 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120376+0000", 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3330000000000001e-06 2024-09-10T15:26:59.380 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124380+0000", 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040035380000000001 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124417+0000", 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7492e-05 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124435+0000", 2024-09-10T15:26:59.381 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8122999999999999e-05 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124627+0000", 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019198800000000001 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124910+0000", 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000282198 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:59.382 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.125832+0000", 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00092200300000000002 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.139934+0000", 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01410264 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.141879+0000", 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019445059999999999 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.383 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142069+0000", 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018991799999999999 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142202+0000", 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133802 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.384 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2085 3.25 3:a5fb1ce4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.4089678919999997, 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023491656999999999, 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2085 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.385 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874619+0000", 2024-09-10T15:26:59.386 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5100000000000001e-06 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879012+0000", 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043931630000000003 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879049+0000", 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7279e-05 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.387 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879067+0000", 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7447000000000001e-05 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879207+0000", 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014021899999999999 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879489+0000", 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028163800000000002 2024-09-10T15:26:59.388 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.880391+0000", 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090249099999999995 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.894924+0000", 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01453337 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.389 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.897971+0000", 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030460660000000001 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898053+0000", 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2109999999999998e-05 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898108+0000", 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5364000000000001e-05 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.390 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2170 3.24 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.463430013, 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.028850750000000001, 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2170 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.391 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820158+0000", 2024-09-10T15:26:59.392 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.16e-06 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826694+0000", 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065359559999999999 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826734+0000", 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9332000000000002e-05 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.393 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826752+0000", 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8249000000000001e-05 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826937+0000", 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018492500000000001 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.827362+0000", 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042493199999999999 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.394 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.827789+0000", 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000427601 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.846915+0000", 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019125362999999999 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.848838+0000", 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001923264 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.395 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.848935+0000", 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6840000000000001e-05 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.849005+0000", 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0128000000000003e-05 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.396 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2176 3.33 3:cc56d434:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.H48R23l9n0VubS_yIX4DYDGVDMz265g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 7.3242623770000002, 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020038224, 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2176 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.397 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959325+0000", 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8930000000000001e-06 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.398 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963408+0000", 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040833370000000003 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963447+0000", 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8458999999999999e-05 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963465+0000", 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8236e-05 2024-09-10T15:26:59.399 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963624+0000", 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015870899999999999 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963897+0000", 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027347599999999998 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.964130+0000", 2024-09-10T15:26:59.400 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023336299999999999 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.973568+0000", 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094378980000000001 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979097+0000", 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055289939999999997 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.401 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979245+0000", 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014776599999999999 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979360+0000", 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115093 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.402 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:59.404 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:26:59.404 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:59.401+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:59.505 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:26:59.501+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:26:59.585 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:59.585 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:59.585 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:26:59.585 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:59.599 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:26:59.606 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:26:59.601+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:26:59.707 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:26:59.702+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:26:59.725 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:59.725 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:26:59.725 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:26:59.725 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:26:59.725 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:26:59.739 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:26:59.807 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:26:59.805+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:26:59.908 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:26:59.902+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:26:59.911 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:26:59.911 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:26:59.911 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.964890895, 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.912 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.913 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.914 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:26:59.915 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.916 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.917 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.784617293, 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.918 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:26:59.919 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.920 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.921 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.922 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.923 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.758793497999999, 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.924 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.925 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.926 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:26:59.927 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.928 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:26:59.929 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.649410245999999, 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.931 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:26:59.932 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:26:59.933 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.593491253, 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.934 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.935 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.936 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.937 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:26:59.938 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.939 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 28.507255455999999, 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.940 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.941 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.942 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:26:59.943 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:26:59.944 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.945 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 28.483279563, 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.946 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.947 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.948 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:26:59.949 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:26:59.950 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.951 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.704806195, 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.952 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.953 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.954 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:26:59.955 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.956 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.687941214999999, 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.957 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:26:59.958 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.959 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.960 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.961 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.962 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.649018458, 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.964 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:26:59.965 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:26:59.966 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.967 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:59.968 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.636862986000001, 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:59.969 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.970 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.971 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.972 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.973 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.931943075, 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.974 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:26:59.975 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.976 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.977 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1739 3.8 e67/23 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head v 67'4, mlcod=63'2)", 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:59.978 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.212107146000001, 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018473534, 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.979 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695653+0000", 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7039999999999999e-06 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699886+0000", 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042333459999999998 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.980 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699927+0000", 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0457999999999998e-05 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699951+0000", 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4754999999999999e-05 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700106+0000", 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015423699999999999 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.981 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700152+0000", 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6802999999999999e-05 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.713994+0000", 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013841579 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714124+0000", 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012965200000000001 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.982 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1877 3.b 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 14.338478023, 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023807905000000001, 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1877 2024-09-10T15:26:59.983 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.984 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569281+0000", 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.024e-06 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573676+0000", 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043950930000000001 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573702+0000", 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5802000000000001e-05 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.985 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573713+0000", 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0386e-05 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573906+0000", 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000193742 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.574173+0000", 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000266884 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.986 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575041+0000", 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086814499999999996 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592140+0000", 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017098242 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592884+0000", 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074462200000000001 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.987 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592997+0000", 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011323 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.593087+0000", 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9734999999999994e-05 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.988 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1892 3.c e68/23 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head v 68'8, mlcod=67'6)", 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.918600149, 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024892474000000001, 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.989 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989159+0000", 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1100000000000001e-06 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994450+0000", 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052911779999999997 2024-09-10T15:26:59.990 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994487+0000", 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6563999999999998e-05 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994504+0000", 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6906e-05 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994695+0000", 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019078500000000001 2024-09-10T15:26:59.991 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994745+0000", 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0583e-05 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.013894+0000", 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019148603 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.014050+0000", 2024-09-10T15:26:59.992 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015574499999999999 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1947 3.c e69/23 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head v 69'9, mlcod=68'7)", 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 12.940471293, 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020674089999999999, 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.993 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967287+0000", 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4700000000000001e-07 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.994 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974827+0000", 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075409240000000001 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974856+0000", 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8119e-05 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974871+0000", 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5189e-05 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.995 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974968+0000", 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7460999999999994e-05 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.975009+0000", 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0268000000000001e-05 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987873+0000", 2024-09-10T15:26:59.996 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01286399 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987960+0000", 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7591999999999998e-05 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2109 3.23 e70/23 3:c4c10ed7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.66:head v 70'14, mlcod=67'12)", 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.3952030969999996, 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020231979000000001, 2024-09-10T15:26:59.997 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.998 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512557+0000", 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517394+0000", 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048370799999999997 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517433+0000", 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8982e-05 2024-09-10T15:26:59.999 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517451+0000", 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7672999999999998e-05 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517620+0000", 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169409 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:00.000 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517685+0000", 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5240999999999994e-05 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532706+0000", 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015020436 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532786+0000", 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0581999999999995e-05 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2112 3.c e70/23 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head v 70'10, mlcod=68'8)", 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.257380349, 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017546361, 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:00.002 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650378+0000", 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6700000000000003e-07 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:00.003 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656693+0000", 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063148220000000003 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656733+0000", 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9981999999999998e-05 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656751+0000", 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8853000000000001e-05 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.004 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656852+0000", 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100608 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656881+0000", 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9377999999999999e-05 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667779+0000", 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010897232 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.005 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667923+0000", 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014471899999999999 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2118 3.3f 3:fd7c3aaf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.6OutWCbOnJUoR6EgAd38lwPhVbxENPy_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 9.1016494580000007, 2024-09-10T15:27:00.006 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031726504000000003, 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2118 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.007 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806111+0000", 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4570000000000001e-06 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811285+0000", 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051735699999999997 2024-09-10T15:27:00.008 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811321+0000", 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6455000000000002e-05 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811340+0000", 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8887000000000001e-05 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:00.009 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811478+0000", 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137362 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811749+0000", 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027095 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811968+0000", 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021936699999999999 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.010 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.828291+0000", 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016322691 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837605+0000", 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093144179999999997 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837701+0000", 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6033999999999996e-05 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.011 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837834+0000", 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133313 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2317 3.3f 3:fe380e92:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.TMyG-M8R-iMnSIXgNMZF9cDGYU85EU6_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 4.7536551730000003, 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022281011999999999, 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:00.012 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2317 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:00.013 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154107+0000", 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5329999999999996e-06 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162076+0000", 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079692389999999995 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162115+0000", 2024-09-10T15:27:00.014 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9569e-05 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162134+0000", 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8422000000000001e-05 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162310+0000", 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017659199999999999 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162481+0000", 2024-09-10T15:27:00.015 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017045999999999999 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162645+0000", 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016447200000000001 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.172417+0000", 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097715030000000008 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.016 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176269+0000", 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003852014 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176334+0000", 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5055999999999995e-05 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176383+0000", 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9152e-05 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.017 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:00.018 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.018 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:00.018 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:00.018 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:00.019 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:00.014+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:00.019 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:27:00.120 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:00.117+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:00.150 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:00.150 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:00.150 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:00.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:27:00.221 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:00.214+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:00.321 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:00.317+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:00.323 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:00.323 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:00.323 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:00.323 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:00.323 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:00.337 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:27:00.422 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:00.418+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:27:00.498 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 100.62855318699999, 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:27:00.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:27:00.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:27:00.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1174 3.34 3:2edb9bfe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.516128405000003, 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024623020999999998, 2024-09-10T15:27:00.506 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1174 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978206+0000", 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3940000000000004e-06 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.982994+0000", 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047887839999999999 2024-09-10T15:27:00.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983055+0000", 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0418999999999999e-05 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983076+0000", 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0752999999999999e-05 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983249+0000", 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017358299999999999 2024-09-10T15:27:00.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983639+0000", 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038977100000000002 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.984055+0000", 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041571000000000002 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.997740+0000", 2024-09-10T15:27:00.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013685235 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002491+0000", 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047511860000000001 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002696+0000", 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204706 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002823+0000", 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012747999999999999 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1203 3.32 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.529293954000003, 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025222162999999999, 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.512 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1203 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:00.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965038+0000", 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969717+0000", 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046785730000000001 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969764+0000", 2024-09-10T15:27:00.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7676000000000002e-05 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969785+0000", 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0616e-05 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969895+0000", 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109728 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970109+0000", 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000214553 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970302+0000", 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019275800000000001 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.978686+0000", 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083835560000000003 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989954+0000", 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01126866 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990123+0000", 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016891000000000001 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990257+0000", 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013365299999999999 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.517 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1206 3.c 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.470371594, 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020855684999999999, 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.518 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1206 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023962+0000", 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8099999999999997e-06 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027160+0000", 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031981259999999999 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027205+0000", 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5460000000000002e-05 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027233+0000", 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7118999999999999e-05 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027404+0000", 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017182300000000001 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027701+0000", 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029708099999999998 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.028039+0000", 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033788900000000002 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.037510+0000", 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094706579999999999 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044590+0000", 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070796729999999999 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044739+0000", 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014925999999999999 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044813+0000", 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3786000000000001e-05 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.523 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1383 3.39 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.505039148000002, 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022778762000000001, 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1383 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989293+0000", 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0599999999999999e-06 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993369+0000", 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040763070000000004 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993410+0000", 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1038999999999998e-05 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993428+0000", 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7771e-05 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993550+0000", 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000122576 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993846+0000", 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029542799999999998 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.994081+0000", 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235641 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.009893+0000", 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0158113 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.011974+0000", 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020813630000000001 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012020+0000", 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5734e-05 2024-09-10T15:27:00.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012068+0000", 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8542999999999999e-05 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1384 3.2c 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.494561062999999, 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020364463999999999, 2024-09-10T15:27:00.529 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1384 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999770+0000", 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4260000000000002e-06 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002633+0000", 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028625120000000002 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002658+0000", 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5537999999999998e-05 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002674+0000", 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5877000000000001e-05 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002819+0000", 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014549300000000001 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003193+0000", 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037408599999999998 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003510+0000", 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031606700000000001 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.015405+0000", 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011895279 2024-09-10T15:27:00.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020063+0000", 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046583550000000003 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020100+0000", 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6780999999999999e-05 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020132+0000", 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.205e-05 2024-09-10T15:27:00.534 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1709 3.34 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.493028501000001, 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022337223999999999, 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.535 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1709 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001303+0000", 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9830000000000001e-06 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004358+0000", 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030546330000000002 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004394+0000", 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6616000000000003e-05 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004409+0000", 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5129e-05 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004573+0000", 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016369099999999999 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.005006+0000", 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043294999999999998 2024-09-10T15:27:00.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006178+0000", 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011721640000000001 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023441+0000", 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017262323 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023464+0000", 2024-09-10T15:27:00.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3828e-05 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023567+0000", 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102847 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023637+0000", 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0060000000000003e-05 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1718 3.c 3:328a3854:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.xA_hHjoo7scrwl59lEhs4AnaT1c9BOR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.204263839999999, 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019371422999999999, 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1718 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.541 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290068+0000", 2024-09-10T15:27:00.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6660000000000001e-06 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292551+0000", 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024821600000000002 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292578+0000", 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6981000000000001e-05 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292590+0000", 2024-09-10T15:27:00.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2105e-05 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292755+0000", 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016553499999999999 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293164+0000", 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040894899999999998 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:00.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293571+0000", 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040694199999999998 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.308210+0000", 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01463879 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309290+0000", 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010800860000000001 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309378+0000", 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7632000000000004e-05 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309436+0000", 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8576999999999998e-05 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1883 3.32 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:00.546 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.755401606, 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021961523, 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1883 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:00.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738931+0000", 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741686+0000", 2024-09-10T15:27:00.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027550740000000002 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741744+0000", 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.804e-05 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741767+0000", 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2651999999999999e-05 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741908+0000", 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140922 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.742202+0000", 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029458400000000002 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743119+0000", 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091704199999999997 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.754582+0000", 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011462764 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760672+0000", 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006089878 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760812+0000", 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000139722 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760889+0000", 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6859000000000004e-05 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1892 3.c 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.508043013, 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029189914000000001, 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.552 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1892 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:00.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986290+0000", 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4870000000000004e-06 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989074+0000", 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002784361 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989123+0000", 2024-09-10T15:27:00.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8331000000000002e-05 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989151+0000", 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8551000000000002e-05 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989296+0000", 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989452+0000", 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156692 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989582+0000", 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012952800000000001 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.999285+0000", 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009703181 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015308+0000", 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016022656 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015406+0000", 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8152000000000005e-05 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015476+0000", 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9512999999999997e-05 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.557 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1905 3.3b 3:dc76b4ec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.32:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.474370075, 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024023249999999999, 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1905 2024-09-10T15:27:00.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019961+0000", 2024-09-10T15:27:00.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6000000000000001e-06 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022708+0000", 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027468420000000002 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022749+0000", 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0791000000000003e-05 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022768+0000", 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9046e-05 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022895+0000", 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126897 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.023194+0000", 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029916699999999998 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:00.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.024121+0000", 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092692399999999998 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.038705+0000", 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014584185 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043638+0000", 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049327429999999999 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043847+0000", 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020970200000000001 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043982+0000", 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013435300000000001 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1947 3.c 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:00.563 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.528982510000001, 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023953879000000001, 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1947 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:00.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965349+0000", 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1e-06 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967022+0000", 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016730709999999999 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967083+0000", 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0693999999999999e-05 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967103+0000", 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9879000000000001e-05 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967196+0000", 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3284999999999999e-05 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967335+0000", 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138882 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967738+0000", 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040259999999999997 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.978781+0000", 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011043078 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989144+0000", 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01036346 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989239+0000", 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5130999999999994e-05 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989300+0000", 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0699000000000003e-05 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1950 3.1b e69/23 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head v 69'11, mlcod=68'9)", 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.398366188000001, 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020694515, 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.569 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.570 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095963+0000", 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0599999999999999e-07 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103130+0000", 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007167606 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103155+0000", 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5177999999999998e-05 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103166+0000", 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1027e-05 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103252+0000", 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5555000000000003e-05 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103271+0000", 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9106999999999998e-05 2024-09-10T15:27:00.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116534+0000", 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013263074999999999 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116657+0000", 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012276100000000001 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2097 3.1c e70/23 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head v 70'8, mlcod=67'6)", 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.292493185, 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019625252999999999, 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201838+0000", 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.553e-06 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206019+0000", 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041808970000000003 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206065+0000", 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5955000000000003e-05 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206084+0000", 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9052e-05 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206282+0000", 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019853399999999999 2024-09-10T15:27:00.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206325+0000", 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2117999999999999e-05 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221343+0000", 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015018323 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221461+0000", 2024-09-10T15:27:00.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117821 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2103 3.15 3:a805735b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.132858690000001, 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022718693000000002, 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.578 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2103 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361473+0000", 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2399999999999999e-06 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364075+0000", 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002601885 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364106+0000", 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0445000000000001e-05 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364118+0000", 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2729e-05 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364284+0000", 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016567700000000001 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364737+0000", 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045284900000000001 2024-09-10T15:27:00.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.365933+0000", 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011964790000000001 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.380849+0000", 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014915517999999999 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.383771+0000", 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029221669999999998 2024-09-10T15:27:00.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384056+0000", 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028503399999999998 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384189+0000", 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013266999999999999 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.583 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2112 3.c 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.8470492350000001, 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021998597000000002, 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2112 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647284+0000", 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2649999999999998e-06 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649669+0000", 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002385688 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649717+0000", 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7797000000000003e-05 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649738+0000", 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1005999999999998e-05 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649908+0000", 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016979199999999999 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650330+0000", 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042203599999999998 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650750+0000", 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041985699999999999 2024-09-10T15:27:00.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.662847+0000", 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012097139999999999 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669092+0000", 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062450279999999997 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669200+0000", 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108378 2024-09-10T15:27:00.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669278+0000", 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7609999999999997e-05 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2115 3.e e70/23 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head v 70'8, mlcod=67'6)", 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.8141969010000008, 2024-09-10T15:27:00.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020482499000000001, 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680133+0000", 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.451e-06 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682900+0000", 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027672170000000002 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682934+0000", 2024-09-10T15:27:00.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4005999999999999e-05 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682952+0000", 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7608000000000001e-05 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683128+0000", 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017570300000000001 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683190+0000", 2024-09-10T15:27:00.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2507000000000003e-05 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700468+0000", 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017277682999999999 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700614+0000", 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146324 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2124 3.15 3:aa28aa43:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.GCb3ey1gJiZZ0JvS2IR_yrJtE_qQhyg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.5218778119999996, 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023070721999999998, 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2124 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972455+0000", 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8360000000000002e-06 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976710+0000", 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042554769999999997 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976751+0000", 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1307999999999998e-05 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976771+0000", 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:27:00.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976971+0000", 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019981799999999999 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977371+0000", 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039999099999999999 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977782+0000", 2024-09-10T15:27:00.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041056000000000003 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.993874+0000", 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016091668999999999 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995173+0000", 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001299571 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995362+0000", 2024-09-10T15:27:00.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018902400000000001 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995522+0000", 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015942300000000001 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2170 3.24 e70/23 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head v 70'12, mlcod=68'10)", 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 8.6654226530000003, 2024-09-10T15:27:00.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020388610000000001, 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828909+0000", 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840061+0000", 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011152072000000001 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840089+0000", 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8186000000000001e-05 2024-09-10T15:27:00.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840104+0000", 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4721e-05 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840209+0000", 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105283 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840244+0000", 2024-09-10T15:27:00.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.502e-05 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849236+0000", 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089918459999999995 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849295+0000", 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8631999999999997e-05 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2311 3.38 e71/23 3:1f5d1b31:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.CbmyYpo0pl88KNJFZ0NLOldB0HRNzU2_1:head v 71'9, mlcod=71'7)", 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.4816227639999999, 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024560713000000001, 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012708+0000", 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4590000000000001e-06 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017270+0000", 2024-09-10T15:27:00.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045614360000000003 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017312+0000", 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1983000000000001e-05 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017333+0000", 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1324000000000001e-05 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017497+0000", 2024-09-10T15:27:00.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016356899999999999 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017567+0000", 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0171000000000003e-05 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037115+0000", 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019548660999999998 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:00.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037267+0000", 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015111000000000001 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:00.608 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:00.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:27:00.610 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:00.602+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:00.710 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:00.706+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:00.733 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:00.733 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:00.733 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:00.733 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:00.750 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:27:00.811 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:00.809+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:00.861 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:00.861 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:00.861 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:00.874 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:27:00.913 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:00.906+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:01.013 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:01.009+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:01.043 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:01.043 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:01.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:01.043 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:01.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 120.69573881300001, 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.044 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:01.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:27:01.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 119.56798191999999, 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.051 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.054 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:27:01.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:27:01.057 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 119.56793495300001, 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:01.058 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.060 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:27:01.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:27:01.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 119.567681132, 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.064 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:01.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:27:01.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1180 3.10 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.946016630999999, 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023100504000000001, 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.070 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1180 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093818+0000", 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.924e-06 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096732+0000", 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029139919999999998 2024-09-10T15:27:01.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096760+0000", 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8487999999999999e-05 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096777+0000", 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6515e-05 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096874+0000", 2024-09-10T15:27:01.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7182000000000006e-05 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.097083+0000", 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000208698 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.097267+0000", 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000184279 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.107950+0000", 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010682741000000001 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116814+0000", 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088636289999999996 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116861+0000", 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7540999999999998e-05 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116915+0000", 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3514999999999998e-05 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1203 3.32 e62/45 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head v 62'3, mlcod=61'1)", 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.069338232, 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019033174999999999, 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970495+0000", 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3999999999999999e-06 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974692+0000", 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004197409 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974733+0000", 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0602000000000002e-05 2024-09-10T15:27:01.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974757+0000", 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4525999999999999e-05 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974922+0000", 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164816 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974986+0000", 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4142999999999999e-05 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989395+0000", 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014408921999999999 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989526+0000", 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130357 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.080 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1204 3.37 3:ec79df02:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.052894471000002, 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.02302278, 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.081 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1204 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.082 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986939+0000", 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9890000000000001e-06 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990155+0000", 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032154660000000002 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990181+0000", 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6072e-05 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990195+0000", 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4129e-05 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990327+0000", 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132263 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990705+0000", 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037791399999999997 2024-09-10T15:27:01.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.991081+0000", 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037557600000000002 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.999068+0000", 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079871249999999994 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009789+0000", 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010720887 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009876+0000", 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7520000000000002e-05 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009959+0000", 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2838999999999997e-05 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.086 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1218 3.2a 3:558e4067:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.831410472999998, 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017902910000000001, 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.087 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1218 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208423+0000", 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7360000000000001e-06 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210338+0000", 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001915148 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210370+0000", 2024-09-10T15:27:01.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1837e-05 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210385+0000", 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5012e-05 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210476+0000", 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0950000000000002e-05 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210641+0000", 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016545000000000001 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210766+0000", 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012440800000000001 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223542+0000", 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012775922 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226195+0000", 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002653454 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226261+0000", 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5748999999999997e-05 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226323+0000", 2024-09-10T15:27:01.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2243999999999996e-05 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1220 3.10 3:08f79c03:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.809297784999998, 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018274163, 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.093 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1220 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230536+0000", 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6740000000000001e-06 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232597+0000", 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020610239999999998 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232628+0000", 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1316999999999998e-05 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232643+0000", 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5353999999999999e-05 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232745+0000", 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101366 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232947+0000", 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020186999999999999 2024-09-10T15:27:01.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.233128+0000", 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018164900000000001 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.239213+0000", 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060851109999999998 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248677+0000", 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094637360000000004 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248751+0000", 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248807+0000", 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5575999999999998e-05 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.098 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1362 3.21 e63/23 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head v 63'3, mlcod=61'1)", 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.631072885000002, 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017128918, 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:01.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408759+0000", 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3489999999999999e-06 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416535+0000", 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077755319999999999 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416561+0000", 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.633e-05 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416575+0000", 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.376e-05 2024-09-10T15:27:01.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416673+0000", 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8617999999999997e-05 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416715+0000", 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1112000000000002e-05 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.425823+0000", 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091085769999999996 2024-09-10T15:27:01.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.425887+0000", 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3639999999999994e-05 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1384 3.2c e63/23 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head v 63'5, mlcod=63'3)", 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 29.036099319000002, 2024-09-10T15:27:01.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016112702999999999, 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:01.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003734+0000", 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1880000000000001e-06 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006362+0000", 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026283650000000001 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006387+0000", 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4740999999999999e-05 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006400+0000", 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3541e-05 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006545+0000", 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144394 2024-09-10T15:27:01.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006588+0000", 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3001999999999999e-05 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.019752+0000", 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013164380999999999 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.019844+0000", 2024-09-10T15:27:01.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2090999999999996e-05 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1709 3.34 e67/23 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head v 67'7, mlcod=62'5)", 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.033458034999999, 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016755263999999999, 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.108 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006375+0000", 2024-09-10T15:27:01.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9630000000000001e-06 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010047+0000", 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036721169999999999 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010077+0000", 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0741000000000003e-05 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.110 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010098+0000", 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0839000000000002e-05 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010246+0000", 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147894 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010287+0000", 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1196999999999999e-05 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.022997+0000", 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012710005 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023128+0000", 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013050799999999999 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.112 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1730 3.37 3:ec453865:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.MN6ndaRYV2EuyC3iAo0IHvk0Z_MzJqU_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.485202409999999, 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016741232000000002, 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1730 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554632+0000", 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556158+0000", 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001526721 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556194+0000", 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5652999999999999e-05 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556209+0000", 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5186e-05 2024-09-10T15:27:01.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556298+0000", 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9172999999999995e-05 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556431+0000", 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013272100000000001 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:01.116 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556545+0000", 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011393299999999999 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.566363+0000", 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009817882 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571282+0000", 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049190040000000003 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.117 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571330+0000", 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8214000000000003e-05 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571370+0000", 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1883 3.32 e68/45 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head v 68'8, mlcod=63'6)", 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.296467890000001, 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016971944999999999, 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.119 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743365+0000", 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3470000000000001e-06 2024-09-10T15:27:01.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748517+0000", 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051514589999999997 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748563+0000", 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6060999999999998e-05 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748588+0000", 2024-09-10T15:27:01.121 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5194999999999998e-05 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748730+0000", 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014263599999999999 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748790+0000", 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9908999999999998e-05 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.122 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760196+0000", 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011405861999999999 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760335+0000", 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013847600000000001 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1914 3.37 3:efeebdfa:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.Dgg4K9tN4GZ3upzOVu1wT7WdqOlTALP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:01.123 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.740892963, 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027977588000000001, 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1914 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.124 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298942+0000", 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.125 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301665+0000", 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027234030000000001 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301712+0000", 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6987999999999998e-05 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301739+0000", 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6618000000000002e-05 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.126 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301914+0000", 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017554499999999999 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302156+0000", 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024161300000000001 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302394+0000", 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000238001 2024-09-10T15:27:01.127 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.325961+0000", 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023567504 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326705+0000", 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000743251 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326812+0000", 2024-09-10T15:27:01.128 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000107135 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326915+0000", 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103597 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2097 3.1c 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:01.129 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.843645412000001, 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025789561999999999, 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2097 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:01.130 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196187+0000", 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.136e-06 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.131 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200289+0000", 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041016150000000003 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200336+0000", 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6526999999999997e-05 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200356+0000", 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0366000000000001e-05 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.132 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200456+0000", 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9889000000000005e-05 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200727+0000", 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027102199999999999 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201638+0000", 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000910909 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.133 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.220951+0000", 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019313157000000001 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221783+0000", 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00083172699999999999 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221897+0000", 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114078 2024-09-10T15:27:01.134 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221975+0000", 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8135999999999999e-05 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2167 3.27 e70/23 3:e6c4ba75:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.74:head v 70'7, mlcod=69'5)", 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.3349938699999999, 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017419674, 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.135 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.136 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704839+0000", 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711422+0000", 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065833719999999997 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711461+0000", 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8685e-05 2024-09-10T15:27:01.137 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711487+0000", 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6718000000000001e-05 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711617+0000", 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000129844 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.138 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711636+0000", 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8499e-05 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.722206+0000", 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010569846000000001 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.722256+0000", 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0803000000000001e-05 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.139 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2296 3.10 3:096a7ecf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.95:head [create,setxattr user.rgw.idtag (60) in=14b,setxattr user.rgw.tail_tag (60) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.4789549629999996, 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018620313999999999, 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.140 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2296 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.141 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560879+0000", 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2600000000000001e-06 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562473+0000", 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015938020000000001 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.142 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562514+0000", 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1561999999999999e-05 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562533+0000", 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8286000000000001e-05 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562661+0000", 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012875699999999999 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.143 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562950+0000", 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028865800000000001 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.563877+0000", 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092681999999999997 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.144 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579332+0000", 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015454987 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579362+0000", 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0165999999999999e-05 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579445+0000", 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2727999999999998e-05 2024-09-10T15:27:01.145 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579496+0000", 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1288000000000001e-05 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2302 3.27 e71/23 3:e5e963ff:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.96:head v 71'8, mlcod=69'6)", 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:01.146 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 6.317141243, 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019253927000000001, 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:01.147 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722692+0000", 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7640000000000001e-06 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731782+0000", 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009089382 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.148 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731824+0000", 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2851e-05 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731844+0000", 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9896000000000001e-05 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731975+0000", 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000131089 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.149 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.732009+0000", 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3791999999999998e-05 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.741859+0000", 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0098501330000000005 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.741943+0000", 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4019999999999999e-05 2024-09-10T15:27:01.150 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2320 3.10 3:0be12419:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.99:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 5.8599111349999999, 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01725233, 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:01.151 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2320 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:01.152 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179922+0000", 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8899999999999999e-06 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181591+0000", 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016687119999999999 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.153 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181634+0000", 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2855000000000002e-05 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181652+0000", 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8229000000000001e-05 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181756+0000", 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010405500000000001 2024-09-10T15:27:01.154 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181982+0000", 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000225627 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.182599+0000", 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000617576 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:01.155 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.194441+0000", 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011841463999999999 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197000+0000", 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025590439999999999 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197094+0000", 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4474000000000004e-05 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:01.156 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197172+0000", 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7404000000000006e-05 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:01.157 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:01.157 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:27:01.158 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:27:01.160 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:27:01.160 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:01.154+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:01.290 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:01.289+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:01.349 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:27:01.349 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:27:01.362 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:01.358+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:01.365 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:27:01.365 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:27:01.371 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:01.371 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:01.371 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:01.371 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:01.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:27:01.398 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:27:01.398 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:27:01.425 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:27:01.426 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:27:01.446 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:27:01.446 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:27:01.461 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:01.457+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:01.482 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:27:01.482 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:27:01.508 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:01.508 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:01.518 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:27:01.518 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:27:01.521 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:27:01.544 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:27:01.545 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:27:01.563 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:01.558+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:01.658 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:01.658 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:01.664 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:01.662+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:01.671 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:27:01.765 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:01.761+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:01.790 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:01.790 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:01.803 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:27:01.890 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:01.889+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:01.966 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:01.967 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:01.967 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:01.962+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:01.980 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:27:02.067 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:02.065+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:02.076 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:27:02.153 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:02.153 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:02.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:27:02.167 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:02.165+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:02.268 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:02.262+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:02.294 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:02.294 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:02.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:27:02.369 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:02.365+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:02.470 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:02.465+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:02.483 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:02.483 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:02.499 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:27:02.571 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:02.569+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:02.617 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:02.617 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:02.631 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:27:02.678 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:02.674+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:02.757 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:02.757 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:02.772 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:27:02.773 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:02.769+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:02.875 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:02.873+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:02.942 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:02.942 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:02.956 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:27:03.002 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:27:02.998+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:27:03.076 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:03.073+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:03.080 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:03.080 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:03.096 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:27:03.182 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:03.178+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:03.263 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:03.264 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:03.277 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:03.273+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:03.280 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:27:03.378 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:03.377+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:03.447 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:03.447 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:03.464 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:27:03.479 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:03.477+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:03.565 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:27:03.580 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:03.574+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:03.585 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:03.586 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:03.601 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:27:03.696 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:03.690+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:03.708 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:27:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:27:03.723 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:27:03.724 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:27:03.742 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:27:03.742 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:27:03.759 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:27:03.759 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:27:03.770 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:03.770 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:03.777 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:27:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:27:03.782 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:03.778+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:03.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:27:03.795 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:27:03.795 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:27:03.815 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:27:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:27:03.832 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:27:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:27:03.882 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:03.878+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:03.956 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:03.956 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:03.956 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:27:03.956 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:27:03.956 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:03.970 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:27:04.014 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:27:04.009+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:27:04.084 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:27:04.077+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:27:04.108 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.148 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 36.200822043999999, 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:27:04.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:27:04.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 36.020548441999999, 2024-09-10T15:27:04.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:27:04.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:27:04.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 35.994724646999998, 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:27:04.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:27:04.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:27:04.166 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 35.885341394999998, 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:27:04.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 35.829422401999999, 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:27:04.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:27:04.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:27:04.176 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.743186604999998, 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:27:04.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.178 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:27:04.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 32.719210711999999, 2024-09-10T15:27:04.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:27:04.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:27:04.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.940737343999999, 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.188 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.192 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.923872364000001, 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:27:04.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:27:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.197 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.198 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.884949606999999, 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.199 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:27:04.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.203 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:27:04.204 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 31.872794134999999, 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.205 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:27:04.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:27:04.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.210 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.167874223999998, 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:27:04.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.212 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.213 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1739 3.8 e67/23 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head v 67'4, mlcod=63'2)", 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.448038295, 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018473534, 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.215 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695653+0000", 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7039999999999999e-06 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699886+0000", 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042333459999999998 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699927+0000", 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0457999999999998e-05 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699951+0000", 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4754999999999999e-05 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700106+0000", 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015423699999999999 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700152+0000", 2024-09-10T15:27:04.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6802999999999999e-05 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.713994+0000", 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013841579 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714124+0000", 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012965200000000001 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1877 3.b 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.574409171999999, 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023807905000000001, 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1877 2024-09-10T15:27:04.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569281+0000", 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.024e-06 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573676+0000", 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043950930000000001 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573702+0000", 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5802000000000001e-05 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573713+0000", 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0386e-05 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573906+0000", 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000193742 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.574173+0000", 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000266884 2024-09-10T15:27:04.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575041+0000", 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086814499999999996 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592140+0000", 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017098242 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592884+0000", 2024-09-10T15:27:04.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074462200000000001 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592997+0000", 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011323 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.593087+0000", 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9734999999999994e-05 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.225 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1892 3.c e68/23 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head v 68'8, mlcod=67'6)", 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 18.154531297999998, 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024892474000000001, 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:27:04.226 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989159+0000", 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1100000000000001e-06 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.227 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994450+0000", 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052911779999999997 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994487+0000", 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6563999999999998e-05 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994504+0000", 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6906e-05 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.228 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994695+0000", 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019078500000000001 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994745+0000", 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0583e-05 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.013894+0000", 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019148603 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.229 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.014050+0000", 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015574499999999999 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1947 3.c e69/23 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head v 69'9, mlcod=68'7)", 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.176402442000001, 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020674089999999999, 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.230 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.231 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967287+0000", 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4700000000000001e-07 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974827+0000", 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075409240000000001 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974856+0000", 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8119e-05 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.232 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974871+0000", 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5189e-05 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974968+0000", 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7460999999999994e-05 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.975009+0000", 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0268000000000001e-05 2024-09-10T15:27:04.233 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987873+0000", 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01286399 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987960+0000", 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7591999999999998e-05 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.234 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2109 3.23 e70/23 3:c4c10ed7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.66:head v 70'14, mlcod=67'12)", 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.631134246, 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020231979000000001, 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.235 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512557+0000", 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517394+0000", 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048370799999999997 2024-09-10T15:27:04.236 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517433+0000", 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8982e-05 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517451+0000", 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7672999999999998e-05 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517620+0000", 2024-09-10T15:27:04.237 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169409 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517685+0000", 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5240999999999994e-05 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532706+0000", 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015020436 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.238 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532786+0000", 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0581999999999995e-05 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2112 3.c e70/23 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head v 70'10, mlcod=68'8)", 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.493311498000001, 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017546361, 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.239 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650378+0000", 2024-09-10T15:27:04.240 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6700000000000003e-07 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656693+0000", 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063148220000000003 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656733+0000", 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9981999999999998e-05 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.241 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656751+0000", 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8853000000000001e-05 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656852+0000", 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100608 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656881+0000", 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9377999999999999e-05 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.242 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667779+0000", 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010897232 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667923+0000", 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014471899999999999 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.243 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2118 3.3f 3:fd7c3aaf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.6OutWCbOnJUoR6EgAd38lwPhVbxENPy_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 13.337580607, 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031726504000000003, 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2118 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.244 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806111+0000", 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4570000000000001e-06 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.245 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811285+0000", 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051735699999999997 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811321+0000", 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6455000000000002e-05 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811340+0000", 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8887000000000001e-05 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.246 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811478+0000", 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137362 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811749+0000", 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027095 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811968+0000", 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021936699999999999 2024-09-10T15:27:04.247 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.828291+0000", 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016322691 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837605+0000", 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093144179999999997 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837701+0000", 2024-09-10T15:27:04.248 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6033999999999996e-05 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837834+0000", 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133313 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2317 3.3f 3:fe380e92:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.TMyG-M8R-iMnSIXgNMZF9cDGYU85EU6_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:04.249 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 8.9895863219999992, 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022281011999999999, 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2317 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:04.250 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154107+0000", 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5329999999999996e-06 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:04.251 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162076+0000", 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079692389999999995 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162115+0000", 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9569e-05 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162134+0000", 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8422000000000001e-05 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.252 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162310+0000", 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017659199999999999 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162481+0000", 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017045999999999999 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162645+0000", 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016447200000000001 2024-09-10T15:27:04.253 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.172417+0000", 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097715030000000008 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176269+0000", 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003852014 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176334+0000", 2024-09-10T15:27:04.254 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5055999999999995e-05 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176383+0000", 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9152e-05 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:04.255 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:04.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:27:04.257 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:04.253+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:04.357 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:04.353+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:04.373 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:04.373 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:04.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:27:04.459 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:27:04.453+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:27:04.545 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:04.545 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:04.545 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:04.545 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:04.545 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:04.558 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:27:04.559 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:04.557+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:04.660 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:04.657+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:04.675 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:04.675 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:04.675 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:04.675 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 104.80727317500001, 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:27:04.676 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.677 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.678 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.679 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:27:04.680 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.681 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.682 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1174 3.34 3:2edb9bfe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.683 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.694848393000001, 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024623020999999998, 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1174 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.684 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978206+0000", 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3940000000000004e-06 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.685 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.982994+0000", 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047887839999999999 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983055+0000", 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0418999999999999e-05 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983076+0000", 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0752999999999999e-05 2024-09-10T15:27:04.686 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983249+0000", 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017358299999999999 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983639+0000", 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038977100000000002 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.984055+0000", 2024-09-10T15:27:04.687 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041571000000000002 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.997740+0000", 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013685235 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002491+0000", 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047511860000000001 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.688 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002696+0000", 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204706 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002823+0000", 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012747999999999999 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1203 3.32 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.689 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.708013942000001, 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025222162999999999, 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1203 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.690 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965038+0000", 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.691 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969717+0000", 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046785730000000001 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969764+0000", 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7676000000000002e-05 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.692 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969785+0000", 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0616e-05 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969895+0000", 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109728 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970109+0000", 2024-09-10T15:27:04.693 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000214553 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970302+0000", 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019275800000000001 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.978686+0000", 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083835560000000003 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.694 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989954+0000", 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01126866 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990123+0000", 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016891000000000001 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990257+0000", 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013365299999999999 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.695 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1206 3.c 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.649091581999997, 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020855684999999999, 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.696 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1206 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.697 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023962+0000", 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8099999999999997e-06 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027160+0000", 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031981259999999999 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027205+0000", 2024-09-10T15:27:04.698 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5460000000000002e-05 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027233+0000", 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7118999999999999e-05 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027404+0000", 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017182300000000001 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.699 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027701+0000", 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029708099999999998 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.028039+0000", 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033788900000000002 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.037510+0000", 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094706579999999999 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.700 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044590+0000", 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070796729999999999 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044739+0000", 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014925999999999999 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044813+0000", 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3786000000000001e-05 2024-09-10T15:27:04.701 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1383 3.39 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.683759135999999, 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022778762000000001, 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.702 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1383 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.703 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989293+0000", 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0599999999999999e-06 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993369+0000", 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040763070000000004 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.704 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993410+0000", 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1038999999999998e-05 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993428+0000", 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7771e-05 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993550+0000", 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000122576 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.705 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993846+0000", 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029542799999999998 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.994081+0000", 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235641 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.009893+0000", 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0158113 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.706 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.011974+0000", 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020813630000000001 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012020+0000", 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5734e-05 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012068+0000", 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8542999999999999e-05 2024-09-10T15:27:04.707 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1384 3.2c 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 32.673281051000004, 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020364463999999999, 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.708 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1384 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.709 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999770+0000", 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4260000000000002e-06 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002633+0000", 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028625120000000002 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002658+0000", 2024-09-10T15:27:04.710 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5537999999999998e-05 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002674+0000", 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5877000000000001e-05 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002819+0000", 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014549300000000001 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.711 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003193+0000", 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037408599999999998 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003510+0000", 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031606700000000001 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.015405+0000", 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011895279 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.712 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020063+0000", 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046583550000000003 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020100+0000", 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6780999999999999e-05 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020132+0000", 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.205e-05 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.713 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1709 3.34 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.671748488999999, 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022337223999999999, 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.714 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1709 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.715 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001303+0000", 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9830000000000001e-06 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004358+0000", 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030546330000000002 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004394+0000", 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6616000000000003e-05 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.716 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004409+0000", 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5129e-05 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004573+0000", 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016369099999999999 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.717 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.005006+0000", 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043294999999999998 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006178+0000", 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011721640000000001 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.718 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023441+0000", 2024-09-10T15:27:04.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017262323 2024-09-10T15:27:04.720 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.720 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.720 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.720 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023464+0000", 2024-09-10T15:27:04.720 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3828e-05 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023567+0000", 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102847 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023637+0000", 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0060000000000003e-05 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.721 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1718 3.c 3:328a3854:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.xA_hHjoo7scrwl59lEhs4AnaT1c9BOR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.382983828, 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019371422999999999, 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1718 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.722 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.723 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290068+0000", 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6660000000000001e-06 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292551+0000", 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024821600000000002 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.724 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292578+0000", 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6981000000000001e-05 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292590+0000", 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2105e-05 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292755+0000", 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016553499999999999 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.725 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293164+0000", 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040894899999999998 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293571+0000", 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040694199999999998 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.308210+0000", 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01463879 2024-09-10T15:27:04.726 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309290+0000", 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010800860000000001 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309378+0000", 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7632000000000004e-05 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.727 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309436+0000", 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8576999999999998e-05 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1883 3.32 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.934121594, 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021961523, 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.728 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1883 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:04.729 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738931+0000", 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741686+0000", 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027550740000000002 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.730 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741744+0000", 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.804e-05 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741767+0000", 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2651999999999999e-05 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741908+0000", 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140922 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.731 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.742202+0000", 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029458400000000002 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743119+0000", 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091704199999999997 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.754582+0000", 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011462764 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.732 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760672+0000", 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006089878 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760812+0000", 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000139722 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.733 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760889+0000", 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6859000000000004e-05 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1892 3.c 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.686763000999999, 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029189914000000001, 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.734 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1892 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.735 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986290+0000", 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4870000000000004e-06 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989074+0000", 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002784361 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.736 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989123+0000", 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8331000000000002e-05 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989151+0000", 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8551000000000002e-05 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989296+0000", 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.737 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989452+0000", 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156692 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989582+0000", 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012952800000000001 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.999285+0000", 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009703181 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.738 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015308+0000", 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016022656 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015406+0000", 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8152000000000005e-05 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015476+0000", 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9512999999999997e-05 2024-09-10T15:27:04.739 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1905 3.3b 3:dc76b4ec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.32:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.653090063, 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024023249999999999, 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.740 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1905 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:04.741 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019961+0000", 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6000000000000001e-06 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022708+0000", 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027468420000000002 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.742 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022749+0000", 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0791000000000003e-05 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022768+0000", 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9046e-05 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022895+0000", 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126897 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.743 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.023194+0000", 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029916699999999998 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.024121+0000", 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092692399999999998 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.038705+0000", 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014584185 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.744 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043638+0000", 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049327429999999999 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043847+0000", 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020970200000000001 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043982+0000", 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013435300000000001 2024-09-10T15:27:04.745 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1947 3.c 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.707702498, 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023953879000000001, 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.746 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1947 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.747 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965349+0000", 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1e-06 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967022+0000", 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016730709999999999 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967083+0000", 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0693999999999999e-05 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.748 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967103+0000", 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9879000000000001e-05 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967196+0000", 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3284999999999999e-05 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967335+0000", 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138882 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.749 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967738+0000", 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040259999999999997 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.978781+0000", 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011043078 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989144+0000", 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01036346 2024-09-10T15:27:04.750 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989239+0000", 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5130999999999994e-05 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989300+0000", 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0699000000000003e-05 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.751 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1950 3.1b e69/23 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head v 69'11, mlcod=68'9)", 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.577086176000002, 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020694515, 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.752 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095963+0000", 2024-09-10T15:27:04.753 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0599999999999999e-07 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103130+0000", 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007167606 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103155+0000", 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5177999999999998e-05 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.754 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103166+0000", 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1027e-05 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103252+0000", 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5555000000000003e-05 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103271+0000", 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9106999999999998e-05 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.755 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116534+0000", 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013263074999999999 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116657+0000", 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012276100000000001 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2097 3.1c e70/23 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head v 70'8, mlcod=67'6)", 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:04.756 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.471213173000001, 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019625252999999999, 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.757 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201838+0000", 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.553e-06 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206019+0000", 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041808970000000003 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.758 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206065+0000", 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5955000000000003e-05 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206084+0000", 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9052e-05 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206282+0000", 2024-09-10T15:27:04.759 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019853399999999999 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206325+0000", 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2117999999999999e-05 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221343+0000", 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015018323 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221461+0000", 2024-09-10T15:27:04.760 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117821 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2103 3.15 3:a805735b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.311578678, 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022718693000000002, 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.761 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2103 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.762 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361473+0000", 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2399999999999999e-06 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364075+0000", 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002601885 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364106+0000", 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0445000000000001e-05 2024-09-10T15:27:04.763 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364118+0000", 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2729e-05 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364284+0000", 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016567700000000001 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364737+0000", 2024-09-10T15:27:04.764 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045284900000000001 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.365933+0000", 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011964790000000001 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.380849+0000", 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014915517999999999 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.383771+0000", 2024-09-10T15:27:04.765 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029221669999999998 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384056+0000", 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028503399999999998 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384189+0000", 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013266999999999999 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.766 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2112 3.c 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.025769222999999, 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021998597000000002, 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2112 2024-09-10T15:27:04.767 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.768 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647284+0000", 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2649999999999998e-06 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649669+0000", 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002385688 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649717+0000", 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7797000000000003e-05 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.769 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649738+0000", 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1005999999999998e-05 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649908+0000", 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016979199999999999 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650330+0000", 2024-09-10T15:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042203599999999998 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650750+0000", 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041985699999999999 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.662847+0000", 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012097139999999999 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.771 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669092+0000", 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062450279999999997 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669200+0000", 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108378 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669278+0000", 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7609999999999997e-05 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.772 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2115 3.e e70/23 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head v 70'8, mlcod=67'6)", 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.992916889, 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020482499000000001, 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.773 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680133+0000", 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.451e-06 2024-09-10T15:27:04.774 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682900+0000", 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027672170000000002 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682934+0000", 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4005999999999999e-05 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682952+0000", 2024-09-10T15:27:04.775 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7608000000000001e-05 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683128+0000", 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017570300000000001 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683190+0000", 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2507000000000003e-05 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.776 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700468+0000", 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017277682999999999 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700614+0000", 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146324 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2124 3.15 3:aa28aa43:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.GCb3ey1gJiZZ0JvS2IR_yrJtE_qQhyg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.700597800000001, 2024-09-10T15:27:04.777 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023070721999999998, 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2124 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.778 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972455+0000", 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8360000000000002e-06 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.779 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976710+0000", 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042554769999999997 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976751+0000", 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1307999999999998e-05 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976771+0000", 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.780 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976971+0000", 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019981799999999999 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977371+0000", 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039999099999999999 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:04.781 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977782+0000", 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041056000000000003 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.993874+0000", 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016091668999999999 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995173+0000", 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001299571 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.782 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995362+0000", 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018902400000000001 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995522+0000", 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015942300000000001 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.783 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2170 3.24 e70/23 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head v 70'12, mlcod=68'10)", 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 12.844142640999999, 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020388610000000001, 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.784 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828909+0000", 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840061+0000", 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011152072000000001 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.785 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840089+0000", 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8186000000000001e-05 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840104+0000", 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4721e-05 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840209+0000", 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105283 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.786 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840244+0000", 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.502e-05 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849236+0000", 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089918459999999995 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849295+0000", 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8631999999999997e-05 2024-09-10T15:27:04.787 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2311 3.38 e71/23 3:1f5d1b31:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.CbmyYpo0pl88KNJFZ0NLOldB0HRNzU2_1:head v 71'9, mlcod=71'7)", 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 9.660342752, 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024560713000000001, 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:04.788 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012708+0000", 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4590000000000001e-06 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.789 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017270+0000", 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045614360000000003 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017312+0000", 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1983000000000001e-05 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017333+0000", 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1324000000000001e-05 2024-09-10T15:27:04.790 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017497+0000", 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016356899999999999 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017567+0000", 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0171000000000003e-05 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037115+0000", 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019548660999999998 2024-09-10T15:27:04.791 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037267+0000", 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015111000000000001 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:04.792 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:04.794 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:27:04.794 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:04.789+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:04.894 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:04.893+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:04.948 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:04.948 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:04.948 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:04.961 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:27:05.006 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:05.005+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:05.086 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:05.086 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:05.086 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:05.086 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:05.086 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:05.096 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:05.093+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:05.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:27:05.103 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:27:05.197 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:05.193+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:05.221 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:05.221 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 124.87498807599999, 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.222 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.223 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:27:05.224 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.225 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.226 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:27:05.227 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.228 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:05.229 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 123.747231183, 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.230 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.231 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:27:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:27:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.232 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.233 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.234 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.235 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 123.74718421599999, 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.236 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.237 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.238 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.239 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.240 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:27:05.241 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:05.242 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 123.74693039500001, 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.243 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.244 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.245 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.246 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:27:05.247 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1180 3.10 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.125265894000002, 2024-09-10T15:27:05.248 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023100504000000001, 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1180 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.249 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093818+0000", 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.924e-06 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.250 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096732+0000", 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029139919999999998 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096760+0000", 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8487999999999999e-05 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096777+0000", 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6515e-05 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.251 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096874+0000", 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7182000000000006e-05 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.097083+0000", 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000208698 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.097267+0000", 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000184279 2024-09-10T15:27:05.252 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.107950+0000", 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010682741000000001 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116814+0000", 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088636289999999996 2024-09-10T15:27:05.253 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116861+0000", 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7540999999999998e-05 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116915+0000", 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3514999999999998e-05 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.254 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1203 3.32 e62/45 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head v 62'3, mlcod=61'1)", 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.248587495000002, 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019033174999999999, 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:05.255 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970495+0000", 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3999999999999999e-06 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.256 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974692+0000", 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004197409 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974733+0000", 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0602000000000002e-05 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974757+0000", 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4525999999999999e-05 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.257 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974922+0000", 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164816 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974986+0000", 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4142999999999999e-05 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989395+0000", 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014408921999999999 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.258 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989526+0000", 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130357 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1204 3.37 3:ec79df02:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:05.259 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.232143733999997, 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.02302278, 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1204 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.260 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986939+0000", 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9890000000000001e-06 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.261 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990155+0000", 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032154660000000002 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990181+0000", 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6072e-05 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990195+0000", 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4129e-05 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.262 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990327+0000", 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132263 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990705+0000", 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037791399999999997 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.991081+0000", 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037557600000000002 2024-09-10T15:27:05.263 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.999068+0000", 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079871249999999994 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009789+0000", 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010720887 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.264 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009876+0000", 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7520000000000002e-05 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009959+0000", 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2838999999999997e-05 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1218 3.2a 3:558e4067:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.265 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.010659736000001, 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017902910000000001, 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1218 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:05.266 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208423+0000", 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7360000000000001e-06 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210338+0000", 2024-09-10T15:27:05.267 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001915148 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210370+0000", 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1837e-05 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210385+0000", 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5012e-05 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.268 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210476+0000", 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0950000000000002e-05 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210641+0000", 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016545000000000001 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210766+0000", 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012440800000000001 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.269 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223542+0000", 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012775922 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226195+0000", 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002653454 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226261+0000", 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5748999999999997e-05 2024-09-10T15:27:05.270 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226323+0000", 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2243999999999996e-05 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1220 3.10 3:08f79c03:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.988547048000001, 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018274163, 2024-09-10T15:27:05.271 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1220 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.272 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230536+0000", 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6740000000000001e-06 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232597+0000", 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020610239999999998 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.273 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232628+0000", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1316999999999998e-05 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232643+0000", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5353999999999999e-05 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232745+0000", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101366 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.274 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232947+0000", 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020186999999999999 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.233128+0000", 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018164900000000001 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.239213+0000", 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060851109999999998 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.275 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248677+0000", 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094637360000000004 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248751+0000", 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248807+0000", 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5575999999999998e-05 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.276 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1362 3.21 e63/23 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head v 63'3, mlcod=61'1)", 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.810322147999997, 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017128918, 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.277 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408759+0000", 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3489999999999999e-06 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416535+0000", 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077755319999999999 2024-09-10T15:27:05.278 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416561+0000", 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.633e-05 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416575+0000", 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.376e-05 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416673+0000", 2024-09-10T15:27:05.279 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8617999999999997e-05 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416715+0000", 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1112000000000002e-05 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.425823+0000", 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091085769999999996 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.280 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.425887+0000", 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3639999999999994e-05 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1384 3.2c e63/23 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head v 63'5, mlcod=63'3)", 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.215348581999997, 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016112702999999999, 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.281 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003734+0000", 2024-09-10T15:27:05.282 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1880000000000001e-06 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006362+0000", 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026283650000000001 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006387+0000", 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4740999999999999e-05 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006400+0000", 2024-09-10T15:27:05.283 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3541e-05 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006545+0000", 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144394 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006588+0000", 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3001999999999999e-05 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.019752+0000", 2024-09-10T15:27:05.284 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013164380999999999 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.019844+0000", 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2090999999999996e-05 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1709 3.34 e67/23 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head v 67'7, mlcod=62'5)", 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.212707298000002, 2024-09-10T15:27:05.285 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016755263999999999, 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.286 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006375+0000", 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9630000000000001e-06 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010047+0000", 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036721169999999999 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010077+0000", 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0741000000000003e-05 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.287 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010098+0000", 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0839000000000002e-05 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010246+0000", 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147894 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010287+0000", 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1196999999999999e-05 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.288 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.022997+0000", 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012710005 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023128+0000", 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013050799999999999 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1730 3.37 3:ec453865:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.MN6ndaRYV2EuyC3iAo0IHvk0Z_MzJqU_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:05.289 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.664451672999999, 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016741232000000002, 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1730 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:05.290 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554632+0000", 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.291 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556158+0000", 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001526721 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556194+0000", 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5652999999999999e-05 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.292 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556209+0000", 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5186e-05 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556298+0000", 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9172999999999995e-05 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556431+0000", 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013272100000000001 2024-09-10T15:27:05.293 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556545+0000", 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011393299999999999 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.566363+0000", 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009817882 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571282+0000", 2024-09-10T15:27:05.294 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049190040000000003 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571330+0000", 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8214000000000003e-05 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571370+0000", 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.295 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1883 3.32 e68/45 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head v 68'8, mlcod=63'6)", 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.475717153000002, 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016971944999999999, 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.296 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743365+0000", 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3470000000000001e-06 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748517+0000", 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051514589999999997 2024-09-10T15:27:05.297 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748563+0000", 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6060999999999998e-05 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748588+0000", 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5194999999999998e-05 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.298 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748730+0000", 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014263599999999999 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748790+0000", 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9908999999999998e-05 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760196+0000", 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011405861999999999 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.299 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760335+0000", 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013847600000000001 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1914 3.37 3:efeebdfa:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.Dgg4K9tN4GZ3upzOVu1wT7WdqOlTALP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.920142225999999, 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027977588000000001, 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.300 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1914 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.301 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298942+0000", 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301665+0000", 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027234030000000001 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.302 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301712+0000", 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6987999999999998e-05 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301739+0000", 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6618000000000002e-05 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301914+0000", 2024-09-10T15:27:05.303 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017554499999999999 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302156+0000", 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024161300000000001 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302394+0000", 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000238001 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.325961+0000", 2024-09-10T15:27:05.304 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023567504 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326705+0000", 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000743251 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326812+0000", 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000107135 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.305 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326915+0000", 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103597 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2097 3.1c 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.022894675, 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025789561999999999, 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.306 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2097 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.307 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196187+0000", 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.136e-06 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200289+0000", 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041016150000000003 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200336+0000", 2024-09-10T15:27:05.308 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6526999999999997e-05 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200356+0000", 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0366000000000001e-05 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200456+0000", 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9889000000000005e-05 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.309 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200727+0000", 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027102199999999999 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201638+0000", 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000910909 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.220951+0000", 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019313157000000001 2024-09-10T15:27:05.310 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221783+0000", 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00083172699999999999 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221897+0000", 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114078 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221975+0000", 2024-09-10T15:27:05.311 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8135999999999999e-05 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2167 3.27 e70/23 3:e6c4ba75:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.74:head v 70'7, mlcod=69'5)", 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.514243133000001, 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017419674, 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.312 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704839+0000", 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.313 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711422+0000", 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065833719999999997 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711461+0000", 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8685e-05 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711487+0000", 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6718000000000001e-05 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.314 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711617+0000", 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000129844 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711636+0000", 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8499e-05 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.722206+0000", 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010569846000000001 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.315 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.722256+0000", 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0803000000000001e-05 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2296 3.10 3:096a7ecf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.95:head [create,setxattr user.rgw.idtag (60) in=14b,setxattr user.rgw.tail_tag (60) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.658204226000001, 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018620313999999999, 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.316 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2296 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.317 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560879+0000", 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2600000000000001e-06 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562473+0000", 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015938020000000001 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.318 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562514+0000", 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1561999999999999e-05 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562533+0000", 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8286000000000001e-05 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562661+0000", 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012875699999999999 2024-09-10T15:27:05.319 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562950+0000", 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028865800000000001 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.563877+0000", 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092681999999999997 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579332+0000", 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015454987 2024-09-10T15:27:05.320 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579362+0000", 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0165999999999999e-05 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579445+0000", 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2727999999999998e-05 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579496+0000", 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1288000000000001e-05 2024-09-10T15:27:05.321 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2302 3.27 e71/23 3:e5e963ff:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.96:head v 71'8, mlcod=69'6)", 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.496390506000001, 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019253927000000001, 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:05.322 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722692+0000", 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7640000000000001e-06 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731782+0000", 2024-09-10T15:27:05.323 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009089382 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731824+0000", 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2851e-05 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731844+0000", 2024-09-10T15:27:05.324 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9896000000000001e-05 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731975+0000", 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000131089 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.732009+0000", 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3791999999999998e-05 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.325 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.741859+0000", 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0098501330000000005 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.741943+0000", 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4019999999999999e-05 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.326 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2320 3.10 3:0be12419:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.99:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 10.039160398, 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01725233, 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2320 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.327 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.328 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179922+0000", 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8899999999999999e-06 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181591+0000", 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016687119999999999 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181634+0000", 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2855000000000002e-05 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.329 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181652+0000", 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8229000000000001e-05 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181756+0000", 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010405500000000001 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181982+0000", 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000225627 2024-09-10T15:27:05.330 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.182599+0000", 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000617576 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.194441+0000", 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011841463999999999 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197000+0000", 2024-09-10T15:27:05.331 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025590439999999999 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197094+0000", 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4474000000000004e-05 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197172+0000", 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7404000000000006e-05 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.332 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.333 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.333 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:05.334 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:27:05.335 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:05.333+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:05.435 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:05.433+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:05.495 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:05.496 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:05.496 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:05.496 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:05.509 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:27:05.537 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:05.529+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:05.638 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:05.633+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:05.668 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:05.668 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:05.668 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:05.668 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:05.668 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:05.682 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:27:05.741 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:05.737+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1175 3.30 e62/23 3:0f1b3996:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_2:head v 62'3, mlcod=61'1)", 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.007399+0000", 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.790116476999998, 2024-09-10T15:27:05.802 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022279245, 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007399+0000", 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007399+0000", 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.803 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007402+0000", 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1599999999999998e-06 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012585+0000", 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051825719999999999 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.804 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012631+0000", 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6508999999999998e-05 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012656+0000", 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4499e-05 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012819+0000", 2024-09-10T15:27:05.805 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016317999999999999 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012879+0000", 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9874999999999998e-05 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029560+0000", 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016681109999999999 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.806 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029678+0000", 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011834 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1177 3.3a 3:5f641ecd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.036474+0000", 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.761041390999999, 2024-09-10T15:27:05.807 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026832357000000001, 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1177 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.036474+0000", 2024-09-10T15:27:05.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.036474+0000", 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.036477+0000", 2024-09-10T15:27:05.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0970000000000002e-06 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.040949+0000", 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004472274 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.040992+0000", 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2919e-05 2024-09-10T15:27:05.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041011+0000", 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8584e-05 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041152+0000", 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141073 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041472+0000", 2024-09-10T15:27:05.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031981799999999998 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041804+0000", 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033232699999999999 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.051868+0000", 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01006364 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.063076+0000", 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011208163 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.063193+0000", 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116908 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.063306+0000", 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113554 2024-09-10T15:27:05.813 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1182 3.2b e62/23 3:d6877f0f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_9:head v 62'2, mlcod=0'0)", 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.133458+0000", 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.664057147999998, 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017348209999999999, 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.133458+0000", 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.133458+0000", 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.133462+0000", 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2739999999999999e-06 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.139996+0000", 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065340210000000001 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140035+0000", 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.926e-05 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140053+0000", 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8349e-05 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140195+0000", 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014194399999999999 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140253+0000", 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7562000000000002e-05 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.150698+0000", 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010445588 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.150806+0000", 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108212 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1183 3.e 3:708ebd7f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.152010+0000", 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.645504993000003, 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023359326, 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1183 2024-09-10T15:27:05.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.152010+0000", 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.152010+0000", 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.152015+0000", 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4170000000000002e-06 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154760+0000", 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027446710000000002 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154808+0000", 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8256e-05 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154834+0000", 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6381999999999999e-05 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154999+0000", 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016509000000000001 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.155345+0000", 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034616900000000001 2024-09-10T15:27:05.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.155676+0000", 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000330262 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.166169+0000", 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010493758000000001 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.823 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175192+0000", 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090228389999999995 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175294+0000", 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101407 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175370+0000", 2024-09-10T15:27:05.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6075000000000006e-05 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1190 3.3c 3:3d352607:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.304421+0000", 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.493094640999999, 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017453946000000001, 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.825 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1190 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.304421+0000", 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.304421+0000", 2024-09-10T15:27:05.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.304425+0000", 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2599999999999999e-06 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307747+0000", 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003322457 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307805+0000", 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7448999999999998e-05 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307826+0000", 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0849e-05 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307956+0000", 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130576 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.308237+0000", 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028108799999999998 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.308465+0000", 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000227758 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.317201+0000", 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087354919999999992 2024-09-10T15:27:05.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.321568+0000", 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043677580000000002 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.321732+0000", 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016395 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.321875+0000", 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000142309 2024-09-10T15:27:05.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1210 3.2b e62/23 3:d428ccbb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_9:head v 62'4, mlcod=62'2)", 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.105574+0000", 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.691941112999999, 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018229328, 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.105574+0000", 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.105574+0000", 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.105576+0000", 2024-09-10T15:27:05.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0789999999999999e-06 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111644+0000", 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060673979999999999 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111667+0000", 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2877000000000001e-05 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111690+0000", 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3065e-05 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111798+0000", 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010778 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111843+0000", 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5182999999999998e-05 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.123669+0000", 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011826671 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.123804+0000", 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134275 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1212 3.3a 3:5fff66ed:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:05.835 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.136169+0000", 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.661346760000001, 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022350334999999999, 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1212 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.136169+0000", 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.136169+0000", 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.136172+0000", 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999999e-06 2024-09-10T15:27:05.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139222+0000", 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030503380000000001 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139252+0000", 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9611000000000002e-05 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139268+0000", 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6373000000000001e-05 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139409+0000", 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141147 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139697+0000", 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028720200000000002 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139846+0000", 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014943899999999999 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.149526+0000", 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096795579999999996 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.158413+0000", 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088876500000000004 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.158463+0000", 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9619e-05 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.158519+0000", 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6168999999999997e-05 2024-09-10T15:27:05.841 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1358 3.26 3:6627d402:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.352784+0000", 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.444730980000003, 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021929707999999999, 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.842 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1358 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.352784+0000", 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.352784+0000", 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.352787+0000", 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2079999999999999e-06 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354480+0000", 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016934000000000001 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354502+0000", 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2206999999999999e-05 2024-09-10T15:27:05.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354513+0000", 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0740000000000001e-05 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354591+0000", 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7535999999999998e-05 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354765+0000", 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017483700000000001 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354880+0000", 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011435200000000001 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374445+0000", 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019564993999999999 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374565+0000", 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120528 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374649+0000", 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4260999999999998e-05 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374714+0000", 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4645000000000002e-05 2024-09-10T15:27:05.847 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1360 3.3a 3:5e523b29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.372391+0000", 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.425124197000002, 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019404747, 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.848 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1360 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.372391+0000", 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.372391+0000", 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.372394+0000", 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2200000000000001e-06 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374513+0000", 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021182150000000001 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374533+0000", 2024-09-10T15:27:05.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0029000000000001e-05 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374543+0000", 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0740000000000001e-05 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374616+0000", 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2231999999999996e-05 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374784+0000", 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167868 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374946+0000", 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016210500000000001 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.383596+0000", 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086502809999999992 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.391620+0000", 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.008024013 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.391721+0000", 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010061 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.391796+0000", 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5433999999999996e-05 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1367 3.20 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.462878+0000", 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.334637305999998, 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025499633000000001, 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.854 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1367 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.462878+0000", 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.462878+0000", 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.462881+0000", 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.48e-06 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464477+0000", 2024-09-10T15:27:05.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001596643 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464510+0000", 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3077999999999997e-05 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464525+0000", 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4401e-05 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464622+0000", 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6972000000000006e-05 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464796+0000", 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000174458 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464969+0000", 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017297800000000001 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473878+0000", 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089088090000000002 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.488241+0000", 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014363312 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.488320+0000", 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8427e-05 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.488378+0000", 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8075000000000002e-05 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1368 3.5 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.471890+0000", 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 34.325625209999998, 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025271399, 2024-09-10T15:27:05.860 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1368 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.471890+0000", 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.471890+0000", 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.471893+0000", 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4080000000000001e-06 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473375+0000", 2024-09-10T15:27:05.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014823849999999999 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473408+0000", 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3250999999999997e-05 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473421+0000", 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2438e-05 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473498+0000", 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6911999999999998e-05 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473667+0000", 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016903999999999999 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473823+0000", 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156475 2024-09-10T15:27:05.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.481199+0000", 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073759020000000002 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.497035+0000", 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015835755999999999 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.497100+0000", 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.497162+0000", 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1319e-05 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1381 3.2b e63/23 3:d6ca9a27:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_2:head v 63'6, mlcod=62'4)", 2024-09-10T15:27:05.866 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.959709+0000", 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.837806125999997, 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022028941999999999, 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.959709+0000", 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.867 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.959709+0000", 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.959712+0000", 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999999e-06 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965692+0000", 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005979626 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965726+0000", 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4402e-05 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965743+0000", 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6697e-05 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965891+0000", 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014849000000000001 2024-09-10T15:27:05.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965956+0000", 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5219e-05 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.981692+0000", 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015735612999999999 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.981738+0000", 2024-09-10T15:27:05.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6184999999999999e-05 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1382 3.3a 3:5c7d2a35:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.967278+0000", 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.830237803000003, 2024-09-10T15:27:05.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021108330000000002, 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1382 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.967278+0000", 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.967278+0000", 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.967281+0000", 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9869999999999999e-06 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972735+0000", 2024-09-10T15:27:05.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054546129999999996 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972783+0000", 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7568999999999998e-05 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972807+0000", 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.463e-05 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972967+0000", 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015941999999999999 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.973272+0000", 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030489699999999999 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.973554+0000", 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028234400000000002 2024-09-10T15:27:05.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.985690+0000", 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012136169 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.988229+0000", 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025388070000000001 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.988319+0000", 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9701000000000001e-05 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.988386+0000", 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7193000000000005e-05 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1390 3.16 3:685c184e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.137419+0000", 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 33.660095988000002, 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020276387, 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1390 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.137419+0000", 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.137419+0000", 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.137423+0000", 2024-09-10T15:27:05.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1319999999999998e-06 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.138905+0000", 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014823659999999999 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.138937+0000", 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2234999999999999e-05 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.138951+0000", 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4197e-05 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.139093+0000", 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141388 2024-09-10T15:27:05.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.139104+0000", 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.145236+0000", 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061317849999999998 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.145507+0000", 2024-09-10T15:27:05.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027067299999999997 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.145601+0000", 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4281000000000001e-05 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.155192+0000", 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095910619999999992 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.157591+0000", 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002398374 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.157648+0000", 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7272000000000003e-05 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.157696+0000", 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8007999999999998e-05 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.884 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1727 3.e 3:739b2b2d:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.459970+0000", 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.337545181999999, 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018548438, 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.885 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1727 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.459970+0000", 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.459970+0000", 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.459973+0000", 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8679999999999999e-06 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.462936+0000", 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029632640000000002 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.462975+0000", 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8936999999999997e-05 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.462990+0000", 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5157000000000001e-05 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.463097+0000", 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106736 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.463311+0000", 2024-09-10T15:27:05.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021343999999999999 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.463808+0000", 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000496942 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.474182+0000", 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010374883999999999 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.478367+0000", 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041841689999999997 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.478457+0000", 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9870999999999994e-05 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.478519+0000", 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2088 3.26 3:64947c0a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.RfeDPgIgfcw8pRS8DUuVuvkC-nFOFP-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.007173+0000", 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.790342122, 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019897755, 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.891 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2088 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.007173+0000", 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.007173+0000", 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.007178+0000", 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0069999999999997e-06 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010436+0000", 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032576139999999998 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010473+0000", 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7029000000000001e-05 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010496+0000", 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2654e-05 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010672+0000", 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017598000000000001 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.011103+0000", 2024-09-10T15:27:05.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000431612 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.011507+0000", 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040427399999999999 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.026142+0000", 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014634561000000001 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.895 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.026885+0000", 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00074267599999999995 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.026982+0000", 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7591999999999997e-05 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.027071+0000", 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8756000000000002e-05 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.896 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2115 3.e 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.675629+0000", 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.12188647, 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025446198999999999, 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2115 2024-09-10T15:27:05.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.675629+0000", 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.675629+0000", 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.675632+0000", 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2559999999999998e-06 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678198+0000", 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025654150000000001 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678242+0000", 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4421e-05 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678261+0000", 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9208999999999999e-05 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678421+0000", 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015928900000000001 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678707+0000", 2024-09-10T15:27:05.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028610300000000001 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.679925+0000", 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012186479999999999 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700288+0000", 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020362228 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.901 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700883+0000", 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059576900000000001 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700997+0000", 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011415400000000001 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.701075+0000", 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7707000000000007e-05 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.902 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2121 3.26 3:67fce6a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.68:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.842659+0000", 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.954856017999999, 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022763314, 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.903 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2121 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.842659+0000", 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.842659+0000", 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.842663+0000", 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.377e-06 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844728+0000", 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020652040000000002 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844771+0000", 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3148000000000001e-05 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844794+0000", 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2979000000000001e-05 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844970+0000", 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017614200000000001 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.845418+0000", 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044737200000000003 2024-09-10T15:27:05.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.846578+0000", 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011604849999999999 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865072+0000", 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018493907 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.907 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865209+0000", 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013663999999999999 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865324+0000", 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115118 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865423+0000", 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8942000000000002e-05 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.908 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2140 3.2 e70/23 3:41e1aae4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.o5pR5N96QCi6URaV0uXzaZAiql4QK_j_1:head v 70'9, mlcod=68'7)", 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.124597+0000", 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.672918743, 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022703645000000001, 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.124597+0000", 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.124597+0000", 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.124598+0000", 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0299999999999997e-07 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133606+0000", 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090081810000000005 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133640+0000", 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3760999999999997e-05 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133657+0000", 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7285000000000001e-05 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133805+0000", 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014860000000000001 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133849+0000", 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3781e-05 2024-09-10T15:27:05.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.147205+0000", 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013355753 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.147300+0000", 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5381e-05 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2155 3.3a 3:5f7b2ed9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.72:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.449603+0000", 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.347912750000001, 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017743208999999999, 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2155 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.914 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.449603+0000", 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.449603+0000", 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.449605+0000", 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0430000000000002e-06 2024-09-10T15:27:05.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451275+0000", 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016698279999999999 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451306+0000", 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1081999999999998e-05 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:05.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451328+0000", 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2852000000000001e-05 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451462+0000", 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133585 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451631+0000", 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016937899999999999 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.452141+0000", 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000509626 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.464414+0000", 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012272542000000001 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.467230+0000", 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028160580000000002 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.467301+0000", 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0943000000000002e-05 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.467346+0000", 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5271000000000001e-05 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:05.919 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:05.920 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-10T15:27:05.922 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:27:05.922 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:05.917+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:06.022 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:06.017+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:06.076 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:06.076 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:06.077 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:06.093 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:27:06.110 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:27:06.110 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:27:06.123 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:06.117+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:06.127 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:27:06.128 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:27:06.145 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:27:06.146 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:27:06.162 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:27:06.162 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:27:06.182 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:27:06.183 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:27:06.203 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:27:06.203 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:27:06.205 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:06.206 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:06.219 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:27:06.224 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:27:06.224 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:27:06.225 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:06.217+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:06.244 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:27:06.244 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:27:06.325 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:06.321+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:06.336 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:06.336 INFO:teuthology.orchestra.run.smithi099.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:06.349 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:27:06.426 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:06.421+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:06.483 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:06.483 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:06.497 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:27:06.542 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:06.537+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:06.619 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:06.620 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:06.627 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:06.625+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:06.634 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:27:06.728 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:06.725+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:06.801 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:06.801 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:06.816 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:27:06.868 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:06.861+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:07.016 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.016 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.017 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:27:07.017 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:07.009+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:07.116 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:27:07.109+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:27:07.131 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-10T15:27:07.184 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.184 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:27:07.242 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:07.237+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:07.317 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:07.313+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:07.364 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.364 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.378 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:27:07.418 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:07.417+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:07.497 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.497 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.511 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:27:07.520 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:07.517+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:07.620 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:07.617+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:07.633 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.633 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:27:07.722 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:07.717+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:07.770 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.770 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.784 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:27:07.823 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-09-10T15:27:07.820+0000 7f40192ff640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26453) UID: 0 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:adding file to bucket buck_2024_08_10_15_26_41: 10Mb.100 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:upload file successful 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.1 from bucket to /tmp/downloadfile.1 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.2 from bucket to /tmp/downloadfile.2 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.3 from bucket to /tmp/downloadfile.3 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.4 from bucket to /tmp/downloadfile.4 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.5 from bucket to /tmp/downloadfile.5 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.6 from bucket to /tmp/downloadfile.6 2024-09-10T15:27:07.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.7 from bucket to /tmp/downloadfile.7 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.8 from bucket to /tmp/downloadfile.8 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.9 from bucket to /tmp/downloadfile.9 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.10 from bucket to /tmp/downloadfile.10 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.11 from bucket to /tmp/downloadfile.11 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.12 from bucket to /tmp/downloadfile.12 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.13 from bucket to /tmp/downloadfile.13 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.14 from bucket to /tmp/downloadfile.14 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.15 from bucket to /tmp/downloadfile.15 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.16 from bucket to /tmp/downloadfile.16 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.17 from bucket to /tmp/downloadfile.17 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.18 from bucket to /tmp/downloadfile.18 2024-09-10T15:27:07.900 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.19 from bucket to /tmp/downloadfile.19 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.20 from bucket to /tmp/downloadfile.20 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.21 from bucket to /tmp/downloadfile.21 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.22 from bucket to /tmp/downloadfile.22 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.23 from bucket to /tmp/downloadfile.23 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.24 from bucket to /tmp/downloadfile.24 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.25 from bucket to /tmp/downloadfile.25 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.26 from bucket to /tmp/downloadfile.26 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.27 from bucket to /tmp/downloadfile.27 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.28 from bucket to /tmp/downloadfile.28 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.29 from bucket to /tmp/downloadfile.29 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.30 from bucket to /tmp/downloadfile.30 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.31 from bucket to /tmp/downloadfile.31 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.32 from bucket to /tmp/downloadfile.32 2024-09-10T15:27:07.901 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.33 from bucket to /tmp/downloadfile.33 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.34 from bucket to /tmp/downloadfile.34 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.35 from bucket to /tmp/downloadfile.35 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.36 from bucket to /tmp/downloadfile.36 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.37 from bucket to /tmp/downloadfile.37 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.38 from bucket to /tmp/downloadfile.38 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.39 from bucket to /tmp/downloadfile.39 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.40 from bucket to /tmp/downloadfile.40 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.41 from bucket to /tmp/downloadfile.41 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.42 from bucket to /tmp/downloadfile.42 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.43 from bucket to /tmp/downloadfile.43 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.44 from bucket to /tmp/downloadfile.44 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.45 from bucket to /tmp/downloadfile.45 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.46 from bucket to /tmp/downloadfile.46 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.47 from bucket to /tmp/downloadfile.47 2024-09-10T15:27:07.902 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.48 from bucket to /tmp/downloadfile.48 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.49 from bucket to /tmp/downloadfile.49 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.50 from bucket to /tmp/downloadfile.50 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.51 from bucket to /tmp/downloadfile.51 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.52 from bucket to /tmp/downloadfile.52 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.53 from bucket to /tmp/downloadfile.53 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.54 from bucket to /tmp/downloadfile.54 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.55 from bucket to /tmp/downloadfile.55 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.56 from bucket to /tmp/downloadfile.56 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.57 from bucket to /tmp/downloadfile.57 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.58 from bucket to /tmp/downloadfile.58 2024-09-10T15:27:07.903 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.59 from bucket to /tmp/downloadfile.59 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.60 from bucket to /tmp/downloadfile.60 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.61 from bucket to /tmp/downloadfile.61 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.62 from bucket to /tmp/downloadfile.62 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.63 from bucket to /tmp/downloadfile.63 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.64 from bucket to /tmp/downloadfile.64 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.65 from bucket to /tmp/downloadfile.65 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.66 from bucket to /tmp/downloadfile.66 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.67 from bucket to /tmp/downloadfile.67 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.68 from bucket to /tmp/downloadfile.68 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.69 from bucket to /tmp/downloadfile.69 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.70 from bucket to /tmp/downloadfile.70 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.71 from bucket to /tmp/downloadfile.71 2024-09-10T15:27:07.904 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.72 from bucket to /tmp/downloadfile.72 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.73 from bucket to /tmp/downloadfile.73 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.74 from bucket to /tmp/downloadfile.74 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.75 from bucket to /tmp/downloadfile.75 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.76 from bucket to /tmp/downloadfile.76 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.77 from bucket to /tmp/downloadfile.77 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.78 from bucket to /tmp/downloadfile.78 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.79 from bucket to /tmp/downloadfile.79 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.80 from bucket to /tmp/downloadfile.80 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.81 from bucket to /tmp/downloadfile.81 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.82 from bucket to /tmp/downloadfile.82 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.83 from bucket to /tmp/downloadfile.83 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.84 from bucket to /tmp/downloadfile.84 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.85 from bucket to /tmp/downloadfile.85 2024-09-10T15:27:07.905 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.86 from bucket to /tmp/downloadfile.86 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.87 from bucket to /tmp/downloadfile.87 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.88 from bucket to /tmp/downloadfile.88 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.89 from bucket to /tmp/downloadfile.89 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.90 from bucket to /tmp/downloadfile.90 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.91 from bucket to /tmp/downloadfile.91 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.92 from bucket to /tmp/downloadfile.92 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.93 from bucket to /tmp/downloadfile.93 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.94 from bucket to /tmp/downloadfile.94 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.95 from bucket to /tmp/downloadfile.95 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.96 from bucket to /tmp/downloadfile.96 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.97 from bucket to /tmp/downloadfile.97 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.98 from bucket to /tmp/downloadfile.98 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.99 from bucket to /tmp/downloadfile.99 2024-09-10T15:27:07.906 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading 10Mb.100 from bucket to /tmp/downloadfile.100 2024-09-10T15:27:07.907 INFO:tasks.workunit.client.0.smithi099.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T15:27:07.907 INFO:tasks.workunit.client.0.smithi099.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-09-10T15:27:07.907 INFO:tasks.workunit.client.0.smithi099.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-10T15:27:07.907 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:07.907 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:07.922 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:27:07.923 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:07.917+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:08.024 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:08.017+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:08.053 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:08.053 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:08.068 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:27:08.100 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is set 2024-09-10T15:27:08.125 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:08.120+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:08.226 INFO:tasks.ceph.osd.5.smithi159.stderr:2024-09-10T15:27:08.221+0000 7fdfac6cc640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26592) UID: 0 2024-09-10T15:27:08.253 INFO:teuthology.orchestra.run.smithi159.stdout:ERROR: (22) Invalid argument 2024-09-10T15:27:08.253 INFO:teuthology.orchestra.run.smithi159.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-10T15:27:08.261 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-10T15:27:08.268 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-10T15:27:08.354 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-09-10T15:27:08.352+0000 7efc71a48640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26459) UID: 0 2024-09-10T15:27:08.428 INFO:tasks.ceph.osd.6.smithi159.stderr:2024-09-10T15:27:08.421+0000 7f1c15f33640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26595) UID: 0 2024-09-10T15:27:08.430 INFO:teuthology.orchestra.run.smithi099.stdout:osd.0: {} 2024-09-10T15:27:08.430 INFO:teuthology.orchestra.run.smithi099.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-10T15:27:08.449 INFO:teuthology.orchestra.run.smithi099.stdout:osd.1: {} 2024-09-10T15:27:08.449 INFO:teuthology.orchestra.run.smithi099.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-10T15:27:08.452 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop_reply(client.5163.0:345 3.f e76/23 ondisk, result = 0)", 2024-09-10T15:27:08.452 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:27:08.452577+0000", 2024-09-10T15:27:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 0.000113275, 2024-09-10T15:27:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012675499999999999, 2024-09-10T15:27:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "started", 2024-09-10T15:27:08.453 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452577+0000", 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452577+0000", 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452578+0000", 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.113e-06 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452583+0000", 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6319999999999999e-06 2024-09-10T15:27:08.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452595+0000", 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2663999999999999e-05 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452603+0000", 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3950000000000003e-06 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452638+0000", 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5092999999999998e-05 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452642+0000", 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3660000000000002e-06 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:27:08.452707+0000", 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4752000000000006e-05 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.457 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-09-10T15:27:08.458 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 1 2024-09-10T15:27:08.458 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:08.469 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-10T15:27:08.470 INFO:teuthology.orchestra.run.smithi099.stdout:osd.2: {} 2024-09-10T15:27:08.470 INFO:teuthology.orchestra.run.smithi099.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-10T15:27:08.488 INFO:teuthology.orchestra.run.smithi099.stdout:osd.3: {} 2024-09-10T15:27:08.488 INFO:teuthology.orchestra.run.smithi099.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-10T15:27:08.525 INFO:teuthology.orchestra.run.smithi099.stdout:osd.4: {} 2024-09-10T15:27:08.525 INFO:teuthology.orchestra.run.smithi099.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-10T15:27:08.529 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:08.524+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:08.562 INFO:teuthology.orchestra.run.smithi099.stdout:osd.5: {} 2024-09-10T15:27:08.563 INFO:teuthology.orchestra.run.smithi099.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-10T15:27:08.599 INFO:teuthology.orchestra.run.smithi099.stdout:osd.6: {} 2024-09-10T15:27:08.599 INFO:teuthology.orchestra.run.smithi099.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-10T15:27:08.616 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:08.616 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:08.616 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:08.616 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:08.616 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:08.620 INFO:teuthology.orchestra.run.smithi099.stdout:osd.7: {} 2024-09-10T15:27:08.621 INFO:teuthology.orchestra.run.smithi099.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-10T15:27:08.630 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:08.625+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:08.632 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-10T15:27:08.731 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:08.728+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:08.808 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 108.94029218, 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033319319, 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 46 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:08.809 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865775+0000", 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865779+0000", 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5300000000000001e-06 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.810 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865794+0000", 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5463000000000001e-05 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865837+0000", 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2772999999999999e-05 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.865867+0000", 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9465999999999999e-05 2024-09-10T15:27:08.811 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866049+0000", 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018222900000000001 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.866074+0000", 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4916999999999999e-05 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.812 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869282+0000", 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032077210000000002 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.869303+0000", 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.103e-05 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893073+0000", 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023769983000000001 2024-09-10T15:27:08.813 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893364+0000", 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029180699999999999 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.893672+0000", 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030795699999999998 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.814 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.896646+0000", 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029734000000000002 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898840+0000", 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002193885 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.898976+0000", 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013676199999999999 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.815 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:19.899095+0000", 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118396 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1174 3.34 3:2edb9bfe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.827867398000002, 2024-09-10T15:27:08.816 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024623020999999998, 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1174 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:08.817 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978200+0000", 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.978206+0000", 2024-09-10T15:27:08.818 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3940000000000004e-06 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.982994+0000", 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047887839999999999 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983055+0000", 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0418999999999999e-05 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.819 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983076+0000", 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0752999999999999e-05 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983249+0000", 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017358299999999999 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.983639+0000", 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00038977100000000002 2024-09-10T15:27:08.820 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.984055+0000", 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041571000000000002 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:26.997740+0000", 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013685235 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002491+0000", 2024-09-10T15:27:08.821 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0047511860000000001 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002696+0000", 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000204706 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.822 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.002823+0000", 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012747999999999999 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1203 3.32 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.841032947000002, 2024-09-10T15:27:08.824 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025222162999999999, 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1203 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:08.825 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965035+0000", 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.965038+0000", 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.826 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969717+0000", 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046785730000000001 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969764+0000", 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7676000000000002e-05 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969785+0000", 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0616e-05 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.827 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.969895+0000", 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000109728 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970109+0000", 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000214553 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970302+0000", 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019275800000000001 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.828 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.978686+0000", 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083835560000000003 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989954+0000", 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01126866 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990123+0000", 2024-09-10T15:27:08.829 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016891000000000001 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990257+0000", 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013365299999999999 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1206 3.c 3:3361c113:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:08.830 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 40.782110586999998, 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020855684999999999, 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1206 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:08.831 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023957+0000", 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.023962+0000", 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8099999999999997e-06 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.832 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027160+0000", 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0031981259999999999 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027205+0000", 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5460000000000002e-05 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027233+0000", 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7118999999999999e-05 2024-09-10T15:27:08.833 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027404+0000", 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017182300000000001 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.027701+0000", 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029708099999999998 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:08.834 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.028039+0000", 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033788900000000002 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.037510+0000", 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094706579999999999 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044590+0000", 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0070796729999999999 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.835 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044739+0000", 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014925999999999999 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.044813+0000", 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3786000000000001e-05 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.836 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1383 3.39 3:9dc5e620:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.816778141, 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022778762000000001, 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1383 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.837 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989289+0000", 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.989293+0000", 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0599999999999999e-06 2024-09-10T15:27:08.838 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993369+0000", 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0040763070000000004 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993410+0000", 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1038999999999998e-05 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.839 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993428+0000", 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7771e-05 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993550+0000", 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000122576 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.993846+0000", 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029542799999999998 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.840 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.994081+0000", 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000235641 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.009893+0000", 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0158113 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.011974+0000", 2024-09-10T15:27:08.841 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020813630000000001 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012020+0000", 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5734e-05 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.012068+0000", 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8542999999999999e-05 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.842 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1384 3.2c 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 36.806300055999998, 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020364463999999999, 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1384 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.843 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999768+0000", 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.999770+0000", 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4260000000000002e-06 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.844 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002633+0000", 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028625120000000002 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002658+0000", 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5537999999999998e-05 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002674+0000", 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5877000000000001e-05 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.845 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.002819+0000", 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014549300000000001 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003193+0000", 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037408599999999998 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:08.846 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003510+0000", 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031606700000000001 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.015405+0000", 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011895279 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020063+0000", 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0046583550000000003 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.847 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020100+0000", 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6780999999999999e-05 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.020132+0000", 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.205e-05 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1709 3.34 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:08.848 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.804767494, 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022337223999999999, 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1709 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.849 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001300+0000", 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.001303+0000", 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9830000000000001e-06 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.850 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004358+0000", 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030546330000000002 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004394+0000", 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6616000000000003e-05 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004409+0000", 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5129e-05 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.004573+0000", 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016369099999999999 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.005006+0000", 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00043294999999999998 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006178+0000", 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011721640000000001 2024-09-10T15:27:08.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023441+0000", 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017262323 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023464+0000", 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3828e-05 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.853 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023567+0000", 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000102847 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023637+0000", 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0060000000000003e-05 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1718 3.c 3:328a3854:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.xA_hHjoo7scrwl59lEhs4AnaT1c9BOR_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:08.854 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.516002833000002, 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019371422999999999, 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1718 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.855 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290065+0000", 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.290068+0000", 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6660000000000001e-06 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.856 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292551+0000", 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024821600000000002 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292578+0000", 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6981000000000001e-05 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292590+0000", 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2105e-05 2024-09-10T15:27:08.857 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.292755+0000", 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016553499999999999 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293164+0000", 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040894899999999998 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:08.858 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.293571+0000", 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040694199999999998 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.308210+0000", 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01463879 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309290+0000", 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0010800860000000001 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.859 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309378+0000", 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7632000000000004e-05 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.309436+0000", 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8576999999999998e-05 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.860 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1883 3.32 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.067140598999998, 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021961523, 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1883 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.861 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738927+0000", 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.738931+0000", 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9859999999999996e-06 2024-09-10T15:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741686+0000", 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027550740000000002 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741744+0000", 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.804e-05 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741767+0000", 2024-09-10T15:27:08.863 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2651999999999999e-05 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.741908+0000", 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000140922 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.742202+0000", 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029458400000000002 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.864 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743119+0000", 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00091704199999999997 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.754582+0000", 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011462764 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760672+0000", 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.006089878 2024-09-10T15:27:08.865 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760812+0000", 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000139722 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760889+0000", 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6859000000000004e-05 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.866 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1892 3.c 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.819782006000001, 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.029189914000000001, 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1892 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.867 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.868 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986286+0000", 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.986290+0000", 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4870000000000004e-06 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989074+0000", 2024-09-10T15:27:08.869 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002784361 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989123+0000", 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8331000000000002e-05 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989151+0000", 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8551000000000002e-05 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.870 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989296+0000", 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014446199999999999 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989452+0000", 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156692 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.989582+0000", 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012952800000000001 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.871 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.999285+0000", 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009703181 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015308+0000", 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016022656 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015406+0000", 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8152000000000005e-05 2024-09-10T15:27:08.872 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.015476+0000", 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9512999999999997e-05 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1905 3.3b 3:dc76b4ec:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.32:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 22.786109068000002, 2024-09-10T15:27:08.873 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024023249999999999, 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1905 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.874 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019959+0000", 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.019961+0000", 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6000000000000001e-06 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022708+0000", 2024-09-10T15:27:08.875 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027468420000000002 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022749+0000", 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0791000000000003e-05 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022768+0000", 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9046e-05 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.876 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.022895+0000", 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126897 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.023194+0000", 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029916699999999998 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.024121+0000", 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092692399999999998 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.877 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.038705+0000", 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014584185 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043638+0000", 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049327429999999999 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043847+0000", 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020970200000000001 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.878 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.043982+0000", 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013435300000000001 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1947 3.c 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.840721503000001, 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023953879000000001, 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.879 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1947 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.880 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965346+0000", 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.965349+0000", 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1e-06 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967022+0000", 2024-09-10T15:27:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016730709999999999 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967083+0000", 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0693999999999999e-05 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967103+0000", 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9879000000000001e-05 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967196+0000", 2024-09-10T15:27:08.882 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3284999999999999e-05 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967335+0000", 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000138882 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.967738+0000", 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040259999999999997 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.883 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.978781+0000", 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011043078 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989144+0000", 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01036346 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989239+0000", 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5130999999999994e-05 2024-09-10T15:27:08.884 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.989300+0000", 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0699000000000003e-05 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1950 3.1b e69/23 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head v 69'11, mlcod=68'9)", 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 21.710105180999999, 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020694515, 2024-09-10T15:27:08.885 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095962+0000", 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.886 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.095963+0000", 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0599999999999999e-07 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103130+0000", 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.007167606 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103155+0000", 2024-09-10T15:27:08.887 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5177999999999998e-05 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103166+0000", 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1027e-05 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103252+0000", 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.5555000000000003e-05 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.888 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.103271+0000", 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9106999999999998e-05 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116534+0000", 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013263074999999999 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:47.116657+0000", 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012276100000000001 2024-09-10T15:27:08.889 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2097 3.1c e70/23 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head v 70'8, mlcod=67'6)", 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.604232178, 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019625252999999999, 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.890 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201835+0000", 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201838+0000", 2024-09-10T15:27:08.891 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.553e-06 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206019+0000", 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041808970000000003 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206065+0000", 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5955000000000003e-05 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.892 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206084+0000", 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9052e-05 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206282+0000", 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019853399999999999 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.206325+0000", 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2117999999999999e-05 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.893 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221343+0000", 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015018323 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221461+0000", 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000117821 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.894 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2103 3.15 3:a805735b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.65:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.444597683000001, 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022718693000000002, 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2103 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.895 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361470+0000", 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.361473+0000", 2024-09-10T15:27:08.896 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2399999999999999e-06 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364075+0000", 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002601885 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364106+0000", 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0445000000000001e-05 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.897 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364118+0000", 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2729e-05 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364284+0000", 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016567700000000001 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.364737+0000", 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00045284900000000001 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.898 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.365933+0000", 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011964790000000001 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.380849+0000", 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014915517999999999 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.899 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.383771+0000", 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029221669999999998 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384056+0000", 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028503399999999998 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.384189+0000", 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013266999999999999 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.900 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2112 3.c 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.158788227999999, 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021998597000000002, 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.901 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2112 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647279+0000", 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.902 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.647284+0000", 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2649999999999998e-06 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649669+0000", 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002385688 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649717+0000", 2024-09-10T15:27:08.903 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7797000000000003e-05 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649738+0000", 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1005999999999998e-05 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.649908+0000", 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016979199999999999 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.904 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650330+0000", 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00042203599999999998 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.650750+0000", 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041985699999999999 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.662847+0000", 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012097139999999999 2024-09-10T15:27:08.905 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669092+0000", 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062450279999999997 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669200+0000", 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108378 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.906 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.669278+0000", 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7609999999999997e-05 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2115 3.e e70/23 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head v 70'8, mlcod=67'6)", 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.125935894000001, 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020482499000000001, 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.907 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680132+0000", 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.908 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.680133+0000", 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.451e-06 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682900+0000", 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027672170000000002 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682934+0000", 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4005999999999999e-05 2024-09-10T15:27:08.909 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.682952+0000", 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7608000000000001e-05 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683128+0000", 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017570300000000001 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.683190+0000", 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2507000000000003e-05 2024-09-10T15:27:08.910 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700468+0000", 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017277682999999999 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700614+0000", 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000146324 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.911 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2124 3.15 3:aa28aa43:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.GCb3ey1gJiZZ0JvS2IR_yrJtE_qQhyg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.833616804999998, 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023070721999999998, 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2124 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.912 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972451+0000", 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.913 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.972455+0000", 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8360000000000002e-06 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976710+0000", 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0042554769999999997 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976751+0000", 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1307999999999998e-05 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.914 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976771+0000", 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.976971+0000", 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019981799999999999 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977371+0000", 2024-09-10T15:27:08.915 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039999099999999999 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.977782+0000", 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00041056000000000003 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.993874+0000", 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016091668999999999 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.916 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995173+0000", 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001299571 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995362+0000", 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018902400000000001 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.995522+0000", 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015942300000000001 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.917 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2170 3.24 e70/23 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head v 70'12, mlcod=68'10)", 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.977161645999999, 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020388610000000001, 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.918 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828906+0000", 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.828909+0000", 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8499999999999998e-06 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.919 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840061+0000", 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011152072000000001 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840089+0000", 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8186000000000001e-05 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840104+0000", 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4721e-05 2024-09-10T15:27:08.920 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840209+0000", 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000105283 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.840244+0000", 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.502e-05 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.921 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849236+0000", 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089918459999999995 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.849295+0000", 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8631999999999997e-05 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2311 3.38 e71/23 3:1f5d1b31:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.CbmyYpo0pl88KNJFZ0NLOldB0HRNzU2_1:head v 71'9, mlcod=71'7)", 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:08.922 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 13.793361757, 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024560713000000001, 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012706+0000", 2024-09-10T15:27:08.923 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.012708+0000", 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4590000000000001e-06 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017270+0000", 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0045614360000000003 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:08.924 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017312+0000", 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1983000000000001e-05 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017333+0000", 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1324000000000001e-05 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017497+0000", 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016356899999999999 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.925 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.017567+0000", 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0171000000000003e-05 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037115+0000", 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019548660999999998 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.037267+0000", 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015111000000000001 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.926 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.927 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:08.927 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:08.927 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:08.928 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-10T15:27:08.929 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:08.921+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:09.014 INFO:tasks.workunit.client.0.smithi099.stdout:user 0.565744886963756 deleted 2024-09-10T15:27:09.020 INFO:tasks.workunit.client.0.smithi099.stdout:OK 2024-09-10T15:27:09.020 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-10T15:27:09.021 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-10T15:27:09.029 INFO:tasks.ceph.osd.7.smithi159.stderr:2024-09-10T15:27:09.021+0000 7fc3bcdbd640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26597) UID: 0 2024-09-10T15:27:09.074 INFO:tasks.workunit:Stopping ['rgw/s3_multipart_upload.pl'] on client.0... 2024-09-10T15:27:09.074 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-10T15:27:09.086 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:09.086 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:09.087 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:09.087 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:09.100 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-10T15:27:09.146 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:09.144+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:09.232 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:09.228+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:09.266 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:09.266 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:09.267 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:09.280 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-10T15:27:09.334 INFO:tasks.ceph.osd.4.smithi159.stderr:2024-09-10T15:27:09.329+0000 7fecd82d5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26591) UID: 0 2024-09-10T15:27:09.395 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:09.396 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T15:27:09.406 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T15:27:09.407 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:09.439 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 129.092156491, 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.31304392199999997, 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.440 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344092+0000", 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344094+0000", 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5469999999999999e-06 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.441 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344120+0000", 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5882999999999999e-05 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344142+0000", 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1523e-05 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344158+0000", 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.615e-05 2024-09-10T15:27:09.442 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344250+0000", 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2116999999999999e-05 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.344272+0000", 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1645999999999999e-05 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653513+0000", 2024-09-10T15:27:09.443 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30924171900000003 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653640+0000", 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000126511 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.653771+0000", 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013131800000000001 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.444 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.655455+0000", 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016834669999999999 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657012+0000", 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001557484 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657075+0000", 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3195999999999996e-05 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.445 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:00.657136+0000", 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0361e-05 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 127.964399598, 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018056131, 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.446 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 139 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:09.447 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471849+0000", 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1699999999999997e-07 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471862+0000", 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2456000000000001e-05 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.448 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471877+0000", 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.508e-05 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471884+0000", 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3839999999999999e-06 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484689+0000", 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012804704 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.449 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.484847+0000", 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015784600000000001 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485040+0000", 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000192855 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487809+0000", 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027691019999999998 2024-09-10T15:27:09.450 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489772+0000", 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019635450000000001 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489848+0000", 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6029e-05 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489905+0000", 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6412999999999997e-05 2024-09-10T15:27:09.451 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 127.964352631, 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018920323999999999, 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 140 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.453 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.471896+0000", 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6599999999999995e-07 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472084+0000", 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000187219 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.454 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472105+0000", 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1653000000000001e-05 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472121+0000", 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5773e-05 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485850+0000", 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013728857000000001 2024-09-10T15:27:09.455 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.485972+0000", 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012171999999999999 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.486162+0000", 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019028799999999999 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488800+0000", 2024-09-10T15:27:09.456 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026383399999999999 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490701+0000", 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019005249999999999 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490765+0000", 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3818999999999993e-05 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490816+0000", 2024-09-10T15:27:09.457 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1363999999999998e-05 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4198.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 127.96409881, 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018806761000000002, 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.458 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4198", 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.159:0/3787946324", 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 141 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472150+0000", 2024-09-10T15:27:09.459 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472151+0000", 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.517e-06 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472167+0000", 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6390000000000001e-05 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.460 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472190+0000", 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2495999999999999e-05 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.472205+0000", 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5130000000000001e-05 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487871+0000", 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015666001999999998 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.461 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.487995+0000", 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012402 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.488189+0000", 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000193561 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.489374+0000", 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011849180000000001 2024-09-10T15:27:09.462 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490826+0000", 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001452159 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490882+0000", 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5982e-05 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:01.490956+0000", 2024-09-10T15:27:09.463 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4585999999999994e-05 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1180 3.10 3:0984bf5b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.342434308999998, 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023100504000000001, 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1180 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093814+0000", 2024-09-10T15:27:09.465 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.093818+0000", 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.924e-06 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096732+0000", 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029139919999999998 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096760+0000", 2024-09-10T15:27:09.466 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8487999999999999e-05 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096777+0000", 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6515e-05 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.096874+0000", 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7182000000000006e-05 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.467 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.097083+0000", 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000208698 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.097267+0000", 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000184279 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.107950+0000", 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010682741000000001 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.468 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116814+0000", 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088636289999999996 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116861+0000", 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7540999999999998e-05 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.116915+0000", 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3514999999999998e-05 2024-09-10T15:27:09.469 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1203 3.32 e62/45 3:4f36cd29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_2:head v 62'3, mlcod=61'1)", 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.465755909999999, 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019033174999999999, 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.470 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970492+0000", 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.471 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.970495+0000", 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3999999999999999e-06 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974692+0000", 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004197409 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974733+0000", 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0602000000000002e-05 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.472 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974757+0000", 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4525999999999999e-05 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974922+0000", 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000164816 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.974986+0000", 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4142999999999999e-05 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.473 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989395+0000", 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014408921999999999 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.989526+0000", 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130357 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.474 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1204 3.37 3:ec79df02:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.449312149000001, 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.02302278, 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1204 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.475 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986936+0000", 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.986939+0000", 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9890000000000001e-06 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.476 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990155+0000", 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032154660000000002 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990181+0000", 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6072e-05 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990195+0000", 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4129e-05 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.477 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990327+0000", 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132263 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.990705+0000", 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037791399999999997 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.991081+0000", 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00037557600000000002 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.478 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.999068+0000", 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0079871249999999994 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009789+0000", 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010720887 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009876+0000", 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.7520000000000002e-05 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.479 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.009959+0000", 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2838999999999997e-05 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1218 3.2a 3:558e4067:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.227828150999997, 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017902910000000001, 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.480 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1218 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.481 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208420+0000", 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.208423+0000", 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7360000000000001e-06 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210338+0000", 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001915148 2024-09-10T15:27:09.482 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210370+0000", 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1837e-05 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210385+0000", 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5012e-05 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210476+0000", 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0950000000000002e-05 2024-09-10T15:27:09.483 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210641+0000", 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016545000000000001 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.210766+0000", 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012440800000000001 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.223542+0000", 2024-09-10T15:27:09.484 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012775922 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226195+0000", 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002653454 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226261+0000", 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5748999999999997e-05 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.485 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.226323+0000", 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2243999999999996e-05 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1220 3.10 3:08f79c03:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.205715462999997, 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018274163, 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.486 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1220 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230533+0000", 2024-09-10T15:27:09.487 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.230536+0000", 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6740000000000001e-06 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232597+0000", 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020610239999999998 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.488 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232628+0000", 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1316999999999998e-05 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232643+0000", 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5353999999999999e-05 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232745+0000", 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101366 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.489 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.232947+0000", 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020186999999999999 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.233128+0000", 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018164900000000001 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.239213+0000", 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060851109999999998 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.490 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248677+0000", 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0094637360000000004 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248751+0000", 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4486000000000005e-05 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.248807+0000", 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5575999999999998e-05 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.491 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1362 3.21 e63/23 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head v 63'3, mlcod=61'1)", 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.027490563000001, 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017128918, 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:09.492 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408758+0000", 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.408759+0000", 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3489999999999999e-06 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.493 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416535+0000", 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0077755319999999999 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416561+0000", 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.633e-05 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416575+0000", 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.376e-05 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.494 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416673+0000", 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8617999999999997e-05 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.416715+0000", 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1112000000000002e-05 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.425823+0000", 2024-09-10T15:27:09.495 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0091085769999999996 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.425887+0000", 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.3639999999999994e-05 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1384 3.2c e63/23 3:37519165:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_5:head v 63'5, mlcod=63'3)", 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.432516997, 2024-09-10T15:27:09.496 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016112702999999999, 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003731+0000", 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.497 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.003734+0000", 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1880000000000001e-06 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006362+0000", 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0026283650000000001 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006387+0000", 2024-09-10T15:27:09.498 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4740999999999999e-05 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006400+0000", 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3541e-05 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006545+0000", 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000144394 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.499 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.006588+0000", 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3001999999999999e-05 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.019752+0000", 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013164380999999999 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.019844+0000", 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2090999999999996e-05 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.500 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1709 3.34 e67/23 3:2f2a10be:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.1:head v 67'7, mlcod=62'5)", 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.429875713000001, 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016755263999999999, 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:09.501 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006373+0000", 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.006375+0000", 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9630000000000001e-06 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010047+0000", 2024-09-10T15:27:09.502 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036721169999999999 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010077+0000", 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0741000000000003e-05 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010098+0000", 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0839000000000002e-05 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.503 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010246+0000", 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000147894 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.010287+0000", 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1196999999999999e-05 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.022997+0000", 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012710005 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.504 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.023128+0000", 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013050799999999999 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1730 3.37 3:ec453865:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.MN6ndaRYV2EuyC3iAo0IHvk0Z_MzJqU_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 26.881620087999998, 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016741232000000002, 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.505 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1730 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554628+0000", 2024-09-10T15:27:09.506 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.554632+0000", 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4800000000000001e-06 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556158+0000", 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001526721 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556194+0000", 2024-09-10T15:27:09.507 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5652999999999999e-05 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556209+0000", 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5186e-05 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556298+0000", 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9172999999999995e-05 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.508 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556431+0000", 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013272100000000001 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.556545+0000", 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011393299999999999 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.566363+0000", 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009817882 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.509 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571282+0000", 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0049190040000000003 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571330+0000", 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8214000000000003e-05 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.571370+0000", 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9264999999999998e-05 2024-09-10T15:27:09.510 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1883 3.32 e68/45 3:4c381599:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.30:head v 68'8, mlcod=63'6)", 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.692885568000001, 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016971944999999999, 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.511 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743363+0000", 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.743365+0000", 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3470000000000001e-06 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.512 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748517+0000", 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051514589999999997 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748563+0000", 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6060999999999998e-05 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748588+0000", 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5194999999999998e-05 2024-09-10T15:27:09.513 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748730+0000", 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014263599999999999 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.748790+0000", 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9908999999999998e-05 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760196+0000", 2024-09-10T15:27:09.514 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011405861999999999 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.760335+0000", 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013847600000000001 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1914 3.37 3:efeebdfa:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.Dgg4K9tN4GZ3upzOVu1wT7WdqOlTALP_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.137310640999999, 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027977588000000001, 2024-09-10T15:27:09.515 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1914 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.516 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298938+0000", 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.298942+0000", 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301665+0000", 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027234030000000001 2024-09-10T15:27:09.517 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301712+0000", 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6987999999999998e-05 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301739+0000", 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6618000000000002e-05 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.301914+0000", 2024-09-10T15:27:09.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017554499999999999 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302156+0000", 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00024161300000000001 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302394+0000", 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000238001 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.519 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.325961+0000", 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023567504 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326705+0000", 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000743251 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326812+0000", 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000107135 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326915+0000", 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000103597 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2097 3.1c 3:39f073a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.24006309, 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025789561999999999, 2024-09-10T15:27:09.521 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2097 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196185+0000", 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.196187+0000", 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.136e-06 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200289+0000", 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041016150000000003 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200336+0000", 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6526999999999997e-05 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200356+0000", 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0366000000000001e-05 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200456+0000", 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9889000000000005e-05 2024-09-10T15:27:09.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.200727+0000", 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027102199999999999 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.201638+0000", 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000910909 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.220951+0000", 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019313157000000001 2024-09-10T15:27:09.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221783+0000", 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00083172699999999999 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221897+0000", 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000114078 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.221975+0000", 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8135999999999999e-05 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2167 3.27 e70/23 3:e6c4ba75:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.74:head v 70'7, mlcod=69'5)", 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 17.731411548000001, 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017419674, 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.527 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704837+0000", 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.704839+0000", 2024-09-10T15:27:09.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711422+0000", 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065833719999999997 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711461+0000", 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8685e-05 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711487+0000", 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6718000000000001e-05 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711617+0000", 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000129844 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.711636+0000", 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8499e-05 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.530 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.722206+0000", 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010569846000000001 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.722256+0000", 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0803000000000001e-05 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2296 3.10 3:096a7ecf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.95:head [create,setxattr user.rgw.idtag (60) in=14b,setxattr user.rgw.tail_tag (60) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.875372641, 2024-09-10T15:27:09.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018620313999999999, 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2296 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560876+0000", 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.560879+0000", 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2600000000000001e-06 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562473+0000", 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0015938020000000001 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562514+0000", 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1561999999999999e-05 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562533+0000", 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8286000000000001e-05 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562661+0000", 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012875699999999999 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.562950+0000", 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028865800000000001 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.563877+0000", 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00092681999999999997 2024-09-10T15:27:09.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579332+0000", 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015454987 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579362+0000", 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0165999999999999e-05 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579445+0000", 2024-09-10T15:27:09.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.2727999999999998e-05 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.579496+0000", 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1288000000000001e-05 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2302 3.27 e71/23 3:e5e963ff:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.96:head v 71'8, mlcod=69'6)", 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.713558921000001, 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019253927000000001, 2024-09-10T15:27:09.537 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722689+0000", 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.722692+0000", 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7640000000000001e-06 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731782+0000", 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.009089382 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731824+0000", 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2851e-05 2024-09-10T15:27:09.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731844+0000", 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9896000000000001e-05 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.731975+0000", 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000131089 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.732009+0000", 2024-09-10T15:27:09.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3791999999999998e-05 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.741859+0000", 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0098501330000000005 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.741943+0000", 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4019999999999999e-05 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2320 3.10 3:0be12419:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.99:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 14.256328813, 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01725233, 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2320 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.542 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179920+0000", 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.179922+0000", 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8899999999999999e-06 2024-09-10T15:27:09.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181591+0000", 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016687119999999999 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181634+0000", 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2855000000000002e-05 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:09.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181652+0000", 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8229000000000001e-05 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181756+0000", 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010405500000000001 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.181982+0000", 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000225627 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.182599+0000", 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000617576 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.194441+0000", 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011841463999999999 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197000+0000", 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025590439999999999 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197094+0000", 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4474000000000004e-05 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:55.197172+0000", 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7404000000000006e-05 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:09.547 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:09.548 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-09-10T15:27:09.436+0000 7f26f121d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26455) UID: 0 2024-09-10T15:27:09.549 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-10T15:27:09.564 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-10T15:27:09.565 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-10T15:27:09.575 INFO:tasks.thrashosds:joining thrashosds 2024-09-10T15:27:09.576 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-09-10T15:27:09.560+0000 7f3ab7b24640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26457) UID: 0 2024-09-10T15:27:09.730 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:09.731 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:09.731 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:09.731 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:09.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-10T15:27:09.865 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:09.865 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:09.865 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:09.879 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1175 3.30 e62/23 3:0f1b3996:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_2:head v 62'3, mlcod=61'1)", 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.007399+0000", 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.994309340000001, 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022279245, 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.006 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007399+0000", 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007399+0000", 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.007 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007402+0000", 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1599999999999998e-06 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012585+0000", 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0051825719999999999 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012631+0000", 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6508999999999998e-05 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.008 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012656+0000", 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4499e-05 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012819+0000", 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016317999999999999 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.012879+0000", 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9874999999999998e-05 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.009 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029560+0000", 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016681109999999999 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029678+0000", 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011834 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.010 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1177 3.3a 3:5f641ecd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.036474+0000", 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.965234254000002, 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026832357000000001, 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1177 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.011 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.036474+0000", 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.036474+0000", 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.036477+0000", 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0970000000000002e-06 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.012 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.040949+0000", 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.004472274 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.040992+0000", 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2919e-05 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041011+0000", 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8584e-05 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.013 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041152+0000", 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141073 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041472+0000", 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00031981799999999998 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.041804+0000", 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033232699999999999 2024-09-10T15:27:10.014 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.051868+0000", 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01006364 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.063076+0000", 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011208163 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.063193+0000", 2024-09-10T15:27:10.015 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116908 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.063306+0000", 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113554 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1182 3.2b e62/23 3:d6877f0f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_9:head v 62'2, mlcod=0'0)", 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.133458+0000", 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.868250011000001, 2024-09-10T15:27:10.016 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017348209999999999, 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.133458+0000", 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.133458+0000", 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.017 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.133462+0000", 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2739999999999999e-06 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.139996+0000", 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065340210000000001 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140035+0000", 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.926e-05 2024-09-10T15:27:10.018 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140053+0000", 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.8349e-05 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140195+0000", 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014194399999999999 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.140253+0000", 2024-09-10T15:27:10.019 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7562000000000002e-05 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.150698+0000", 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010445588 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.150806+0000", 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000108212 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.020 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1183 3.e 3:708ebd7f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.152010+0000", 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.849697855999999, 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023359326, 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1183 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.021 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.152010+0000", 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.152010+0000", 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.152015+0000", 2024-09-10T15:27:10.022 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4170000000000002e-06 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154760+0000", 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027446710000000002 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154808+0000", 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8256e-05 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154834+0000", 2024-09-10T15:27:10.023 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6381999999999999e-05 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.154999+0000", 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016509000000000001 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.155345+0000", 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00034616900000000001 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.155676+0000", 2024-09-10T15:27:10.024 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000330262 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.166169+0000", 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010493758000000001 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175192+0000", 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090228389999999995 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.025 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175294+0000", 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000101407 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.175370+0000", 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6075000000000006e-05 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1190 3.3c 3:3d352607:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.304421+0000", 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 42.697287504000002, 2024-09-10T15:27:10.026 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017453946000000001, 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1190 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.304421+0000", 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.027 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.304421+0000", 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.304425+0000", 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2599999999999999e-06 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307747+0000", 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.003322457 2024-09-10T15:27:10.028 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307805+0000", 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7448999999999998e-05 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307826+0000", 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0849e-05 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.307956+0000", 2024-09-10T15:27:10.029 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000130576 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.308237+0000", 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028108799999999998 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.308465+0000", 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000227758 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.030 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.317201+0000", 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0087354919999999992 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.321568+0000", 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043677580000000002 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.321732+0000", 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016395 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.031 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.321875+0000", 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000142309 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1210 3.2b e62/23 3:d428ccbb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_9:head v 62'4, mlcod=62'2)", 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.105574+0000", 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.896133976000002, 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018229328, 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.032 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.105574+0000", 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.105574+0000", 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.033 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.105576+0000", 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0789999999999999e-06 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111644+0000", 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0060673979999999999 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111667+0000", 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2877000000000001e-05 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.034 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111690+0000", 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3065e-05 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111798+0000", 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010778 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.111843+0000", 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5182999999999998e-05 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.035 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.123669+0000", 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011826671 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.123804+0000", 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000134275 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.036 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1212 3.3a 3:5fff66ed:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:28.136169+0000", 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 41.865539622999997, 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022350334999999999, 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1212 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.037 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.136169+0000", 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.136169+0000", 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.136172+0000", 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2289999999999999e-06 2024-09-10T15:27:10.038 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139222+0000", 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0030503380000000001 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139252+0000", 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9611000000000002e-05 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139268+0000", 2024-09-10T15:27:10.039 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6373000000000001e-05 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139409+0000", 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141147 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139697+0000", 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028720200000000002 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.040 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.139846+0000", 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014943899999999999 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.149526+0000", 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0096795579999999996 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.158413+0000", 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0088876500000000004 2024-09-10T15:27:10.041 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.158463+0000", 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9619e-05 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:28.158519+0000", 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6168999999999997e-05 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.042 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1358 3.26 3:6627d402:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.352784+0000", 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.648923842999999, 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021929707999999999, 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1358 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.043 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.352784+0000", 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.352784+0000", 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.352787+0000", 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2079999999999999e-06 2024-09-10T15:27:10.044 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354480+0000", 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016934000000000001 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354502+0000", 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2206999999999999e-05 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354513+0000", 2024-09-10T15:27:10.045 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0740000000000001e-05 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354591+0000", 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7535999999999998e-05 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354765+0000", 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017483700000000001 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.354880+0000", 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011435200000000001 2024-09-10T15:27:10.046 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374445+0000", 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019564993999999999 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374565+0000", 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000120528 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374649+0000", 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4260999999999998e-05 2024-09-10T15:27:10.047 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374714+0000", 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.4645000000000002e-05 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1360 3.3a 3:5e523b29:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.372391+0000", 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.629317059999998, 2024-09-10T15:27:10.048 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019404747, 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1360 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.372391+0000", 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.049 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.372391+0000", 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.372394+0000", 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2200000000000001e-06 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.050 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374513+0000", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0021182150000000001 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374533+0000", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0029000000000001e-05 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374543+0000", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0740000000000001e-05 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374616+0000", 2024-09-10T15:27:10.051 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2231999999999996e-05 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374784+0000", 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000167868 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.374946+0000", 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016210500000000001 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.052 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.383596+0000", 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0086502809999999992 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.391620+0000", 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.008024013 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.391721+0000", 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010061 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.053 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.391796+0000", 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.5433999999999996e-05 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1367 3.20 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.462878+0000", 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.538830169000001, 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025499633000000001, 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.054 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1367 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.462878+0000", 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.462878+0000", 2024-09-10T15:27:10.055 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.462881+0000", 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.48e-06 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464477+0000", 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001596643 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.056 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464510+0000", 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3077999999999997e-05 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464525+0000", 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4401e-05 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464622+0000", 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.6972000000000006e-05 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.057 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464796+0000", 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000174458 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.464969+0000", 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017297800000000001 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473878+0000", 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0089088090000000002 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.058 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.488241+0000", 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014363312 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.488320+0000", 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.8427e-05 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.488378+0000", 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.8075000000000002e-05 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1368 3.5 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.471890+0000", 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.529818073000001, 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025271399, 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1368 2024-09-10T15:27:10.060 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.471890+0000", 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.471890+0000", 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.061 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.471893+0000", 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4080000000000001e-06 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473375+0000", 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014823849999999999 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473408+0000", 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3250999999999997e-05 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.062 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473421+0000", 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2438e-05 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473498+0000", 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6911999999999998e-05 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473667+0000", 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016903999999999999 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.063 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.473823+0000", 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000156475 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.481199+0000", 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0073759020000000002 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.497035+0000", 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015835755999999999 2024-09-10T15:27:10.064 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.497100+0000", 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5512999999999994e-05 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.497162+0000", 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1319e-05 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.065 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1381 3.2b e63/23 3:d6ca9a27:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_2:head v 63'6, mlcod=62'4)", 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.959709+0000", 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.041998989, 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022028941999999999, 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.959709+0000", 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.066 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.959709+0000", 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.959712+0000", 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7099999999999999e-06 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965692+0000", 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.005979626 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.067 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965726+0000", 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4402e-05 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965743+0000", 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.6697e-05 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965891+0000", 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014849000000000001 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.068 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.965956+0000", 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.5219e-05 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.981692+0000", 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015735612999999999 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.981738+0000", 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.6184999999999999e-05 2024-09-10T15:27:10.069 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1382 3.3a 3:5c7d2a35:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:31.967278+0000", 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.034430665999999, 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021108330000000002, 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.070 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1382 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.967278+0000", 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.967278+0000", 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.071 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.967281+0000", 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9869999999999999e-06 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972735+0000", 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0054546129999999996 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972783+0000", 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7568999999999998e-05 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.072 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972807+0000", 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.463e-05 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.972967+0000", 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015941999999999999 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.973272+0000", 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030489699999999999 2024-09-10T15:27:10.073 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.973554+0000", 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028234400000000002 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.985690+0000", 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012136169 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.988229+0000", 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025388070000000001 2024-09-10T15:27:10.074 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.988319+0000", 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9701000000000001e-05 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:31.988386+0000", 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7193000000000005e-05 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.075 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1390 3.16 3:685c184e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.137419+0000", 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 37.864288850999998, 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020276387, 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1390 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.076 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.137419+0000", 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.137419+0000", 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.137423+0000", 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1319999999999998e-06 2024-09-10T15:27:10.077 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.138905+0000", 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014823659999999999 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.138937+0000", 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2234999999999999e-05 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.138951+0000", 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.4197e-05 2024-09-10T15:27:10.078 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.139093+0000", 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000141388 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.139104+0000", 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.1613999999999999e-05 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.145236+0000", 2024-09-10T15:27:10.079 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061317849999999998 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.145507+0000", 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00027067299999999997 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.145601+0000", 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4281000000000001e-05 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.080 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.155192+0000", 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0095910619999999992 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.157591+0000", 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002398374 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.157648+0000", 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7272000000000003e-05 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.081 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.157696+0000", 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8007999999999998e-05 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1727 3.e 3:739b2b2d:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.459970+0000", 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 27.541738044999999, 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018548438, 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1727 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.459970+0000", 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.083 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.459970+0000", 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.459973+0000", 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8679999999999999e-06 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.462936+0000", 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029632640000000002 2024-09-10T15:27:10.084 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.462975+0000", 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8936999999999997e-05 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.462990+0000", 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.5157000000000001e-05 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.085 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.463097+0000", 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000106736 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.463311+0000", 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00021343999999999999 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.463808+0000", 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000496942 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.086 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.474182+0000", 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010374883999999999 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.478367+0000", 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041841689999999997 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.478457+0000", 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.9870999999999994e-05 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.087 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.478519+0000", 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.2169999999999996e-05 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2088 3.26 3:64947c0a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.RfeDPgIgfcw8pRS8DUuVuvkC-nFOFP-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.007173+0000", 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.994534985000001, 2024-09-10T15:27:10.088 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019897755, 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2088 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.007173+0000", 2024-09-10T15:27:10.089 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.007173+0000", 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.007178+0000", 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0069999999999997e-06 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.090 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010436+0000", 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0032576139999999998 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010473+0000", 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7029000000000001e-05 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010496+0000", 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2654e-05 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.091 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.010672+0000", 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017598000000000001 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.011103+0000", 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000431612 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.011507+0000", 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00040427399999999999 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.092 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.026142+0000", 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014634561000000001 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.026885+0000", 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00074267599999999995 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.026982+0000", 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.7591999999999997e-05 2024-09-10T15:27:10.093 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.027071+0000", 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8756000000000002e-05 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2115 3.e 3:7086116c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.67:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.675629+0000", 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.326079332999999, 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025446198999999999, 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.094 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2115 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.675629+0000", 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.095 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.675629+0000", 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.675632+0000", 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2559999999999998e-06 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678198+0000", 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025654150000000001 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.096 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678242+0000", 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.4421e-05 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678261+0000", 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9208999999999999e-05 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678421+0000", 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015928900000000001 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.097 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.678707+0000", 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028610300000000001 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.679925+0000", 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0012186479999999999 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700288+0000", 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020362228 2024-09-10T15:27:10.098 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700883+0000", 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00059576900000000001 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.700997+0000", 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011415400000000001 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.701075+0000", 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7707000000000007e-05 2024-09-10T15:27:10.099 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2121 3.26 3:67fce6a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.68:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.842659+0000", 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.159048881, 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022763314, 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.100 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2121 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.842659+0000", 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.842659+0000", 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.101 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.842663+0000", 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.377e-06 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844728+0000", 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0020652040000000002 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844771+0000", 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3148000000000001e-05 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.102 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844794+0000", 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2979000000000001e-05 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.844970+0000", 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017614200000000001 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.845418+0000", 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044737200000000003 2024-09-10T15:27:10.103 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.846578+0000", 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0011604849999999999 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865072+0000", 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018493907 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865209+0000", 2024-09-10T15:27:10.104 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013663999999999999 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865324+0000", 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000115118 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.865423+0000", 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.8942000000000002e-05 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.105 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2140 3.2 e70/23 3:41e1aae4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.o5pR5N96QCi6URaV0uXzaZAiql4QK_j_1:head v 70'9, mlcod=68'7)", 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.124597+0000", 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.877111606, 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022703645000000001, 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.124597+0000", 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.106 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.124597+0000", 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.124598+0000", 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.0299999999999997e-07 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133606+0000", 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0090081810000000005 2024-09-10T15:27:10.107 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133640+0000", 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3760999999999997e-05 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133657+0000", 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7285000000000001e-05 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133805+0000", 2024-09-10T15:27:10.108 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014860000000000001 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.133849+0000", 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3781e-05 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.147205+0000", 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.013355753 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.109 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.147300+0000", 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5381e-05 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2155 3.3a 3:5f7b2ed9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.72:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:51.449603+0000", 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 18.552105612999998, 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017743208999999999, 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.110 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2155 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.449603+0000", 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.449603+0000", 2024-09-10T15:27:10.111 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.449605+0000", 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0430000000000002e-06 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451275+0000", 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0016698279999999999 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.112 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451306+0000", 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1081999999999998e-05 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451328+0000", 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2852000000000001e-05 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451462+0000", 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133585 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.113 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.451631+0000", 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00016937899999999999 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.452141+0000", 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000509626 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.464414+0000", 2024-09-10T15:27:10.114 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.012272542000000001 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.467230+0000", 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028160580000000002 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.467301+0000", 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.0943000000000002e-05 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:51.467346+0000", 2024-09-10T15:27:10.115 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5271000000000001e-05 2024-09-10T15:27:10.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.116 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.116 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.116 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:10.117 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-10T15:27:10.126 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-10T15:27:10.243 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:10.243 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:10.243 INFO:teuthology.orchestra.run.smithi099.stdout: "num_ops": 0 2024-09-10T15:27:10.243 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:10.258 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-10T15:27:10.381 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:10.381 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [], 2024-09-10T15:27:10.381 INFO:teuthology.orchestra.run.smithi099.stdout: "complaint_time": 30, 2024-09-10T15:27:10.382 INFO:teuthology.orchestra.run.smithi099.stdout: "num_blocked_ops": 0 2024-09-10T15:27:10.382 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:10.395 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-10T15:27:10.518 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:27:10.518 INFO:teuthology.orchestra.run.smithi099.stdout: "size": 20, 2024-09-10T15:27:10.518 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 600, 2024-09-10T15:27:10.518 INFO:teuthology.orchestra.run.smithi099.stdout: "ops": [ 2024-09-10T15:27:10.518 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 126.993212196, 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.210353965, 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.519 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523098+0000", 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523100+0000", 2024-09-10T15:27:10.520 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.995e-06 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523107+0000", 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2699999999999999e-06 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523297+0000", 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000190111 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.521 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523320+0000", 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2540000000000001e-05 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523495+0000", 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017490499999999999 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.523524+0000", 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9386e-05 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.522 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730695+0000", 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.207171036 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.730969+0000", 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000273408 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.731307+0000", 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00033854099999999998 2024-09-10T15:27:10.523 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.732702+0000", 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001395299 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733235+0000", 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00053255299999999995 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733340+0000", 2024-09-10T15:27:10.524 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00010473500000000001 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.733452+0000", 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000112186 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4272.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e19)", 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 126.777820717, 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30235208299999999, 2024-09-10T15:27:10.525 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "reached pg", 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4272", 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/3790976109", 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.526 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738489+0000", 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738492+0000", 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.198e-06 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738501+0000", 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.2099999999999999e-06 2024-09-10T15:27:10.527 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738524+0000", 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.3127000000000001e-05 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738536+0000", 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2108e-05 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738650+0000", 2024-09-10T15:27:10.528 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000113893 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for peered", 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:03.738661+0000", 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.0764000000000001e-05 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040543+0000", 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.30188254199999998 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.529 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:25:04.040841+0000", 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00029824099999999998 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1175 3.30 3:0f1b3996:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.001648+0000", 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.514662444999999, 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.028348508000000001, 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.530 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1175 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.001648+0000", 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.001648+0000", 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.531 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.001652+0000", 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3359999999999997e-06 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006499+0000", 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0048467199999999997 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006539+0000", 2024-09-10T15:27:10.532 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.0745999999999999e-05 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006559+0000", 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9076000000000002e-05 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006692+0000", 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000133857 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.533 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.006945+0000", 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025226099999999999 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.007213+0000", 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000268044 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.534 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029424+0000", 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.02221163 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029927+0000", 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00050258200000000001 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029964+0000", 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6730999999999998e-05 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.535 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.029996+0000", 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2524999999999998e-05 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1176 3.28 3:15488b12:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.013041+0000", 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.503269134, 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022431941, 2024-09-10T15:27:10.536 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1176 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.013041+0000", 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.537 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.013041+0000", 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.013045+0000", 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.6430000000000001e-06 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016675+0000", 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0036305909999999999 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.538 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016725+0000", 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9521999999999998e-05 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016759+0000", 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.4029000000000002e-05 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.016920+0000", 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000161707 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.539 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.017312+0000", 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039121799999999998 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.017757+0000", 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00044546599999999999 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.032984+0000", 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015227021 2024-09-10T15:27:10.540 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.035417+0000", 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0024327480000000002 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.035448+0000", 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1188e-05 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.035473+0000", 2024-09-10T15:27:10.541 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4808e-05 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1196 3.d 3:b022ad54:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.446181+0000", 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.070128920999998, 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019953740000000001, 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.542 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1196 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.446181+0000", 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.446181+0000", 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.543 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.446187+0000", 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3800000000000002e-06 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449586+0000", 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0033995689999999999 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449648+0000", 2024-09-10T15:27:10.544 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.1376000000000003e-05 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449668+0000", 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0591999999999999e-05 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.449813+0000", 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00014528100000000001 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.545 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.450137+0000", 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00032372199999999997 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.450372+0000", 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00023495499999999999 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.465383+0000", 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015010862 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.546 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.465963+0000", 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00058020299999999995 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.466059+0000", 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.5607999999999997e-05 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.466135+0000", 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.6192000000000005e-05 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.547 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1197 3.11 3:89914701:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:27.513564+0000", 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 43.002746074999997, 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019861805, 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1197 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.548 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.513564+0000", 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.513564+0000", 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.513567+0000", 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8229999999999999e-06 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.549 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516243+0000", 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.002676079 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516287+0000", 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3835999999999998e-05 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516306+0000", 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.9675999999999999e-05 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.550 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516484+0000", 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017797900000000001 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516740+0000", 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025542099999999998 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.516986+0000", 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000246085 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533136+0000", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.016150235999999998 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533259+0000", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012310399999999999 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533353+0000", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3548000000000006e-05 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.552 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:27.533426+0000", 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.3017999999999998e-05 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1396 3.9 3:90cc0258:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.211235+0000", 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.305074959000002, 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.033177222999999999, 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.553 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1396 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.211235+0000", 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.211235+0000", 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.554 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.211238+0000", 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8030000000000001e-06 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.212800+0000", 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.001561832 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.212843+0000", 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.2756999999999997e-05 2024-09-10T15:27:10.555 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.212860+0000", 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7271000000000001e-05 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.212931+0000", 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1452000000000006e-05 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.556 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.213061+0000", 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012965000000000001 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.213195+0000", 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013424300000000001 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.222589+0000", 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0093942620000000004 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.244303+0000", 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021713337999999999 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.244363+0000", 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.0034000000000002e-05 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.244412+0000", 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9580999999999998e-05 2024-09-10T15:27:10.558 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1405 3.2f 3:f76407e4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:32.368472+0000", 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 38.147837731000003, 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021390950999999998, 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.559 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1405 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.368472+0000", 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.368472+0000", 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.560 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.368475+0000", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1159999999999999e-06 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.371008+0000", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025321469999999998 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.371077+0000", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.8868999999999994e-05 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.561 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.371109+0000", 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2738999999999999e-05 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.371247+0000", 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137904 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.371510+0000", 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00026236500000000003 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.562 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.372383+0000", 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087380599999999998 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.389640+0000", 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017256383 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.389670+0000", 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0185999999999999e-05 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.563 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.389789+0000", 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000118681 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:32.389863+0000", 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.4754999999999998e-05 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1712 3.13 3:c8e59a58:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.xBDUP587n3fL5WQ5Wd6O9bKITgbFWEj_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.134302+0000", 2024-09-10T15:27:10.564 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.382008210999999, 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.019890458, 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1712 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.134302+0000", 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.565 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.134302+0000", 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.134306+0000", 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8399999999999997e-06 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.138690+0000", 2024-09-10T15:27:10.566 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0043845710000000003 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.138739+0000", 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.8627e-05 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.138765+0000", 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.5891999999999999e-05 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.138881+0000", 2024-09-10T15:27:10.567 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000116595 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.139074+0000", 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00019293700000000001 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.139210+0000", 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013563599999999999 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.153344+0000", 2024-09-10T15:27:10.568 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014133674000000001 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.154064+0000", 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00072051799999999996 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.154137+0000", 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.2955999999999997e-05 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.569 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.154192+0000", 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.5211999999999999e-05 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1715 3.1d 3:b893d1bc:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:42.157311+0000", 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 28.358998835000001, 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.021814874000000001, 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.570 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1715 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.157311+0000", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.157311+0000", 2024-09-10T15:27:10.571 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.157314+0000", 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.2989999999999999e-06 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.160200+0000", 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0028863510000000001 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.160235+0000", 2024-09-10T15:27:10.572 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.5045000000000001e-05 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.160252+0000", 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.7402e-05 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.160372+0000", 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000119827 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.573 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.160677+0000", 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00030519800000000001 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.161556+0000", 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00087895400000000004 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.178792+0000", 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.017235213999999999 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.574 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.178861+0000", 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9103000000000006e-05 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.178989+0000", 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000128169 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:42.179126+0000", 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000137312 2024-09-10T15:27:10.575 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1874 3.28 3:1775fa0c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_._R3ueyKUNnP2Ctai6HQ5XVx_CuM5AgZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:45.543612+0000", 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.972698281, 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022831095999999999, 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.576 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1874 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.543612+0000", 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.543612+0000", 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.577 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.543615+0000", 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3330000000000001e-06 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.547786+0000", 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041710050000000002 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.547832+0000", 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.5689999999999998e-05 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.578 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.547853+0000", 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.0951999999999999e-05 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.547963+0000", 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00011004499999999999 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.548178+0000", 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000214749 2024-09-10T15:27:10.579 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.548356+0000", 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017795800000000001 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.560179+0000", 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011822989000000001 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.566362+0000", 2024-09-10T15:27:10.580 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061832229999999998 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.566406+0000", 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3896999999999997e-05 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:45.566443+0000", 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.7255000000000002e-05 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.581 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1911 3.1d 3:ba95017a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.33:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.162468+0000", 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.353842019999998, 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020875073000000001, 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1911 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.582 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.162468+0000", 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.162468+0000", 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.162471+0000", 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4669999999999998e-06 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.583 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.163967+0000", 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0014963839999999999 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.163997+0000", 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.0105999999999999e-05 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.164019+0000", 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.1922000000000001e-05 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.584 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.164194+0000", 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000174847 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.164499+0000", 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000304701 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.165430+0000", 2024-09-10T15:27:10.585 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00093169399999999995 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.179466+0000", 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.014035822999999999 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.182958+0000", 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0034920730000000001 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.183209+0000", 2024-09-10T15:27:10.586 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025136700000000001 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.183343+0000", 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013368899999999999 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:1914 3.37 e68/23 3:efeebdfa:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.Dgg4K9tN4GZ3upzOVu1wT7WdqOlTALP_1:head v 68'6, mlcod=67'4)", 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.302730+0000", 2024-09-10T15:27:10.587 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 24.213580035, 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.023577598000000002, 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302730+0000", 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302730+0000", 2024-09-10T15:27:10.588 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.302731+0000", 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.1999999999999999e-07 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.305663+0000", 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0029326170000000002 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.589 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.305717+0000", 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3254999999999997e-05 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.305741+0000", 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4535000000000001e-05 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.305917+0000", 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00017572200000000001 2024-09-10T15:27:10.590 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.305955+0000", 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8204999999999998e-05 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326173+0000", 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020218053999999999 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.326308+0000", 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00013448999999999999 2024-09-10T15:27:10.591 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1941 3.13 3:cb468910:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.38:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.828062+0000", 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.688248317999999, 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.025290901000000001, 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.592 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1941 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.828062+0000", 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.828062+0000", 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.593 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.828065+0000", 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.2559999999999998e-06 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.832054+0000", 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0039888370000000003 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.832083+0000", 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9365000000000001e-05 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.594 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.832097+0000", 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3463e-05 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.832181+0000", 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.4426999999999997e-05 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.832186+0000", 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.1170000000000003e-06 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.595 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.835779+0000", 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0035925559999999998 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.836035+0000", 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00025619599999999998 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.836993+0000", 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00095797600000000003 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.596 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.852873+0000", 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015880262999999999 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.853263+0000", 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00039018499999999998 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.853314+0000", 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.0705999999999999e-05 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.597 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.853353+0000", 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.8553999999999997e-05 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:1944 3.1d 3:b8e19857:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.TUwDCXn6RC4_sv2LWUaxhQ645_O1HhV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:46.933762+0000", 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 23.582548026000001, 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.020085906000000001, 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.598 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 1944 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.933762+0000", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.933762+0000", 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.599 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.933767+0000", 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.7330000000000003e-06 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.939654+0000", 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0058873229999999999 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.939708+0000", 2024-09-10T15:27:10.600 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3536999999999999e-05 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.939734+0000", 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.6761999999999999e-05 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.939863+0000", 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012827100000000001 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.939975+0000", 2024-09-10T15:27:10.601 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000111896 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.940069+0000", 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.4320000000000005e-05 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.946644+0000", 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0065753010000000004 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.953756+0000", 2024-09-10T15:27:10.602 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0071116560000000001 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.953808+0000", 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.2153e-05 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:46.953848+0000", 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9953999999999997e-05 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.603 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2094 3.11 3:8b1a52ff:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.BpPCfr_ICEe8VnPR6c1DPn5tStvp5Tz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.162811+0000", 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 20.353498721000001, 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.027630353999999999, 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2094 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.604 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.162811+0000", 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.162811+0000", 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.162817+0000", 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.3569999999999997e-06 2024-09-10T15:27:10.605 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.168942+0000", 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0061250840000000003 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.169002+0000", 2024-09-10T15:27:10.606 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.9976999999999999e-05 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.169031+0000", 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.8855000000000001e-05 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.169197+0000", 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000166389 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op must wait for map", 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.169204+0000", 2024-09-10T15:27:10.607 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.9199999999999998e-06 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.173395+0000", 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0041912340000000003 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.173496+0000", 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000100729 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:10.608 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.173595+0000", 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.9463000000000006e-05 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.184388+0000", 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.010792535000000001 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.190296+0000", 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0059080349999999998 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.609 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.190385+0000", 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8782999999999993e-05 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.190442+0000", 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.6993000000000001e-05 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_repop(client.4364.0:2118 3.3f e70/48 3:fd7c3aaf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.6OutWCbOnJUoR6EgAd38lwPhVbxENPy_1:head v 70'5, mlcod=67'3)", 2024-09-10T15:27:10.610 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:50.813053+0000", 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 19.703256781, 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.024960475999999999, 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.813053+0000", 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.611 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.813053+0000", 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.813054+0000", 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8000000000000004e-07 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.821061+0000", 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0080067820000000005 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.612 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.821102+0000", 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.1177999999999998e-05 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.821130+0000", 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7954999999999999e-05 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.821331+0000", 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00020126700000000001 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.613 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.821399+0000", 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 6.7630000000000001e-05 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.837882+0000", 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.01648258 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:50.838014+0000", 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000132204 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.614 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2287 3.22 3:47a2dfef:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.kgESP2zbhDLrh_TEpueIeZMg_a0NUQ7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.420239+0000", 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 16.096071439999999, 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022372133999999998, 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2287 2024-09-10T15:27:10.615 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.420239+0000", 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.420239+0000", 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.616 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.420241+0000", 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.4090000000000001e-06 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.422195+0000", 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0019538149999999998 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.422228+0000", 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.3599999999999997e-05 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.617 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.422242+0000", 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.3854e-05 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.422331+0000", 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 8.8708000000000005e-05 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.422511+0000", 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00018002299999999999 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.618 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.422682+0000", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000171261 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.431010+0000", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0083278469999999993 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.442522+0000", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.011511397 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.619 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.442571+0000", 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.9282e-05 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.442611+0000", 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.9938000000000003e-05 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2299 3.2f 3:f56fc1bc:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.gYh42IrUYfjOEWc-J_-KbYGf3AorF-J_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.687860+0000", 2024-09-10T15:27:10.620 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.828450492, 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.026385239000000001, 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2299 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.621 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.687860+0000", 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.687860+0000", 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.687864+0000", 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 4.3429999999999998e-06 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.622 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.694069+0000", 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0062045779999999997 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.694126+0000", 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7621000000000003e-05 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.694155+0000", 2024-09-10T15:27:10.623 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.9056000000000001e-05 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.694339+0000", 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000183995 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.694756+0000", 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000416332 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.624 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.695189+0000", 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000433915 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.713918+0000", 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.018728432 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.714093+0000", 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000175489 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.625 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.714187+0000", 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 9.3511999999999995e-05 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.714245+0000", 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 5.7966e-05 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "description": "osd_op(client.4364.0:2308 3.28 3:163aeaed:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.97:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:10.626 INFO:teuthology.orchestra.run.smithi099.stdout: "initiated_at": "2024-09-10T15:26:54.864896+0000", 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "age": 15.651414093, 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.022050991999999998, 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "continuous": false, 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "type_data": { 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "client_info": { 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "client": "client.4364", 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "tid": 2308 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "events": [ 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "initiated", 2024-09-10T15:27:10.627 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.864896+0000", 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "header_read", 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.864896+0000", 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "throttled", 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.864899+0000", 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 2.7460000000000001e-06 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "all_read", 2024-09-10T15:27:10.628 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.867453+0000", 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0025540419999999999 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "dispatched", 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.867484+0000", 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 3.1065000000000002e-05 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "queued_for_pg", 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.867496+0000", 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 1.2299e-05 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.629 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "reached_pg", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.867649+0000", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00015273500000000001 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "started", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.867935+0000", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00028609799999999998 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.868843+0000", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.000907838 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:10.630 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.883998+0000", 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.015154999000000001 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "op_commit", 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.886747+0000", 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.0027491619999999999 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "commit_sent", 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.886870+0000", 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 0.00012278500000000001 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "event": "done", 2024-09-10T15:27:10.631 INFO:teuthology.orchestra.run.smithi099.stdout: "time": "2024-09-10T15:26:54.886947+0000", 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout: "duration": 7.7223000000000002e-05 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout: ] 2024-09-10T15:27:10.632 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:27:10.633 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-10T15:27:10.764 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:10.764 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:10.764 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:27:10.764 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:10.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-10T15:27:10.900 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:10.900 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:10.900 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:27:10.900 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:27:10.900 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:10.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-10T15:27:11.038 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:11.038 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:27:11.038 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:27:11.038 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:27:11.038 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.038 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1181 3.19 3:98ecfd30:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.929270266000003, 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024964212, 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1181 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.039 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104727+0000", 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.040 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.104732+0000", 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2200000000000003e-06 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111913+0000", 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00718171 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111956+0000", 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2855999999999998e-05 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.041 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.111988+0000", 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1415999999999999e-05 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112135+0000", 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014741600000000001 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112393+0000", 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025839 2024-09-10T15:27:11.042 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.112642+0000", 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024873400000000002 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.125741+0000", 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013098487000000001 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.043 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129377+0000", 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036366760000000001 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129582+0000", 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020458499999999999 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.129692+0000", 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000109722 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.044 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1182 3.2b 3:d6877f0f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.907283186999997, 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023699754999999999, 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.045 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1182 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126714+0000", 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.046 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.126718+0000", 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131768+0000", 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050503650000000002 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131795+0000", 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7361000000000001e-05 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.047 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131809+0000", 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4106e-05 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.131933+0000", 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012341500000000001 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132188+0000", 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025496999999999998 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.048 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.132440+0000", 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025235399999999999 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.145720+0000", 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013279699000000001 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150294+0000", 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045736780000000003 2024-09-10T15:27:11.049 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150348+0000", 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4840999999999999e-05 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.150414+0000", 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5763e-05 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.050 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1186 3.2b 3:d6908ca0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.820142240999999, 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021761591, 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1186 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.051 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213855+0000", 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.052 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.213858+0000", 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8159999999999998e-06 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217781+0000", 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039231550000000002 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217819+0000", 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7577000000000003e-05 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.053 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217831+0000", 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1751e-05 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.217955+0000", 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000124017 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218199+0000", 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024441099999999999 2024-09-10T15:27:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.218430+0000", 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000230461 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.227085+0000", 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086550289999999998 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235393+0000", 2024-09-10T15:27:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083088959999999996 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235489+0000", 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5778000000000004e-05 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235617+0000", 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012769999999999999 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1199 3.1b 3:dae099b0:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.497187736999997, 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022241449999999999, 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1199 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.057 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536810+0000", 2024-09-10T15:27:11.058 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.536813+0000", 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.54e-06 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540890+0000", 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040768100000000002 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.059 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540934+0000", 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4155e-05 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.540954+0000", 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9366000000000001e-05 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541095+0000", 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014104699999999999 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.060 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541348+0000", 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025277999999999998 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.541945+0000", 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059730099999999995 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.552388+0000", 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01044308 2024-09-10T15:27:11.061 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.558941+0000", 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065525849999999997 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559008+0000", 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7175000000000007e-05 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.559051+0000", 2024-09-10T15:27:11.062 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3611e-05 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1210 3.2b 3:d428ccbb:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 42.934848877999997, 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024418312000000001, 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.063 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1210 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099149+0000", 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.064 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.099151+0000", 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.43e-06 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.103964+0000", 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048127949999999999 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.065 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104006+0000", 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2391999999999997e-05 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104033+0000", 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.616e-05 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104145+0000", 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011285099999999999 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.066 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104365+0000", 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021917 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.104567+0000", 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020294399999999999 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.114085+0000", 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095177730000000002 2024-09-10T15:27:11.067 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123440+0000", 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009354757 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123510+0000", 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0127000000000001e-05 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123567+0000", 2024-09-10T15:27:11.068 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6913000000000002e-05 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1225 3.8 3:12daa5c3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 42.744501513000003, 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021292011, 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.069 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1225 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289496+0000", 2024-09-10T15:27:11.070 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.289499+0000", 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3129999999999999e-06 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294420+0000", 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049203329999999998 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.071 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294459+0000", 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9511999999999997e-05 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294478+0000", 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8369999999999999e-05 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.294642+0000", 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000164253 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.072 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295016+0000", 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000374201 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.295405+0000", 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038931099999999999 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.073 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.308446+0000", 2024-09-10T15:27:11.075 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013040754 2024-09-10T15:27:11.075 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.075 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310510+0000", 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020643010000000002 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310674+0000", 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016396299999999999 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.310788+0000", 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0001137 2024-09-10T15:27:11.076 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1230 3.7 3:e0a54a53:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 42.382039077000002, 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020686421, 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.077 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1230 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651959+0000", 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.078 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.651962+0000", 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9330000000000003e-06 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656858+0000", 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048953039999999996 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656897+0000", 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9345999999999999e-05 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.079 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.656915+0000", 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7836e-05 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657097+0000", 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018200200000000001 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657504+0000", 2024-09-10T15:27:11.080 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000407284 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.657936+0000", 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043207599999999999 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.667656+0000", 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097194099999999995 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.081 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672492+0000", 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048363399999999997 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672577+0000", 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4812e-05 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.672645+0000", 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8077999999999994e-05 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.082 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1365 3.8 3:122bd512:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.599046819000002, 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025243808999999999, 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.083 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1365 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434951+0000", 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.084 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.434955+0000", 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7139999999999999e-06 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443391+0000", 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0084368099999999994 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443430+0000", 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8189000000000003e-05 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.085 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443446+0000", 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6900000000000001e-05 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443570+0000", 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012320399999999999 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.443821+0000", 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025176099999999998 2024-09-10T15:27:11.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.444043+0000", 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022190900000000001 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.459249+0000", 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015206040000000001 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460027+0000", 2024-09-10T15:27:11.087 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00077740299999999997 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460123+0000", 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6053999999999999e-05 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.460195+0000", 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1824999999999998e-05 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.088 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1381 3.2b 3:d6ca9a27:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.080131262000002, 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.028008075, 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1381 2024-09-10T15:27:11.089 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953866+0000", 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.090 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.953870+0000", 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3569999999999998e-06 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957911+0000", 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040408420000000002 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957947+0000", 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6801999999999998e-05 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.091 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.957965+0000", 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7473e-05 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958102+0000", 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137181 2024-09-10T15:27:11.092 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958354+0000", 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025186400000000003 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.958590+0000", 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000236445 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.093 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.970044+0000", 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011453502000000001 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981461+0000", 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011417418 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981714+0000", 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000252434 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.094 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.981874+0000", 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016075700000000001 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1396 3.9 e64/23 3:90cc0258:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_17:head v 64'6, mlcod=63'4)", 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 38.821353002999999, 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.030549334000000001, 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.095 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.212645+0000", 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.39e-07 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217600+0000", 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049551860000000003 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217620+0000", 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9928e-05 2024-09-10T15:27:11.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217629+0000", 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2660000000000007e-06 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217770+0000", 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000140798 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.217836+0000", 2024-09-10T15:27:11.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6278000000000005e-05 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243052+0000", 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025215339 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243194+0000", 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014219999999999999 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1706 3.6 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.970571+0000", 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 29.063426955000001, 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.026298984000000001, 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1706 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.100 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.970571+0000", 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.970571+0000", 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.970574+0000", 2024-09-10T15:27:11.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.19e-06 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975170+0000", 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045957070000000001 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975203+0000", 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3787e-05 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975218+0000", 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4574e-05 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975316+0000", 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7853e-05 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975475+0000", 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015962999999999999 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975617+0000", 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014123799999999999 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996542+0000", 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020925500999999999 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996776+0000", 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023394099999999999 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996824+0000", 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7540999999999998e-05 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996870+0000", 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6022000000000001e-05 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1739 3.8 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.690022+0000", 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 28.343975138000001, 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024723485, 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1739 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.690022+0000", 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.690022+0000", 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.690025+0000", 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.413e-06 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.694091+0000", 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040665099999999997 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.694129+0000", 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7354999999999997e-05 2024-09-10T15:27:11.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.694145+0000", 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5812e-05 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.694274+0000", 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012948199999999999 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.694544+0000", 2024-09-10T15:27:11.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026977300000000001 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695419+0000", 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087558099999999995 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714492+0000", 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019073054999999998 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714519+0000", 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6880999999999999e-05 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714632+0000", 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011233 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714746+0000", 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000114293 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.111 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1856 3.2b 3:d7beb506:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.q4dNp615V0msh7O6KaCNYbZsIJ0dqrh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.132630+0000", 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.901367957000001, 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021904192999999999, 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1856 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.112 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.132630+0000", 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.132630+0000", 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.132633+0000", 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0400000000000001e-06 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.137905+0000", 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052718679999999999 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.137956+0000", 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1246999999999999e-05 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.137983+0000", 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7236000000000001e-05 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.138146+0000", 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016275999999999999 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.138441+0000", 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00029559699999999998 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.138743+0000", 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000301365 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.151181+0000", 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012438324000000001 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.154408+0000", 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003226956 2024-09-10T15:27:11.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.154476+0000", 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7984999999999994e-05 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.154534+0000", 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7815000000000001e-05 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1871 3.1b 3:daebf554:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.28:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.425346+0000", 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.608651473999998, 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022068098000000001, 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1871 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.425346+0000", 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.425346+0000", 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.425348+0000", 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5090000000000001e-06 2024-09-10T15:27:11.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.429236+0000", 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038886490000000001 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.429264+0000", 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7954e-05 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.429276+0000", 2024-09-10T15:27:11.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1664999999999999e-05 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.429358+0000", 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2391000000000004e-05 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.429497+0000", 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013873100000000001 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:11.121 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.429929+0000", 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00043234399999999998 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.436565+0000", 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0066356920000000003 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.447214+0000", 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010648691 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.447333+0000", 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011883300000000001 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.447414+0000", 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1638999999999995e-05 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1880 3.2 3:40052231:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.1kG3KnGCZRVVIQ5zk0X-8OWnmGbyQrd_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.706426+0000", 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.327572069999999, 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021795285000000001, 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.124 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1880 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.706426+0000", 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.706426+0000", 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.706430+0000", 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1400000000000002e-06 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.710325+0000", 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038950479999999999 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.710367+0000", 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2141000000000002e-05 2024-09-10T15:27:11.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.710388+0000", 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0951e-05 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.710491+0000", 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010323 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.710642+0000", 2024-09-10T15:27:11.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015053199999999999 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.710772+0000", 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013018799999999999 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.719058+0000", 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082863120000000005 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.728130+0000", 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0090720039999999998 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.728182+0000", 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1505999999999998e-05 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.728221+0000", 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9233000000000002e-05 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.129 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1908 3.2b 3:d5cca507:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.bEh9hCKsxr8uubu13gXHdP3NKsc9b___1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.132146+0000", 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.901851966999999, 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022158917, 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1908 2024-09-10T15:27:11.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.132146+0000", 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.132146+0000", 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.132149+0000", 2024-09-10T15:27:11.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3469999999999999e-06 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138371+0000", 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062216839999999999 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138429+0000", 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8628999999999997e-05 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138456+0000", 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6628999999999999e-05 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138614+0000", 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015785800000000001 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138876+0000", 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026252099999999999 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.133 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139092+0000", 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021537800000000001 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.152061+0000", 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012969235000000001 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.154131+0000", 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020703459999999998 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.154222+0000", 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.0575000000000006e-05 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.154305+0000", 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2714999999999997e-05 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.135 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1950 3.1b 3:d8404ec7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.aX3ScmQtlsv7Ha68SnKua0p3AUION0N_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.088628+0000", 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 23.94536913, 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.027730498999999999, 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1950 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.088628+0000", 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.088628+0000", 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.088632+0000", 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.32e-06 2024-09-10T15:27:11.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.094035+0000", 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054030320000000003 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.094078+0000", 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2815999999999998e-05 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.094105+0000", 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7206e-05 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.094250+0000", 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000145286 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.094507+0000", 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025664200000000001 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.094764+0000", 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000257519 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.110192+0000", 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015427778 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.116188+0000", 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005995579 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.116283+0000", 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5407000000000003e-05 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.116359+0000", 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5914000000000005e-05 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2076 3.6 3:61122a92:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.n7y5tEFqq1XVntSU_k4AvFKkfznZCR7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:49.720226+0000", 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.313771331000002, 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023307277000000001, 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2076 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.720226+0000", 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.720226+0000", 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.720229+0000", 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.999e-06 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.724789+0000", 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0045599669999999998 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.724826+0000", 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6301999999999999e-05 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.724843+0000", 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7563000000000001e-05 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.724990+0000", 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014734899999999999 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.725230+0000", 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023907600000000001 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.725445+0000", 2024-09-10T15:27:11.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021593099999999999 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.734013+0000", 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0085677740000000002 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.743233+0000", 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0092195479999999993 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.743399+0000", 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016630900000000001 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.743534+0000", 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013445899999999999 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2140 3.2 3:41e1aae4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.o5pR5N96QCi6URaV0uXzaZAiql4QK_j_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.117621+0000", 2024-09-10T15:27:11.147 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.916376824, 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029455483000000001, 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2140 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.117621+0000", 2024-09-10T15:27:11.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.117621+0000", 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.117624+0000", 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4970000000000001e-06 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.122795+0000", 2024-09-10T15:27:11.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051711159999999999 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.122839+0000", 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3615999999999997e-05 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.122861+0000", 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2469000000000001e-05 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.123019+0000", 2024-09-10T15:27:11.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000157186 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.123259+0000", 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000240327 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.123484+0000", 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00022484299999999999 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.141901+0000", 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018417369999999999 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.146905+0000", 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050033040000000001 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.147000+0000", 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5773999999999995e-05 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.147076+0000", 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5981000000000003e-05 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2149 3.2 3:419e75bc:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.71:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.309661+0000", 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.724336393000002, 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021597531, 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.153 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2149 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.309661+0000", 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.309661+0000", 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.309664+0000", 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3499999999999999e-06 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.314532+0000", 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048684710000000001 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.314568+0000", 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6239000000000003e-05 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.314584+0000", 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.579e-05 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.314775+0000", 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019074200000000001 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.315045+0000", 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000270275 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.315919+0000", 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000873773 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.330501+0000", 2024-09-10T15:27:11.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014582499000000001 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.330928+0000", 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042617799999999998 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.331140+0000", 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021245699999999999 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.331259+0000", 2024-09-10T15:27:11.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118757 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:11.159 INFO:teuthology.orchestra.run.smithi099.stderr:noscrub is unset 2024-09-10T15:27:11.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-10T15:27:11.161 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-10T15:27:11.290 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:11.290 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:11.290 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:27:11.290 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:11.304 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-10T15:27:11.428 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:11.428 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:11.428 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:27:11.428 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:27:11.428 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:11.442 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-10T15:27:11.566 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:11.566 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:27:11.566 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1187 3.29 3:951d489f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.325796707000002, 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020951549, 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1187 2024-09-10T15:27:11.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235750+0000", 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.568 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.235751+0000", 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9069999999999999e-06 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240509+0000", 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047577310000000003 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240531+0000", 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1963999999999998e-05 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.569 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240541+0000", 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5170000000000005e-06 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240612+0000", 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1637999999999994e-05 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240731+0000", 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118876 2024-09-10T15:27:11.570 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.240836+0000", 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104895 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.247085+0000", 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0062490289999999997 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256616+0000", 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095305279999999999 2024-09-10T15:27:11.571 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256662+0000", 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6362000000000001e-05 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.256701+0000", 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9101999999999999e-05 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.572 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1216 3.17 3:eac788d7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.376407833000002, 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024358715999999999, 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1216 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.573 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185138+0000", 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.185142+0000", 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7000000000000002e-06 2024-09-10T15:27:11.574 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189137+0000", 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039947480000000002 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189170+0000", 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3402999999999999e-05 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189188+0000", 2024-09-10T15:27:11.575 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7385999999999999e-05 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189357+0000", 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016903299999999999 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.189760+0000", 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00040378099999999998 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:11.576 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.190175+0000", 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041465300000000002 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.205685+0000", 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015510098 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209323+0000", 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0036379149999999998 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.577 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209424+0000", 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000101303 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.209497+0000", 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.2695999999999997e-05 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.578 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1222 3.23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.308204314999998, 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029186541999999999, 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1222 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.579 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253342+0000", 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.253345+0000", 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.954e-06 2024-09-10T15:27:11.580 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257398+0000", 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040527439999999996 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257431+0000", 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3513000000000003e-05 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.581 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257447+0000", 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6022e-05 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257579+0000", 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000132187 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.257866+0000", 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028712300000000002 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.582 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258110+0000", 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000243248 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.269782+0000", 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011672342 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282341+0000", 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012558613 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.583 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282439+0000", 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.8688000000000001e-05 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.282528+0000", 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9108000000000001e-05 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1242 3.38 3:1d12f6dd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.-lIqXSoAOPxT8wUFN2eMFqpyFBXrE3q_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:11.584 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 42.783271565, 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024298450999999999, 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1242 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.585 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778275+0000", 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.778277+0000", 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5639999999999999e-06 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.586 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783335+0000", 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050581660000000002 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783370+0000", 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5012999999999998e-05 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783400+0000", 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9142e-05 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.587 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783528+0000", 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012881700000000001 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.783864+0000", 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00033515200000000002 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.784288+0000", 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042494000000000001 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.588 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.798794+0000", 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014505980999999999 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802363+0000", 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035688579999999998 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802491+0000", 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012784299999999999 2024-09-10T15:27:11.589 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.802573+0000", 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.1975e-05 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1394 3.23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.368052329999998, 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.043242203, 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.590 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1394 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.591 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193494+0000", 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.193497+0000", 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1949999999999999e-06 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197756+0000", 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042592400000000001 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.592 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197790+0000", 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3831999999999997e-05 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197824+0000", 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3818e-05 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197899+0000", 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5414000000000007e-05 2024-09-10T15:27:11.593 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.197905+0000", 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.2750000000000003e-06 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.201937+0000", 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040326889999999999 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202120+0000", 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000182704 2024-09-10T15:27:11.594 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202312+0000", 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019223299999999999 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.228030+0000", 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025717357999999999 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236643+0000", 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086134929999999998 2024-09-10T15:27:11.595 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236699+0000", 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5407e-05 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236736+0000", 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7545000000000001e-05 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.596 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1395 3.18 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.359181681999999, 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033860491999999999, 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1395 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.597 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202365+0000", 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202366+0000", 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.725e-06 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.598 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208089+0000", 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0057225280000000002 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208111+0000", 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2663999999999998e-05 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208125+0000", 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3516000000000001e-05 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.599 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208199+0000", 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.3677000000000006e-05 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208309+0000", 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011049599999999999 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208403+0000", 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4056999999999997e-05 2024-09-10T15:27:11.600 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233736+0000", 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025333248999999999 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236043+0000", 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00230693 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.601 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236146+0000", 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102954 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236225+0000", 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8695999999999993e-05 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1403 3.1e 3:7aef99fe:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:27:11.602 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.219102878999998, 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021656937000000001, 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1403 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:27:11.603 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342443+0000", 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.342447+0000", 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5260000000000002e-06 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346589+0000", 2024-09-10T15:27:11.604 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041420600000000004 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346633+0000", 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3578999999999997e-05 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346652+0000", 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9177e-05 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.605 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.346780+0000", 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012826999999999999 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347012+0000", 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023154499999999999 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.347236+0000", 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000224429 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.606 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.353199+0000", 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0059633519999999999 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.363980+0000", 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010780811 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364047+0000", 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.6611000000000003e-05 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.607 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.364100+0000", 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3576999999999999e-05 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1865 3.17 3:e91fa98c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.27:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 26.274959803000002, 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022170427999999999, 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.608 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1865 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.609 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286586+0000", 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.286589+0000", 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0590000000000001e-06 2024-09-10T15:27:11.610 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291289+0000", 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047002529999999997 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291315+0000", 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5763e-05 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291325+0000", 2024-09-10T15:27:11.611 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0706999999999999e-05 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291419+0000", 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.344e-05 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.291619+0000", 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019992799999999999 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:11.612 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.292213+0000", 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00059466300000000005 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.300908+0000", 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086945549999999996 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308674+0000", 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007766032 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.613 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308722+0000", 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8576999999999999e-05 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.308757+0000", 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4450999999999999e-05 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1889 3.1e 3:7a0e2d59:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.870279+0000", 2024-09-10T15:27:11.614 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.691267453999998, 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021110397999999999, 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1889 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.870279+0000", 2024-09-10T15:27:11.615 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.870279+0000", 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.870281+0000", 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8929999999999999e-06 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.616 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874239+0000", 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039579649999999999 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874256+0000", 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7292e-05 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874267+0000", 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0730999999999999e-05 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.617 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874335+0000", 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8269999999999995e-05 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.874561+0000", 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000226498 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.875189+0000", 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00062743399999999996 2024-09-10T15:27:11.618 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.883989+0000", 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0087996770000000005 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.891277+0000", 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007288826 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.619 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.891344+0000", 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7065999999999998e-05 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.891389+0000", 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4746000000000002e-05 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1956 3.18 3:1875c112:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.qJG5m4HxH-FypGMc1JuFE5G9RkYfZL2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.219116+0000", 2024-09-10T15:27:11.620 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.342429886000001, 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.029217868000000001, 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1956 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.219116+0000", 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.219116+0000", 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.219119+0000", 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2299999999999998e-06 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.622 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227132+0000", 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0080133519999999996 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227175+0000", 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3065000000000002e-05 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227194+0000", 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8706e-05 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.623 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227334+0000", 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014008900000000001 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227585+0000", 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000251656 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.227817+0000", 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231917 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.624 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248070+0000", 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020252728000000001 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248114+0000", 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3511999999999999e-05 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248211+0000", 2024-09-10T15:27:11.625 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7046999999999994e-05 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.248334+0000", 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000123566 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1959 3.17 3:e832a3fd:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.251866+0000", 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.309679873, 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.026970971999999999, 2024-09-10T15:27:11.626 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1959 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.251866+0000", 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.627 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.251866+0000", 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.251870+0000", 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1439999999999999e-06 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256709+0000", 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048394789999999998 2024-09-10T15:27:11.628 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256748+0000", 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9079000000000003e-05 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256764+0000", 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5809999999999999e-05 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.256907+0000", 2024-09-10T15:27:11.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014260499999999999 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.257190+0000", 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028390199999999999 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.258092+0000", 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090200299999999996 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.273198+0000", 2024-09-10T15:27:11.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015105511 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.278554+0000", 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0053559740000000003 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.278692+0000", 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013803599999999999 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.278837+0000", 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014542900000000001 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2082 3.3e 3:7d6d706e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.NymUgmMVmvGPhKW_pcbEopy6XrcWod__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:49.844551+0000", 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.716995301000001, 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022070861000000001, 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.632 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2082 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.844551+0000", 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.844551+0000", 2024-09-10T15:27:11.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.844554+0000", 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6220000000000001e-06 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.848591+0000", 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040374199999999999 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.848639+0000", 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8318000000000001e-05 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.848665+0000", 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5525999999999999e-05 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.848852+0000", 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018668499999999999 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.849297+0000", 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00044545099999999997 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.849685+0000", 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00038829499999999998 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.859213+0000", 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0095278559999999995 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.636 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.866447+0000", 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072338560000000003 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.866557+0000", 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010980999999999999 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.866622+0000", 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5022000000000002e-05 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.637 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2091 3.0 3:0017f553:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.63:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.032945+0000", 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.528601066, 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.032329869999999997, 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.638 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2091 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.032945+0000", 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.032945+0000", 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.032948+0000", 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.19e-06 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.038331+0000", 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005382291 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.038381+0000", 2024-09-10T15:27:11.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0557999999999999e-05 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.038400+0000", 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8272999999999999e-05 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.038547+0000", 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000147396 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op must wait for map", 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.038559+0000", 2024-09-10T15:27:11.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2509e-05 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.043522+0000", 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0049625729999999996 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.043921+0000", 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039875199999999999 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.045109+0000", 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001188714 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.061722+0000", 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016612829999999999 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.065097+0000", 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0033743129999999999 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.065208+0000", 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011134 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.065275+0000", 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7131000000000005e-05 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.644 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2109 3.23 3:c4c10ed7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.66:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.505582+0000", 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.055963796, 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.027626133000000001, 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2109 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.505582+0000", 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.505582+0000", 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.505594+0000", 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1592e-05 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.510480+0000", 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004885988 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.510521+0000", 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1105e-05 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.510539+0000", 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8287e-05 2024-09-10T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.510714+0000", 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174768 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.511133+0000", 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00041903200000000001 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512304+0000", 2024-09-10T15:27:11.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001171121 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.525331+0000", 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013026352 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.533037+0000", 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077064380000000004 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.533101+0000", 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.3952e-05 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.533209+0000", 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010749800000000001 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2143 3.3d 3:bc0a781a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.70:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.151308+0000", 2024-09-10T15:27:11.650 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.410237916, 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025540771, 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2143 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.151308+0000", 2024-09-10T15:27:11.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.151308+0000", 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.151311+0000", 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6599999999999999e-06 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.159072+0000", 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077610049999999996 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.159111+0000", 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9232e-05 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.159129+0000", 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.766e-05 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.159247+0000", 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011848799999999999 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.159375+0000", 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012786699999999999 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 4", 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.160063+0000", 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00068783899999999999 2024-09-10T15:27:11.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.174210+0000", 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014147018000000001 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.176734+0000", 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002523918 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.176802+0000", 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7540999999999996e-05 2024-09-10T15:27:11.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.176849+0000", 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7543000000000002e-05 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2167 3.27 3:e6c4ba75:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.74:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.696821+0000", 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.86472573, 2024-09-10T15:27:11.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025332787999999998, 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2167 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.696821+0000", 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.696821+0000", 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.696823+0000", 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2900000000000001e-06 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.702303+0000", 2024-09-10T15:27:11.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054798920000000001 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.702344+0000", 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1771999999999999e-05 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.702364+0000", 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9766999999999999e-05 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.702554+0000", 2024-09-10T15:27:11.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000189691 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.702832+0000", 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027829900000000003 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.703709+0000", 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087692900000000003 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.715610+0000", 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011901237 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.721958+0000", 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063473640000000003 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.722078+0000", 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012066999999999999 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.722153+0000", 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.4876999999999995e-05 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2173 3.1e 3:7ae5a723:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.75:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.852670+0000", 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 19.708875829, 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024803341999999999, 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2173 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.852670+0000", 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.852670+0000", 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.852674+0000", 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3969999999999998e-06 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.858619+0000", 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005945278 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.858651+0000", 2024-09-10T15:27:11.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2252999999999998e-05 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.858671+0000", 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9755999999999999e-05 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.858815+0000", 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014383899999999999 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.859081+0000", 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026645599999999998 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.859955+0000", 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087358900000000003 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.871510+0000", 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011555246999999999 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.877276+0000", 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005766083 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.877398+0000", 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012197999999999999 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.877474+0000", 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5463999999999994e-05 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.667 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2293 3.1e 3:7a949137:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.1bTqHVrmmd_w3kQoTJi9J3tW_P5udL2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:54.536016+0000", 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.025529906999999, 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021020193999999999, 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2293 2024-09-10T15:27:11.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.536016+0000", 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.536016+0000", 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.536019+0000", 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4590000000000001e-06 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.539866+0000", 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0038474490000000002 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.539895+0000", 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9193e-05 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.539908+0000", 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2357999999999999e-05 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.540002+0000", 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4487000000000005e-05 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.540178+0000", 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017583200000000001 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.540330+0000", 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000151423 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.551787+0000", 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011457614 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.556947+0000", 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051600680000000003 2024-09-10T15:27:11.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.556996+0000", 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9237999999999999e-05 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.557037+0000", 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0073000000000001e-05 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2302 3.27 3:e5e963ff:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.96:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:54.716540+0000", 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.845006729000001, 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025210414, 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2302 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.674 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.716540+0000", 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.716540+0000", 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.716542+0000", 2024-09-10T15:27:11.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9569999999999998e-06 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.720659+0000", 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0041165439999999998 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.720699+0000", 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9826000000000001e-05 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.720724+0000", 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4935000000000001e-05 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.720831+0000", 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106789 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.721016+0000", 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018558499999999999 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.721625+0000", 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00060896300000000002 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.731036+0000", 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094107140000000006 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.741609+0000", 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010572796000000001 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.741693+0000", 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4456999999999995e-05 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:54.741750+0000", 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6848000000000002e-05 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2311 3.38 3:1f5d1b31:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.CbmyYpo0pl88KNJFZ0NLOldB0HRNzU2_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:11.679 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:55.006608+0000", 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 16.554938224000001, 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.030479824999999999, 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2311 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:11.680 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.006608+0000", 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.006608+0000", 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.006611+0000", 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.0019999999999998e-06 2024-09-10T15:27:11.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.011062+0000", 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044505070000000002 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.011097+0000", 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5394e-05 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:11.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.011111+0000", 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.4100000000000001e-05 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.011249+0000", 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137515 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.011509+0000", 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026056000000000001 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.011753+0000", 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024431300000000002 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.020442+0000", 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086889010000000006 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.036923+0000", 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016480992999999999 2024-09-10T15:27:11.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.037018+0000", 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4596e-05 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.037088+0000", 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.9944000000000007e-05 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:11.685 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:11.686 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:11.687 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-10T15:27:11.813 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:11.813 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:11.813 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:27:11.814 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:11.827 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-10T15:27:11.952 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:11.953 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:11.953 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:27:11.953 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:27:11.953 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:11.967 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-10T15:27:12.094 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:12.094 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:27:12.094 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:27:12.094 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1179 3.4 3:22f8fe6f:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 45.013764164999998, 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024535077999999998, 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1179 2024-09-10T15:27:12.095 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076244+0000", 2024-09-10T15:27:12.096 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.076248+0000", 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7299999999999999e-06 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081469+0000", 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005220995 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.097 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081508+0000", 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8949999999999998e-05 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081528+0000", 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9905e-05 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.098 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.081705+0000", 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017738000000000001 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082121+0000", 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000415523 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.099 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.082487+0000", 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000365972 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.100 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.099549+0000", 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017062172 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100609+0000", 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001059595 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100702+0000", 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2980999999999996e-05 2024-09-10T15:27:12.101 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.100780+0000", 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7874999999999996e-05 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1191 3.33 3:cc6a30e7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.jXouAQZEEbYTBcZwDO-ZGu8OjssF2v-_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.762632859, 2024-09-10T15:27:12.102 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019573034, 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1191 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327376+0000", 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.327378+0000", 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3319999999999999e-06 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331282+0000", 2024-09-10T15:27:12.104 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003903742 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331313+0000", 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.1319000000000003e-05 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331331+0000", 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8054e-05 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.105 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331409+0000", 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7335000000000004e-05 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331538+0000", 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012904100000000001 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.331648+0000", 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000110197 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.106 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.337762+0000", 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0061141720000000002 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346872+0000", 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091104380000000002 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346911+0000", 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8936000000000001e-05 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.107 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.346949+0000", 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7468000000000001e-05 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1207 3.25 3:a5dc18a4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.054059258000002, 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020455014000000001, 2024-09-10T15:27:12.108 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1207 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.109 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035949+0000", 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.035953+0000", 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.23e-06 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040560+0000", 2024-09-10T15:27:12.110 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0046073299999999998 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040588+0000", 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8082999999999999e-05 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.111 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040609+0000", 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1222000000000001e-05 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040687+0000", 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7764999999999998e-05 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040844+0000", 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015674600000000001 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.112 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.040952+0000", 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010846800000000001 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055660+0000", 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014707388 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056279+0000", 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00061911500000000005 2024-09-10T15:27:12.113 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056348+0000", 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8830000000000003e-05 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.056404+0000", 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6836999999999998e-05 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.114 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1208 3.24 3:2491b2b3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.034789719000003, 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023894849999999999, 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1208 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.115 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055219+0000", 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.116 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.055223+0000", 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8569999999999997e-06 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059216+0000", 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039934549999999999 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059250+0000", 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3572000000000003e-05 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.117 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059269+0000", 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9213000000000001e-05 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059403+0000", 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013446399999999999 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059690+0000", 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028604699999999999 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.118 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.059941+0000", 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025145700000000002 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.073449+0000", 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507816000000001 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.078921+0000", 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0054719670000000003 2024-09-10T15:27:12.119 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079030+0000", 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108844 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.079114+0000", 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.4158000000000003e-05 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.120 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1217 3.12 3:4a944d44:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 43.894246719000002, 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019853678999999999, 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1217 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.121 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195762+0000", 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.195765+0000", 2024-09-10T15:27:12.122 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2030000000000001e-06 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200571+0000", 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048055759999999998 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200612+0000", 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1306000000000001e-05 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.123 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200632+0000", 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9741999999999998e-05 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200745+0000", 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113677 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.200931+0000", 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000185608 2024-09-10T15:27:12.124 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.201084+0000", 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000152998 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.211882+0000", 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010798018 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.125 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215500+0000", 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003617683 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215562+0000", 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.2380999999999998e-05 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.215616+0000", 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3486999999999998e-05 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.126 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1353 3.4 3:22048f0e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.789824543999998, 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021998153999999999, 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.127 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1353 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300184+0000", 2024-09-10T15:27:12.128 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.300187+0000", 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6070000000000002e-06 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304918+0000", 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0047314799999999997 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.129 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304956+0000", 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8065999999999998e-05 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.304975+0000", 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9035999999999999e-05 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305152+0000", 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017649300000000001 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.130 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305440+0000", 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028828700000000003 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.305693+0000", 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025328500000000001 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.319201+0000", 2024-09-10T15:27:12.131 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013507483000000001 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322085+0000", 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.002883835 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322139+0000", 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4787999999999998e-05 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.132 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.322182+0000", 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2793999999999997e-05 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1367 3.20 e63/23 3:05e1d538:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_16:head v 63'4, mlcod=63'2)", 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.625623832999999, 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022460562, 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.133 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464385+0000", 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.134 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.464388+0000", 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9459999999999998e-06 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472298+0000", 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079100520000000007 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472339+0000", 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1455000000000002e-05 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.135 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472359+0000", 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.948e-05 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472496+0000", 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013682399999999999 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.472544+0000", 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8825000000000001e-05 2024-09-10T15:27:12.136 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486702+0000", 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014157639 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.486845+0000", 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014334100000000001 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.137 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1368 3.5 e63/23 3:a3ce251e:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_17:head v 63'4, mlcod=62'2)", 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.616573150000001, 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022562873000000001, 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.138 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473435+0000", 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.473437+0000", 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.857e-06 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478575+0000", 2024-09-10T15:27:12.139 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.005137155 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478597+0000", 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.2914000000000001e-05 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478610+0000", 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2833999999999999e-05 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.140 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478782+0000", 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017194000000000001 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.478850+0000", 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7911999999999996e-05 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495883+0000", 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017032876999999998 2024-09-10T15:27:12.141 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.495998+0000", 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011538400000000001 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1385 3.33 3:cf4e159c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.068404999000002, 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021757502000000001, 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.142 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1385 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.143 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021604+0000", 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.021607+0000", 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6169999999999998e-06 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026033+0000", 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0044258969999999998 2024-09-10T15:27:12.144 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026079+0000", 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6186000000000001e-05 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026107+0000", 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7682e-05 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026220+0000", 2024-09-10T15:27:12.145 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000113311 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026370+0000", 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014924299999999999 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.026504+0000", 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013433 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.146 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.035693+0000", 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0091886529999999998 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043274+0000", 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075810390000000004 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043322+0000", 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.8492999999999998e-05 2024-09-10T15:27:12.147 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.043361+0000", 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9051000000000003e-05 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1395 3.18 e64/23 3:1ac86bcf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_16:head v 64'3, mlcod=61'1)", 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.881374045999998, 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024848186000000001, 2024-09-10T15:27:12.148 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.149 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.208635+0000", 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.7899999999999998e-07 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210802+0000", 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0021670550000000002 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210827+0000", 2024-09-10T15:27:12.150 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4555000000000001e-05 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210840+0000", 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.3380000000000001e-05 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210920+0000", 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9815999999999996e-05 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.151 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.210947+0000", 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7152999999999999e-05 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233371+0000", 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0224239 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.233483+0000", 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000111748 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.152 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1398 3.33 3:cc5cceb3:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 39.852960877999998, 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020431820999999999, 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.153 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1398 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237048+0000", 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.154 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.237051+0000", 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.067e-06 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241376+0000", 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.004325176 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241414+0000", 2024-09-10T15:27:12.155 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8342e-05 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241433+0000", 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8647e-05 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241533+0000", 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.9728999999999993e-05 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.156 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241706+0000", 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000173654 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.241880+0000", 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000174072 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.249092+0000", 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0072112210000000003 2024-09-10T15:27:12.157 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257354+0000", 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082622070000000006 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257424+0000", 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0304999999999999e-05 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.257480+0000", 2024-09-10T15:27:12.158 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5401e-05 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1721 3.33 3:cfb68b2a:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 29.778343929999998, 2024-09-10T15:27:12.159 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020343915000000001, 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1721 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.160 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311665+0000", 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.311667+0000", 2024-09-10T15:27:12.161 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3910000000000001e-06 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316763+0000", 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0050959029999999997 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316790+0000", 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6727999999999999e-05 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.162 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316802+0000", 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2153999999999999e-05 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.316888+0000", 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.5977999999999996e-05 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317094+0000", 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00020637499999999999 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.163 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.317643+0000", 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00054915499999999996 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.329834+0000", 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.012190278000000001 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331874+0000", 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0020404440000000002 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.164 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.331950+0000", 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.5819e-05 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.332009+0000", 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.8690000000000002e-05 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1724 3.4 3:203b9278:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.U2tLU59DNduvi7Dw7_6LkcaIJjGttfg_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 29.655868515000002, 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021171696, 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1724 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.166 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434140+0000", 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.434143+0000", 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2370000000000001e-06 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.167 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439034+0000", 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048902920000000001 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439072+0000", 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8787e-05 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439092+0000", 2024-09-10T15:27:12.168 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.9108999999999999e-05 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439188+0000", 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6487e-05 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439322+0000", 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013430500000000001 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 5", 2024-09-10T15:27:12.169 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.439420+0000", 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7343000000000006e-05 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.447315+0000", 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.007895394 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455236+0000", 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079208339999999999 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.170 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455277+0000", 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.1248000000000002e-05 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.455312+0000", 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4659999999999997e-05 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1909 3.24 3:27a2e717:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.bEh9hCKsxr8uubu13gXHdP3NKsc9b___2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:12.171 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.953533076999999, 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020638806999999999, 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1909 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.172 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136476+0000", 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.136479+0000", 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9960000000000002e-06 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.173 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138833+0000", 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0023546610000000001 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138859+0000", 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5616999999999999e-05 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.138871+0000", 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1759999999999999e-05 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.174 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139035+0000", 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016393199999999999 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139394+0000", 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00035952599999999999 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.139610+0000", 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021574100000000001 2024-09-10T15:27:12.175 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.143897+0000", 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042874660000000002 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.156917+0000", 2024-09-10T15:27:12.176 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013019519 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157010+0000", 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.2857999999999998e-05 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.157114+0000", 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000104731 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.177 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1917 3.24 3:24837641:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.759143334000001, 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021840252000000001, 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1917 2024-09-10T15:27:12.178 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330865+0000", 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.179 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.330868+0000", 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5399999999999998e-06 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335714+0000", 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00484594 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.180 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335754+0000", 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0175000000000001e-05 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335780+0000", 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5678e-05 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.335921+0000", 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000141085 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.181 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.336222+0000", 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00030169300000000001 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.337135+0000", 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00091279700000000002 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352078+0000", 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.014942337 2024-09-10T15:27:12.182 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352534+0000", 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00045644199999999999 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352637+0000", 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000103398 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.352706+0000", 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.8167e-05 2024-09-10T15:27:12.183 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1929 3.24 3:259692f9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.36:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.499107813999998, 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019827279, 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1929 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590901+0000", 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.185 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.590905+0000", 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4700000000000004e-06 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597424+0000", 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065183810000000002 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.186 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597470+0000", 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6811000000000003e-05 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597491+0000", 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0044999999999999e-05 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.187 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597622+0000", 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000131834 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.597783+0000", 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016109100000000001 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.598360+0000", 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00057640399999999998 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.188 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.609671+0000", 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011310661 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610525+0000", 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00085494 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.189 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610650+0000", 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012418299999999999 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.610728+0000", 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.8459000000000002e-05 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1953 3.25 3:a444f990:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.40:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:27:12.190 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 24.969635705999998, 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021829541000000001, 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1953 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:27:12.191 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120373+0000", 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.120376+0000", 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3330000000000001e-06 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124380+0000", 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040035380000000001 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124417+0000", 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7492e-05 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124435+0000", 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8122999999999999e-05 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.193 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124627+0000", 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019198800000000001 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.124910+0000", 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000282198 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.125832+0000", 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00092200300000000002 2024-09-10T15:27:12.194 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.139934+0000", 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01410264 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.141879+0000", 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019445059999999999 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142069+0000", 2024-09-10T15:27:12.195 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018991799999999999 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:47.142202+0000", 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133802 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2085 3.25 3:a5fb1ce4:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:27:12.196 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.215392294000001, 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023491656999999999, 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2085 2024-09-10T15:27:12.197 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874616+0000", 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.198 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.874619+0000", 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5100000000000001e-06 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879012+0000", 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043931630000000003 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879049+0000", 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.7279e-05 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.199 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879067+0000", 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7447000000000001e-05 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879207+0000", 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014021899999999999 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.879489+0000", 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00028163800000000002 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.200 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 7", 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.880391+0000", 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00090249099999999995 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.894924+0000", 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01453337 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.897971+0000", 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0030460660000000001 2024-09-10T15:27:12.201 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898053+0000", 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.2109999999999998e-05 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:49.898108+0000", 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.5364000000000001e-05 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.202 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2170 3.24 3:247024a9:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.rHZkZz4cdFahl96W_VkSjihQDFVHwYr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.269854415000001, 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.028850750000000001, 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2170 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.203 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820154+0000", 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.820158+0000", 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.16e-06 2024-09-10T15:27:12.204 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826694+0000", 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065359559999999999 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826734+0000", 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9332000000000002e-05 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826752+0000", 2024-09-10T15:27:12.205 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8249000000000001e-05 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.826937+0000", 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018492500000000001 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.827362+0000", 2024-09-10T15:27:12.206 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00042493199999999999 2024-09-10T15:27:12.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.207 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.207 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.207 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.827789+0000", 2024-09-10T15:27:12.207 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000427601 2024-09-10T15:27:12.207 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.208 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.208 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.846915+0000", 2024-09-10T15:27:12.208 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019125362999999999 2024-09-10T15:27:12.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.208 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.209 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.848838+0000", 2024-09-10T15:27:12.209 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001923264 2024-09-10T15:27:12.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.209 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.209 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.848935+0000", 2024-09-10T15:27:12.210 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6840000000000001e-05 2024-09-10T15:27:12.210 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.210 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.210 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.210 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.849005+0000", 2024-09-10T15:27:12.211 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.0128000000000003e-05 2024-09-10T15:27:12.211 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.211 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.211 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.211 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.211 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.212 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2176 3.33 3:cc56d434:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.H48R23l9n0VubS_yIX4DYDGVDMz265g_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:12.212 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:27:12.212 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 20.130686779000001, 2024-09-10T15:27:12.212 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020038224, 2024-09-10T15:27:12.212 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.213 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.213 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.213 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.213 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.213 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.213 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2176 2024-09-10T15:27:12.214 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.214 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.214 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.214 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.214 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:27:12.214 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.215 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.215 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.215 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959322+0000", 2024-09-10T15:27:12.215 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.215 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.216 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.216 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.216 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.959325+0000", 2024-09-10T15:27:12.216 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8930000000000001e-06 2024-09-10T15:27:12.216 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.217 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.217 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.217 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963408+0000", 2024-09-10T15:27:12.217 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0040833370000000003 2024-09-10T15:27:12.217 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.218 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.218 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963447+0000", 2024-09-10T15:27:12.218 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8458999999999999e-05 2024-09-10T15:27:12.218 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.218 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.219 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963465+0000", 2024-09-10T15:27:12.219 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8236e-05 2024-09-10T15:27:12.219 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.219 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.219 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963624+0000", 2024-09-10T15:27:12.220 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015870899999999999 2024-09-10T15:27:12.220 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.220 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.220 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.220 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.963897+0000", 2024-09-10T15:27:12.221 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027347599999999998 2024-09-10T15:27:12.221 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.221 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.221 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 0", 2024-09-10T15:27:12.221 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.964130+0000", 2024-09-10T15:27:12.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023336299999999999 2024-09-10T15:27:12.222 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.222 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.222 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.222 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.973568+0000", 2024-09-10T15:27:12.222 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0094378980000000001 2024-09-10T15:27:12.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.223 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.223 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.223 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979097+0000", 2024-09-10T15:27:12.223 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055289939999999997 2024-09-10T15:27:12.223 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.224 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.224 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979245+0000", 2024-09-10T15:27:12.224 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014776599999999999 2024-09-10T15:27:12.224 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.224 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.225 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.225 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:51.979360+0000", 2024-09-10T15:27:12.225 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000115093 2024-09-10T15:27:12.225 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.225 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.226 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.226 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.226 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.226 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:12.229 INFO:teuthology.orchestra.run.smithi099.stderr:nodeep-scrub is unset 2024-09-10T15:27:12.230 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-10T15:27:12.361 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:12.361 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:12.362 INFO:teuthology.orchestra.run.smithi159.stdout: "num_ops": 0 2024-09-10T15:27:12.362 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:12.375 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-10T15:27:12.483 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-10T15:27:12.494 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:12.494 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [], 2024-09-10T15:27:12.494 INFO:teuthology.orchestra.run.smithi159.stdout: "complaint_time": 30, 2024-09-10T15:27:12.494 INFO:teuthology.orchestra.run.smithi159.stdout: "num_blocked_ops": 0 2024-09-10T15:27:12.494 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:12.509 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: "size": 20, 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 600, 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: "ops": [ 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1202 3.b 3:d04402da:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:27:12.628 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.683024070999998, 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017922151000000001, 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1202 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.629 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942866+0000", 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.630 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.942869+0000", 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1849999999999998e-06 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948456+0000", 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055870700000000004 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.631 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948483+0000", 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.6905000000000001e-05 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948495+0000", 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.2021000000000001e-05 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948566+0000", 2024-09-10T15:27:12.632 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.1848999999999996e-05 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948673+0000", 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000106551 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.948765+0000", 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.1953999999999994e-05 2024-09-10T15:27:12.633 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960149+0000", 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011383885 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960640+0000", 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00049126599999999997 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.634 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960721+0000", 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0929999999999999e-05 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:27.960789+0000", 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7534999999999996e-05 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.635 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1211 3.2e 3:776b69b5:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.502750468999999, 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018858949, 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.636 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1211 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123140+0000", 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.637 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.123142+0000", 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4700000000000001e-06 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126893+0000", 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003750448 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.638 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126917+0000", 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3654000000000001e-05 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126927+0000", 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0689e-05 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.126995+0000", 2024-09-10T15:27:12.639 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.7453999999999995e-05 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127130+0000", 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013563400000000001 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.127255+0000", 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012414500000000001 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.640 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.136367+0000", 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.009112719 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141908+0000", 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0055405070000000001 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.641 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141962+0000", 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4676999999999998e-05 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.141999+0000", 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6551999999999998e-05 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.642 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1213 3.2e 3:7619f1df:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.476926673999998, 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017861462000000002, 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1213 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.643 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148964+0000", 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.644 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.148966+0000", 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.402e-06 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152816+0000", 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003850053 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.645 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152842+0000", 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5942e-05 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152854+0000", 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.1979e-05 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.152944+0000", 2024-09-10T15:27:12.646 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9603000000000003e-05 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153182+0000", 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023856999999999999 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.153432+0000", 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025008099999999998 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.647 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.164719+0000", 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011286375 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166643+0000", 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001924425 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.648 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166746+0000", 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000102834 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.166825+0000", 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.9197999999999996e-05 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.649 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1222 3.23 e62/23 3:c75a8dd1:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.IP2otoSLkjSHkK6pQLZMogC_Pa8YJBF_21:head v 62'4, mlcod=62'2)", 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.367543421999997, 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023603988999999999, 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:27:12.650 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258347+0000", 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.258350+0000", 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.253e-06 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.651 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264709+0000", 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063588359999999997 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264761+0000", 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.1824999999999999e-05 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264790+0000", 2024-09-10T15:27:12.652 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8693000000000001e-05 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264923+0000", 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00013373700000000001 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.264956+0000", 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2712999999999997e-05 2024-09-10T15:27:12.653 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281781+0000", 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016824849999999999 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.281951+0000", 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000170082 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.654 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1227 3.2e 3:74b4de5c:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1_100Mb.4:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 44.311624428999998, 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021437382000000001, 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.655 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1227 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314266+0000", 2024-09-10T15:27:12.656 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.314269+0000", 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5160000000000001e-06 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319107+0000", 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048388099999999998 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.657 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319146+0000", 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8244999999999997e-05 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319163+0000", 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7669e-05 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319362+0000", 2024-09-10T15:27:12.658 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019828599999999999 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.319624+0000", 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00026238999999999999 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.320501+0000", 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00087716300000000003 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.659 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.334327+0000", 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013825519 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335445+0000", 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.001118403 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.660 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335602+0000", 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015689 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:28.335703+0000", 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010149099999999999 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.661 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1362 3.21 3:8654e189:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 41.225388631999998, 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025275790999999999, 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1362 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.662 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400502+0000", 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.663 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.400506+0000", 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8630000000000001e-06 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407050+0000", 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065442180000000001 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407094+0000", 2024-09-10T15:27:12.664 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.4128999999999997e-05 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407114+0000", 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0239999999999999e-05 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407264+0000", 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014978300000000001 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.665 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407522+0000", 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00025812799999999999 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 1", 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.407754+0000", 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000231408 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425209+0000", 2024-09-10T15:27:12.666 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017455704999999998 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425606+0000", 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00039643799999999999 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425700+0000", 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4550999999999996e-05 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.667 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.425778+0000", 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.7328000000000002e-05 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1364 3.2e 3:74a88fba:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.Enq0damSNBDj_2IR32QsSZH9Jr6yvci_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 41.201412738999998, 2024-09-10T15:27:12.668 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.021245188000000002, 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1364 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.669 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424478+0000", 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.424481+0000", 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2799999999999999e-06 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431005+0000", 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0065237109999999997 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431039+0000", 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4122999999999998e-05 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431055+0000", 2024-09-10T15:27:12.671 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6002999999999999e-05 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431222+0000", 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000167353 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431466+0000", 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00024418500000000001 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.672 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.431704+0000", 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00023773800000000001 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.441873+0000", 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010169203 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445388+0000", 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0035150200000000002 2024-09-10T15:27:12.673 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445563+0000", 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017495999999999999 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:31.445723+0000", 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000159612 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.674 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1394 3.23 e64/23 3:c4c17d82:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_15:head v 64'9, mlcod=63'7)", 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.422939370999998, 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.033497316999999999, 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:12.675 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.202951+0000", 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.03e-07 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.676 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204900+0000", 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0019484680000000001 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204922+0000", 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.177e-05 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.204932+0000", 2024-09-10T15:27:12.677 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0661e-05 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205051+0000", 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000118424 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.205093+0000", 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.2002000000000002e-05 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.678 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236392+0000", 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031299408000000001 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.236448+0000", 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.6381000000000001e-05 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.679 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1397 3.3 3:c21eb228:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.406074390999997, 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023917272, 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1397 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.680 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219816+0000", 2024-09-10T15:27:12.681 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.219818+0000", 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7549999999999999e-06 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223756+0000", 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0039381859999999998 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.682 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223779+0000", 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.3346e-05 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223790+0000", 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0878e-05 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.223891+0000", 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100423 2024-09-10T15:27:12.683 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224069+0000", 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017788600000000001 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.224251+0000", 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00018292199999999999 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.684 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.235405+0000", 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.011153272000000001 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243633+0000", 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0082285819999999999 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243680+0000", 2024-09-10T15:27:12.685 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6817000000000003e-05 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.243733+0000", 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.3205000000000003e-05 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1400 3.3 3:c1055cc2:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:27:12.686 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.367151634000003, 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.025198953999999999, 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1400 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.687 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258739+0000", 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.258742+0000", 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.3859999999999999e-06 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.688 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267076+0000", 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0083335460000000007 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267119+0000", 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.3198999999999998e-05 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.689 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267139+0000", 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.0169e-05 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267228+0000", 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.8922e-05 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.690 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267344+0000", 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011578099999999999 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.267440+0000", 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.5648000000000003e-05 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.277510+0000", 2024-09-10T15:27:12.691 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010070557000000001 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283858+0000", 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.006348256 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283906+0000", 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.7416000000000001e-05 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.692 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.283938+0000", 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2073999999999998e-05 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1401 3.3 3:c28cf7d6:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.1__shadow_.wk_Jc99VO40d_pT5Hs02iph0gzCF5-H_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 40.354996161999999, 2024-09-10T15:27:12.693 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024332115000000001, 2024-09-10T15:27:12.694 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.694 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.694 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.694 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.694 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1401 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.695 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.696 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.696 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270894+0000", 2024-09-10T15:27:12.696 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.696 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.696 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.270897+0000", 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5830000000000001e-06 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279567+0000", 2024-09-10T15:27:12.697 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0086698130000000002 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279602+0000", 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.5122e-05 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279620+0000", 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8389999999999998e-05 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.698 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279729+0000", 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000108448 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279836+0000", 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000107722 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 2", 2024-09-10T15:27:12.699 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.279931+0000", 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.4328999999999998e-05 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.287656+0000", 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0077257649999999999 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295164+0000", 2024-09-10T15:27:12.700 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075078779999999999 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295197+0000", 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.2818000000000003e-05 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:32.295226+0000", 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9247e-05 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.701 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1706 3.6 e67/23 3:6273ca84:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.WB8QMzzhSKV0bYAJVtsjAREbJ36RjdD_1:head v 67'2, mlcod=0'0)", 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 30.650076251000002, 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020756354000000001, 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.702 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975814+0000", 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.703 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.975816+0000", 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.012e-06 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979141+0000", 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003324741 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979158+0000", 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6875e-05 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.704 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979168+0000", 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0039e-05 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979270+0000", 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00010251600000000001 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.979305+0000", 2024-09-10T15:27:12.705 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4459000000000003e-05 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996490+0000", 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017184978 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:41.996571+0000", 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0734000000000003e-05 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.706 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1739 3.8 e67/23 3:10ecaead:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.6:head v 67'4, mlcod=63'2)", 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 29.930240322, 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.018473534, 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.707 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695650+0000", 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.695653+0000", 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.7039999999999999e-06 2024-09-10T15:27:12.708 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699886+0000", 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0042333459999999998 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699927+0000", 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0457999999999998e-05 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.709 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.699951+0000", 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.4754999999999999e-05 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700106+0000", 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015423699999999999 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.710 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.700152+0000", 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.6802999999999999e-05 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.713994+0000", 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.013841579 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:42.714124+0000", 2024-09-10T15:27:12.711 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00012965200000000001 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:1877 3.b 3:d2674995:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.29:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 27.056611198999999, 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.023807905000000001, 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.712 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 1877 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.713 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569279+0000", 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.569281+0000", 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.024e-06 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573676+0000", 2024-09-10T15:27:12.714 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0043950930000000001 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573702+0000", 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.5802000000000001e-05 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573713+0000", 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.0386e-05 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.715 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.573906+0000", 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000193742 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.574173+0000", 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000266884 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 6", 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.575041+0000", 2024-09-10T15:27:12.716 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00086814499999999996 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592140+0000", 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017098242 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592884+0000", 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00074462200000000001 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.717 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.592997+0000", 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00011323 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.593087+0000", 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.9734999999999994e-05 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.718 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1892 3.c e68/23 3:32bd59f8:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.XFEj1Lf2LReErfmIpb_5EeAot1azsNG_1:head v 68'8, mlcod=67'6)", 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 26.636733325000002, 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.024892474000000001, 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:27:12.719 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989157+0000", 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.989159+0000", 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.1100000000000001e-06 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.720 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994450+0000", 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0052911779999999997 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994487+0000", 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6563999999999998e-05 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.721 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994504+0000", 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.6906e-05 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994695+0000", 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00019078500000000001 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:45.994745+0000", 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.0583e-05 2024-09-10T15:27:12.722 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.013894+0000", 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.019148603 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.014050+0000", 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00015574499999999999 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.723 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:1947 3.c e69/23 3:307fcc0b:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.39:head v 69'9, mlcod=68'7)", 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 25.658604469, 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020674089999999999, 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.724 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967286+0000", 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.967287+0000", 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 5.4700000000000001e-07 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.725 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974827+0000", 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0075409240000000001 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974856+0000", 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.8119e-05 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.726 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974871+0000", 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.5189e-05 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.974968+0000", 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.7460999999999994e-05 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.975009+0000", 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.0268000000000001e-05 2024-09-10T15:27:12.727 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987873+0000", 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.01286399 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:46.987960+0000", 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.7591999999999998e-05 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.728 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2109 3.23 e70/23 3:c4c10ed7:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2_10Mb.66:head v 70'14, mlcod=67'12)", 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 22.113336273000002, 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.020231979000000001, 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.729 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512554+0000", 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.512557+0000", 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.576e-06 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517394+0000", 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0048370799999999997 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517433+0000", 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.8982e-05 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517451+0000", 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.7672999999999998e-05 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517620+0000", 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000169409 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.517685+0000", 2024-09-10T15:27:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5240999999999994e-05 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532706+0000", 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.015020436 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.532786+0000", 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 8.0581999999999995e-05 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_repop(client.4364.0:2112 3.c e70/23 3:31a137ce:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.nyUuPnH9KDWkv3uQ6KqA0veVrROsq16_1:head v 70'10, mlcod=68'8)", 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.975513525, 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.017546361, 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.734 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650377+0000", 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.650378+0000", 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 7.6700000000000003e-07 2024-09-10T15:27:12.735 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656693+0000", 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0063148220000000003 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656733+0000", 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9981999999999998e-05 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.736 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656751+0000", 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8853000000000001e-05 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656852+0000", 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000100608 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.656881+0000", 2024-09-10T15:27:12.737 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 2.9377999999999999e-05 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667779+0000", 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.010897232 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.667923+0000", 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00014471899999999999 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.738 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2118 3.3f 3:fd7c3aaf:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.6OutWCbOnJUoR6EgAd38lwPhVbxENPy_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e70)", 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 21.819782633999999, 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.031726504000000003, 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.739 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2118 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.740 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806108+0000", 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.806111+0000", 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.4570000000000001e-06 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.741 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811285+0000", 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0051735699999999997 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811321+0000", 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.6455000000000002e-05 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811340+0000", 2024-09-10T15:27:12.742 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8887000000000001e-05 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811478+0000", 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000137362 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811749+0000", 2024-09-10T15:27:12.743 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00027095 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.811968+0000", 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00021936699999999999 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.828291+0000", 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.016322691 2024-09-10T15:27:12.744 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837605+0000", 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0093144179999999997 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837701+0000", 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 9.6033999999999996e-05 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.745 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:50.837834+0000", 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.000133313 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "description": "osd_op(client.4364.0:2317 3.3f 3:fe380e92:::e428c525-ab2b-41e9-b3d6-fc86feb80f4f.4364.2__shadow_.TMyG-M8R-iMnSIXgNMZF9cDGYU85EU6_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "initiated_at": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "age": 17.471788349000001, 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.022281011999999999, 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "continuous": false, 2024-09-10T15:27:12.746 INFO:teuthology.orchestra.run.smithi159.stdout: "type_data": { 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "client_info": { 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "client": "client.4364", 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "client_addr": "172.21.15.99:0/1001329774", 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "tid": 2317 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "events": [ 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "initiated", 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.747 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "header_read", 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154102+0000", 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "throttled", 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.154107+0000", 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.5329999999999996e-06 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "all_read", 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162076+0000", 2024-09-10T15:27:12.748 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0079692389999999995 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "dispatched", 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162115+0000", 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 3.9569e-05 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "queued_for_pg", 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162134+0000", 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 1.8422000000000001e-05 2024-09-10T15:27:12.749 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "reached_pg", 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162310+0000", 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017659199999999999 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "started", 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162481+0000", 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00017045999999999999 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.750 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "waiting for subops from 3", 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.162645+0000", 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.00016447200000000001 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "op_commit", 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.172417+0000", 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.0097715030000000008 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "sub_op_commit_rec", 2024-09-10T15:27:12.751 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176269+0000", 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 0.003852014 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "commit_sent", 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176334+0000", 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 6.5055999999999995e-05 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "event": "done", 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "time": "2024-09-10T15:26:55.176383+0000", 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: "duration": 4.9152e-05 2024-09-10T15:27:12.752 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.753 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.753 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.753 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-09-10T15:27:12.753 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-09-10T15:27:12.753 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-09-10T15:27:12.754 INFO:teuthology.orchestra.run.smithi099.stdout:mon.a: {} 2024-09-10T15:27:12.754 INFO:teuthology.orchestra.run.smithi099.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T15:27:12.755 INFO:teuthology.orchestra.run.smithi099.stdout:mon.b: {} 2024-09-10T15:27:12.755 INFO:teuthology.orchestra.run.smithi099.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T15:27:12.755 INFO:teuthology.orchestra.run.smithi099.stdout:mon.c: {} 2024-09-10T15:27:12.756 INFO:teuthology.orchestra.run.smithi099.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-10T15:27:12.757 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-10T15:27:13.140 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.0 to 1 (10000) 2024-09-10T15:27:13.162 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-10T15:27:14.150 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-10T15:27:14.174 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-10T15:27:15.168 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.1 to 1 (10000) 2024-09-10T15:27:15.193 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-10T15:27:16.164 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-10T15:27:16.189 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-10T15:27:17.167 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.2 to 1 (10000) 2024-09-10T15:27:17.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-10T15:27:18.181 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-10T15:27:18.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-10T15:27:19.196 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.3 to 1 (10000) 2024-09-10T15:27:19.224 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-10T15:27:20.208 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-10T15:27:20.234 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-10T15:27:21.220 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.4 to 1 (10000) 2024-09-10T15:27:21.247 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-10T15:27:22.231 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-10T15:27:22.257 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-10T15:27:23.250 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.5 to 1 (10000) 2024-09-10T15:27:23.275 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-10T15:27:24.264 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-10T15:27:24.290 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-10T15:27:25.281 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.6 to 1 (10000) 2024-09-10T15:27:25.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-10T15:27:26.294 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-10T15:27:26.318 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-10T15:27:27.298 INFO:teuthology.orchestra.run.smithi099.stderr:reweighted osd.7 to 1 (10000) 2024-09-10T15:27:27.325 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-10T15:27:28.316 INFO:teuthology.orchestra.run.smithi099.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-10T15:27:28.342 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-10T15:27:28.342 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-10T15:27:28.342 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-10T15:27:28.342 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-10T15:27:28.342 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T15:27:28.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T15:27:28.634 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:27:28.634 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":94,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:27:28.305464+0000","last_up_change":"2024-09-10T15:24:57.289996+0000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T15:24:58.987011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T15:25:02.368798+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T15:25:10.252625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T15:25:12.200720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T15:25:14.120064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T15:25:15.995798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T15:25:17.927911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T15:25:20.055058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6809","nonce":2528983694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6811","nonce":2528983694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6815","nonce":2528983694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6813","nonce":2528983694}]},"public_addr":"172.21.15.99:6809/2528983694","cluster_addr":"172.21.15.99:6811/2528983694","heartbeat_back_addr":"172.21.15.99:6815/2528983694","heartbeat_front_addr":"172.21.15.99:6813/2528983694","state":["exists","up"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6801","nonce":3085897297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6803","nonce":3085897297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6807","nonce":3085897297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6805","nonce":3085897297}]},"public_addr":"172.21.15.99:6801/3085897297","cluster_addr":"172.21.15.99:6803/3085897297","heartbeat_back_addr":"172.21.15.99:6807/3085897297","heartbeat_front_addr":"172.21.15.99:6805/3085897297","state":["exists","up"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6817","nonce":4016938445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6819","nonce":4016938445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6823","nonce":4016938445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6821","nonce":4016938445}]},"public_addr":"172.21.15.99:6817/4016938445","cluster_addr":"172.21.15.99:6819/4016938445","heartbeat_back_addr":"172.21.15.99:6823/4016938445","heartbeat_front_addr":"172.21.15.99:6821/4016938445","state":["exists","up"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6825","nonce":1667351160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6827","nonce":1667351160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6831","nonce":1667351160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6829","nonce":1667351160}]},"public_addr":"172.21.15.99:6825/1667351160","cluster_addr":"172.21.15.99:6827/1667351160","heartbeat_back_addr":"172.21.15.99:6831/1667351160","heartbeat_front_addr":"172.21.15.99:6829/1667351160","state":["exists","up"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6825","nonce":1728711275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6827","nonce":1728711275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6831","nonce":1728711275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6829","nonce":1728711275}]},"public_addr":"172.21.15.159:6825/1728711275","cluster_addr":"172.21.15.159:6827/1728711275","heartbeat_back_addr":"172.21.15.159:6831/1728711275","heartbeat_front_addr":"172.21.15.159:6829/1728711275","state":["exists","up"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6801","nonce":1301853491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6803","nonce":1301853491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6807","nonce":1301853491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6805","nonce":1301853491}]},"public_addr":"172.21.15.159:6801/1301853491","cluster_addr":"172.21.15.159:6803/1301853491","heartbeat_back_addr":"172.21.15.159:6807/1301853491","heartbeat_front_addr":"172.21.15.159:6805/1301853491","state":["exists","up"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6817","nonce":1076897158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6819","nonce":1076897158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6823","nonce":1076897158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6821","nonce":1076897158}]},"public_addr":"172.21.15.159:6817/1076897158","cluster_addr":"172.21.15.159:6819/1076897158","heartbeat_back_addr":"172.21.15.159:6823/1076897158","heartbeat_front_addr":"172.21.15.159:6821/1076897158","state":["exists","up"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6809","nonce":989502281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6811","nonce":989502281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6815","nonce":989502281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6813","nonce":989502281}]},"public_addr":"172.21.15.159:6809/989502281","cluster_addr":"172.21.15.159:6811/989502281","heartbeat_back_addr":"172.21.15.159:6815/989502281","heartbeat_front_addr":"172.21.15.159:6813/989502281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.432506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.341537+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.717485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.180863+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.655023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.691365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:54.099394+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.913170+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.32","osds":[0,1]}],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:27:28.653 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T15:27:28.653 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T15:27:28.932 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:27:28.933 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":94,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:27:28.305464+0000","last_up_change":"2024-09-10T15:24:57.289996+0000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T15:24:58.987011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T15:25:02.368798+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T15:25:10.252625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T15:25:12.200720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T15:25:14.120064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T15:25:15.995798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T15:25:17.927911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T15:25:20.055058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6809","nonce":2528983694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6811","nonce":2528983694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6815","nonce":2528983694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6813","nonce":2528983694}]},"public_addr":"172.21.15.99:6809/2528983694","cluster_addr":"172.21.15.99:6811/2528983694","heartbeat_back_addr":"172.21.15.99:6815/2528983694","heartbeat_front_addr":"172.21.15.99:6813/2528983694","state":["exists","up"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6801","nonce":3085897297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6803","nonce":3085897297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6807","nonce":3085897297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6805","nonce":3085897297}]},"public_addr":"172.21.15.99:6801/3085897297","cluster_addr":"172.21.15.99:6803/3085897297","heartbeat_back_addr":"172.21.15.99:6807/3085897297","heartbeat_front_addr":"172.21.15.99:6805/3085897297","state":["exists","up"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6817","nonce":4016938445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6819","nonce":4016938445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6823","nonce":4016938445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6821","nonce":4016938445}]},"public_addr":"172.21.15.99:6817/4016938445","cluster_addr":"172.21.15.99:6819/4016938445","heartbeat_back_addr":"172.21.15.99:6823/4016938445","heartbeat_front_addr":"172.21.15.99:6821/4016938445","state":["exists","up"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6825","nonce":1667351160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6827","nonce":1667351160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6831","nonce":1667351160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6829","nonce":1667351160}]},"public_addr":"172.21.15.99:6825/1667351160","cluster_addr":"172.21.15.99:6827/1667351160","heartbeat_back_addr":"172.21.15.99:6831/1667351160","heartbeat_front_addr":"172.21.15.99:6829/1667351160","state":["exists","up"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6825","nonce":1728711275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6827","nonce":1728711275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6831","nonce":1728711275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6829","nonce":1728711275}]},"public_addr":"172.21.15.159:6825/1728711275","cluster_addr":"172.21.15.159:6827/1728711275","heartbeat_back_addr":"172.21.15.159:6831/1728711275","heartbeat_front_addr":"172.21.15.159:6829/1728711275","state":["exists","up"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6801","nonce":1301853491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6803","nonce":1301853491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6807","nonce":1301853491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6805","nonce":1301853491}]},"public_addr":"172.21.15.159:6801/1301853491","cluster_addr":"172.21.15.159:6803/1301853491","heartbeat_back_addr":"172.21.15.159:6807/1301853491","heartbeat_front_addr":"172.21.15.159:6805/1301853491","state":["exists","up"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6817","nonce":1076897158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6819","nonce":1076897158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6823","nonce":1076897158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6821","nonce":1076897158}]},"public_addr":"172.21.15.159:6817/1076897158","cluster_addr":"172.21.15.159:6819/1076897158","heartbeat_back_addr":"172.21.15.159:6823/1076897158","heartbeat_front_addr":"172.21.15.159:6821/1076897158","state":["exists","up"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6809","nonce":989502281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6811","nonce":989502281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6815","nonce":989502281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6813","nonce":989502281}]},"public_addr":"172.21.15.159:6809/989502281","cluster_addr":"172.21.15.159:6811/989502281","heartbeat_back_addr":"172.21.15.159:6815/989502281","heartbeat_front_addr":"172.21.15.159:6813/989502281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.432506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.341537+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.717485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.180863+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.655023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.691365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:54.099394+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.913170+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.32","osds":[0,1]}],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:27:28.951 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T15:27:28.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T15:27:28.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T15:27:28.952 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T15:27:28.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T15:27:28.953 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T15:27:28.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-10T15:27:28.954 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-10T15:27:29.208 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.208 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T15:27:29.215 INFO:teuthology.orchestra.run.smithi099.stdout:55834574884 2024-09-10T15:27:29.215 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T15:27:29.220 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:29.221 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T15:27:29.221 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.222 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T15:27:29.230 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:29.230 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T15:27:29.232 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.232 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T15:27:29.233 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:29.233 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T15:27:29.235 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:29.236 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T15:27:29.691 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:29.708 INFO:teuthology.orchestra.run.smithi099.stdout:55834574881 2024-09-10T15:27:29.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574884 got 55834574883 for osd.7 2024-09-10T15:27:29.735 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.1 2024-09-10T15:27:29.736 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.761 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.5 2024-09-10T15:27:29.763 INFO:teuthology.orchestra.run.smithi099.stdout:55834574881 2024-09-10T15:27:29.767 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.767 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.786 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.4 2024-09-10T15:27:29.789 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.2 2024-09-10T15:27:29.791 INFO:teuthology.orchestra.run.smithi099.stdout:55834574881 2024-09-10T15:27:29.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.0 2024-09-10T15:27:29.814 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.6 2024-09-10T15:27:29.820 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:29.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.3 2024-09-10T15:27:30.720 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T15:27:30.735 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T15:27:30.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T15:27:30.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T15:27:30.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T15:27:30.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T15:27:30.815 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T15:27:30.839 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T15:27:31.211 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:31.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574884 got 55834574883 for osd.7 2024-09-10T15:27:31.256 INFO:teuthology.orchestra.run.smithi099.stdout:55834574881 2024-09-10T15:27:31.278 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:31.282 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.1 2024-09-10T15:27:31.304 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.5 2024-09-10T15:27:31.312 INFO:teuthology.orchestra.run.smithi099.stdout:55834574881 2024-09-10T15:27:31.318 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:31.324 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:31.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574881 for osd.6 2024-09-10T15:27:31.341 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:31.347 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.2 2024-09-10T15:27:31.351 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574882 for osd.0 2024-09-10T15:27:31.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.4 2024-09-10T15:27:31.361 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:31.375 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:31.392 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574883 for osd.3 2024-09-10T15:27:31.392 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.235 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-10T15:27:32.283 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T15:27:32.304 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T15:27:32.342 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-10T15:27:32.348 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T15:27:32.352 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T15:27:32.581 INFO:teuthology.orchestra.run.smithi099.stdout:55834574884 2024-09-10T15:27:32.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574884 got 55834574884 for osd.7 2024-09-10T15:27:32.599 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.678 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:32.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574883 for osd.5 2024-09-10T15:27:32.696 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.749 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:32.769 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.1 2024-09-10T15:27:32.770 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.808 INFO:teuthology.orchestra.run.smithi099.stdout:55834574882 2024-09-10T15:27:32.819 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:32.827 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574882 got 55834574882 for osd.6 2024-09-10T15:27:32.827 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.829 INFO:teuthology.orchestra.run.smithi099.stdout:55834574883 2024-09-10T15:27:32.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574883 for osd.2 2024-09-10T15:27:32.838 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.848 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574883 got 55834574883 for osd.0 2024-09-10T15:27:32.848 DEBUG:teuthology.parallel:result is None 2024-09-10T15:27:32.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-10T15:27:32.848 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:27:33.211 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:27:33.217 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:27:33.234 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-10T15:27:32.968055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609477,"num_objects":639,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":639,"num_whiteouts":0,"num_read":3875,"num_read_kb":2050994,"num_write":3330,"num_write_kb":2051084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1981,"ondisk_log_size":1981,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3454856,"kb_used_data":3205312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751519864,"statfs":{"total":773094113280,"available":769556340736,"internally_reserved":0,"allocated":3282239488,"data_stored":3277926980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.672337"},"pg_stats":[{"pgid":"3.3f","version":"76'7","reported_seq":109,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492506+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:28.492506+0000","last_peered":"2024-09-10T15:27:28.492506+0000","last_clean":"2024-09-10T15:27:28.492506+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:28.492506+0000","last_undegraded":"2024-09-10T15:27:28.492506+0000","last_fullsized":"2024-09-10T15:27:28.492506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:35.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947344+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:28.947344+0000","last_peered":"2024-09-10T15:27:28.947344+0000","last_clean":"2024-09-10T15:27:28.947344+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:28.947344+0000","last_undegraded":"2024-09-10T15:27:28.947344+0000","last_fullsized":"2024-09-10T15:27:28.947344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696971+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:27:28.696971+0000","last_peered":"2024-09-10T15:27:28.696971+0000","last_clean":"2024-09-10T15:27:28.696971+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:27:28.696971+0000","last_undegraded":"2024-09-10T15:27:28.696971+0000","last_fullsized":"2024-09-10T15:27:28.696971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415197+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:28.415197+0000","last_peered":"2024-09-10T15:27:28.415197+0000","last_clean":"2024-09-10T15:27:28.415197+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:28.415197+0000","last_undegraded":"2024-09-10T15:27:28.415197+0000","last_fullsized":"2024-09-10T15:27:28.415197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"76'16","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693506+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:28.693506+0000","last_peered":"2024-09-10T15:27:28.693506+0000","last_clean":"2024-09-10T15:27:28.693506+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:28.693506+0000","last_undegraded":"2024-09-10T15:27:28.693506+0000","last_fullsized":"2024-09-10T15:27:28.693506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415200+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:27:28.415200+0000","last_peered":"2024-09-10T15:27:28.415200+0000","last_clean":"2024-09-10T15:27:28.415200+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:27:28.415200+0000","last_undegraded":"2024-09-10T15:27:28.415200+0000","last_fullsized":"2024-09-10T15:27:28.415200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"71'2","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315609+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:27:28.315609+0000","last_peered":"2024-09-10T15:27:28.315609+0000","last_clean":"2024-09-10T15:27:28.315609+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:27:28.315609+0000","last_undegraded":"2024-09-10T15:27:28.315609+0000","last_fullsized":"2024-09-10T15:27:28.315609+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'15","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314458+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:27:28.314458+0000","last_peered":"2024-09-10T15:27:28.314458+0000","last_clean":"2024-09-10T15:27:28.314458+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:27:28.314458+0000","last_undegraded":"2024-09-10T15:27:28.314458+0000","last_fullsized":"2024-09-10T15:27:28.314458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":45074,"num_write":45,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314283+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:27:28.314283+0000","last_peered":"2024-09-10T15:27:28.314283+0000","last_clean":"2024-09-10T15:27:28.314283+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:27:28.314283+0000","last_undegraded":"2024-09-10T15:27:28.314283+0000","last_fullsized":"2024-09-10T15:27:28.314283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"76'12","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339817+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:27:28.339817+0000","last_peered":"2024-09-10T15:27:28.339817+0000","last_clean":"2024-09-10T15:27:28.339817+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:27:28.339817+0000","last_undegraded":"2024-09-10T15:27:28.339817+0000","last_fullsized":"2024-09-10T15:27:28.339817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315735+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:27:28.315735+0000","last_peered":"2024-09-10T15:27:28.315735+0000","last_clean":"2024-09-10T15:27:28.315735+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:27:28.315735+0000","last_undegraded":"2024-09-10T15:27:28.315735+0000","last_fullsized":"2024-09-10T15:27:28.315735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314686+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:27:28.314686+0000","last_peered":"2024-09-10T15:27:28.314686+0000","last_clean":"2024-09-10T15:27:28.314686+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:27:28.314686+0000","last_undegraded":"2024-09-10T15:27:28.314686+0000","last_fullsized":"2024-09-10T15:27:28.314686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341680+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:27:28.341680+0000","last_peered":"2024-09-10T15:27:28.341680+0000","last_clean":"2024-09-10T15:27:28.341680+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:27:28.341680+0000","last_undegraded":"2024-09-10T15:27:28.341680+0000","last_fullsized":"2024-09-10T15:27:28.341680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"76'12","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693194+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:28.693194+0000","last_peered":"2024-09-10T15:27:28.693194+0000","last_clean":"2024-09-10T15:27:28.693194+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:28.693194+0000","last_undegraded":"2024-09-10T15:27:28.693194+0000","last_fullsized":"2024-09-10T15:27:28.693194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697665+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:27:28.697665+0000","last_peered":"2024-09-10T15:27:28.697665+0000","last_clean":"2024-09-10T15:27:28.697665+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:27:28.697665+0000","last_undegraded":"2024-09-10T15:27:28.697665+0000","last_fullsized":"2024-09-10T15:27:28.697665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415014+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:28.415014+0000","last_peered":"2024-09-10T15:27:28.415014+0000","last_clean":"2024-09-10T15:27:28.415014+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:28.415014+0000","last_undegraded":"2024-09-10T15:27:28.415014+0000","last_fullsized":"2024-09-10T15:27:28.415014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'10","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948574+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:27:28.948574+0000","last_peered":"2024-09-10T15:27:28.948574+0000","last_clean":"2024-09-10T15:27:28.948574+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:27:28.948574+0000","last_undegraded":"2024-09-10T15:27:28.948574+0000","last_fullsized":"2024-09-10T15:27:28.948574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314356+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:27:28.314356+0000","last_peered":"2024-09-10T15:27:28.314356+0000","last_clean":"2024-09-10T15:27:28.314356+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:27:28.314356+0000","last_undegraded":"2024-09-10T15:27:28.314356+0000","last_fullsized":"2024-09-10T15:27:28.314356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315753+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:27:28.315753+0000","last_peered":"2024-09-10T15:27:28.315753+0000","last_clean":"2024-09-10T15:27:28.315753+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:27:28.315753+0000","last_undegraded":"2024-09-10T15:27:28.315753+0000","last_fullsized":"2024-09-10T15:27:28.315753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948004+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:27:28.948004+0000","last_peered":"2024-09-10T15:27:28.948004+0000","last_clean":"2024-09-10T15:27:28.948004+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:27:28.948004+0000","last_undegraded":"2024-09-10T15:27:28.948004+0000","last_fullsized":"2024-09-10T15:27:28.948004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"70'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316138+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:27:28.316138+0000","last_peered":"2024-09-10T15:27:28.316138+0000","last_clean":"2024-09-10T15:27:28.316138+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:27:28.316138+0000","last_undegraded":"2024-09-10T15:27:28.316138+0000","last_fullsized":"2024-09-10T15:27:28.316138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":34816,"num_write":10,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333287+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:27:28.333287+0000","last_peered":"2024-09-10T15:27:28.333287+0000","last_clean":"2024-09-10T15:27:28.333287+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:27:28.333287+0000","last_undegraded":"2024-09-10T15:27:28.333287+0000","last_fullsized":"2024-09-10T15:27:28.333287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314957+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:27:28.314957+0000","last_peered":"2024-09-10T15:27:28.314957+0000","last_clean":"2024-09-10T15:27:28.314957+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:27:28.314957+0000","last_undegraded":"2024-09-10T15:27:28.314957+0000","last_fullsized":"2024-09-10T15:27:28.314957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695584+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:27:28.695584+0000","last_peered":"2024-09-10T15:27:28.695584+0000","last_clean":"2024-09-10T15:27:28.695584+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:27:28.695584+0000","last_undegraded":"2024-09-10T15:27:28.695584+0000","last_fullsized":"2024-09-10T15:27:28.695584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331238+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:27:28.331238+0000","last_peered":"2024-09-10T15:27:28.331238+0000","last_clean":"2024-09-10T15:27:28.331238+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:27:28.331238+0000","last_undegraded":"2024-09-10T15:27:28.331238+0000","last_fullsized":"2024-09-10T15:27:28.331238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948009+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:28.948009+0000","last_peered":"2024-09-10T15:27:28.948009+0000","last_clean":"2024-09-10T15:27:28.948009+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:28.948009+0000","last_undegraded":"2024-09-10T15:27:28.948009+0000","last_fullsized":"2024-09-10T15:27:28.948009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"76'12","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313280+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:27:28.313280+0000","last_peered":"2024-09-10T15:27:28.313280+0000","last_clean":"2024-09-10T15:27:28.313280+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:27:28.313280+0000","last_undegraded":"2024-09-10T15:27:28.313280+0000","last_fullsized":"2024-09-10T15:27:28.313280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:57.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312903+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:28.312903+0000","last_peered":"2024-09-10T15:27:28.312903+0000","last_clean":"2024-09-10T15:27:28.312903+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:28.312903+0000","last_undegraded":"2024-09-10T15:27:28.312903+0000","last_fullsized":"2024-09-10T15:27:28.312903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333674+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:27:28.333674+0000","last_peered":"2024-09-10T15:27:28.333674+0000","last_clean":"2024-09-10T15:27:28.333674+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:27:28.333674+0000","last_undegraded":"2024-09-10T15:27:28.333674+0000","last_fullsized":"2024-09-10T15:27:28.333674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414255+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:28.414255+0000","last_peered":"2024-09-10T15:27:28.414255+0000","last_clean":"2024-09-10T15:27:28.414255+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:28.414255+0000","last_undegraded":"2024-09-10T15:27:28.414255+0000","last_fullsized":"2024-09-10T15:27:28.414255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416647+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:27:28.416647+0000","last_peered":"2024-09-10T15:27:28.416647+0000","last_clean":"2024-09-10T15:27:28.416647+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:27:28.416647+0000","last_undegraded":"2024-09-10T15:27:28.416647+0000","last_fullsized":"2024-09-10T15:27:28.416647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"76'19","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315306+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:27:28.315306+0000","last_peered":"2024-09-10T15:27:28.315306+0000","last_clean":"2024-09-10T15:27:28.315306+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:27:28.315306+0000","last_undegraded":"2024-09-10T15:27:28.315306+0000","last_fullsized":"2024-09-10T15:27:28.315306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":48,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948263+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:28.948263+0000","last_peered":"2024-09-10T15:27:28.948263+0000","last_clean":"2024-09-10T15:27:28.948263+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:28.948263+0000","last_undegraded":"2024-09-10T15:27:28.948263+0000","last_fullsized":"2024-09-10T15:27:28.948263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947099+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:28.947099+0000","last_peered":"2024-09-10T15:27:28.947099+0000","last_clean":"2024-09-10T15:27:28.947099+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:28.947099+0000","last_undegraded":"2024-09-10T15:27:28.947099+0000","last_fullsized":"2024-09-10T15:27:28.947099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416300+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:28.416300+0000","last_peered":"2024-09-10T15:27:28.416300+0000","last_clean":"2024-09-10T15:27:28.416300+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:28.416300+0000","last_undegraded":"2024-09-10T15:27:28.416300+0000","last_fullsized":"2024-09-10T15:27:28.416300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332989+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:27:28.332989+0000","last_peered":"2024-09-10T15:27:28.332989+0000","last_clean":"2024-09-10T15:27:28.332989+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:27:28.332989+0000","last_undegraded":"2024-09-10T15:27:28.332989+0000","last_fullsized":"2024-09-10T15:27:28.332989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314591+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:27:28.314591+0000","last_peered":"2024-09-10T15:27:28.314591+0000","last_clean":"2024-09-10T15:27:28.314591+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:27:28.314591+0000","last_undegraded":"2024-09-10T15:27:28.314591+0000","last_fullsized":"2024-09-10T15:27:28.314591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948326+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:27:28.948326+0000","last_peered":"2024-09-10T15:27:28.948326+0000","last_clean":"2024-09-10T15:27:28.948326+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:27:28.948326+0000","last_undegraded":"2024-09-10T15:27:28.948326+0000","last_fullsized":"2024-09-10T15:27:28.948326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948156+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:28.948156+0000","last_peered":"2024-09-10T15:27:28.948156+0000","last_clean":"2024-09-10T15:27:28.948156+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:28.948156+0000","last_undegraded":"2024-09-10T15:27:28.948156+0000","last_fullsized":"2024-09-10T15:27:28.948156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331643+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:28.331643+0000","last_peered":"2024-09-10T15:27:28.331643+0000","last_clean":"2024-09-10T15:27:28.331643+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:28.331643+0000","last_undegraded":"2024-09-10T15:27:28.331643+0000","last_fullsized":"2024-09-10T15:27:28.331643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696783+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:27:28.696783+0000","last_peered":"2024-09-10T15:27:28.696783+0000","last_clean":"2024-09-10T15:27:28.696783+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:27:28.696783+0000","last_undegraded":"2024-09-10T15:27:28.696783+0000","last_fullsized":"2024-09-10T15:27:28.696783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415343+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:28.415343+0000","last_peered":"2024-09-10T15:27:28.415343+0000","last_clean":"2024-09-10T15:27:28.415343+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:28.415343+0000","last_undegraded":"2024-09-10T15:27:28.415343+0000","last_fullsized":"2024-09-10T15:27:28.415343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315663+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:28.315663+0000","last_peered":"2024-09-10T15:27:28.315663+0000","last_clean":"2024-09-10T15:27:28.315663+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:28.315663+0000","last_undegraded":"2024-09-10T15:27:28.315663+0000","last_fullsized":"2024-09-10T15:27:28.315663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314318+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:28.314318+0000","last_peered":"2024-09-10T15:27:28.314318+0000","last_clean":"2024-09-10T15:27:28.314318+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:28.314318+0000","last_undegraded":"2024-09-10T15:27:28.314318+0000","last_fullsized":"2024-09-10T15:27:28.314318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"76'14","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416702+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:27:28.416702+0000","last_peered":"2024-09-10T15:27:28.416702+0000","last_clean":"2024-09-10T15:27:28.416702+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:27:28.416702+0000","last_undegraded":"2024-09-10T15:27:28.416702+0000","last_fullsized":"2024-09-10T15:27:28.416702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340580+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:28.340580+0000","last_peered":"2024-09-10T15:27:28.340580+0000","last_clean":"2024-09-10T15:27:28.340580+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:28.340580+0000","last_undegraded":"2024-09-10T15:27:28.340580+0000","last_fullsized":"2024-09-10T15:27:28.340580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696860+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:27:28.696860+0000","last_peered":"2024-09-10T15:27:28.696860+0000","last_clean":"2024-09-10T15:27:28.696860+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:27:28.696860+0000","last_undegraded":"2024-09-10T15:27:28.696860+0000","last_fullsized":"2024-09-10T15:27:28.696860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"76'8","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947752+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:28.947752+0000","last_peered":"2024-09-10T15:27:28.947752+0000","last_clean":"2024-09-10T15:27:28.947752+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:28.947752+0000","last_undegraded":"2024-09-10T15:27:28.947752+0000","last_fullsized":"2024-09-10T15:27:28.947752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20492,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416251+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:27:28.416251+0000","last_peered":"2024-09-10T15:27:28.416251+0000","last_clean":"2024-09-10T15:27:28.416251+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:27:28.416251+0000","last_undegraded":"2024-09-10T15:27:28.416251+0000","last_fullsized":"2024-09-10T15:27:28.416251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"76'18","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341390+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:27:28.341390+0000","last_peered":"2024-09-10T15:27:28.341390+0000","last_clean":"2024-09-10T15:27:28.341390+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:27:28.341390+0000","last_undegraded":"2024-09-10T15:27:28.341390+0000","last_fullsized":"2024-09-10T15:27:28.341390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":43,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"76'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693890+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:27:28.693890+0000","last_peered":"2024-09-10T15:27:28.693890+0000","last_clean":"2024-09-10T15:27:28.693890+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:27:28.693890+0000","last_undegraded":"2024-09-10T15:27:28.693890+0000","last_fullsized":"2024-09-10T15:27:28.693890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415061+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415061+0000","last_peered":"2024-09-10T15:27:28.415061+0000","last_clean":"2024-09-10T15:27:28.415061+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415061+0000","last_undegraded":"2024-09-10T15:27:28.415061+0000","last_fullsized":"2024-09-10T15:27:28.415061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"76'7","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316110+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:27:28.316110+0000","last_peered":"2024-09-10T15:27:28.316110+0000","last_clean":"2024-09-10T15:27:28.316110+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:27:28.316110+0000","last_undegraded":"2024-09-10T15:27:28.316110+0000","last_fullsized":"2024-09-10T15:27:28.316110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":27,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947301+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:27:28.947301+0000","last_peered":"2024-09-10T15:27:28.947301+0000","last_clean":"2024-09-10T15:27:28.947301+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:27:28.947301+0000","last_undegraded":"2024-09-10T15:27:28.947301+0000","last_fullsized":"2024-09-10T15:27:28.947301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313995+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:28.313995+0000","last_peered":"2024-09-10T15:27:28.313995+0000","last_clean":"2024-09-10T15:27:28.313995+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:28.313995+0000","last_undegraded":"2024-09-10T15:27:28.313995+0000","last_fullsized":"2024-09-10T15:27:28.313995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332881+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:28.332881+0000","last_peered":"2024-09-10T15:27:28.332881+0000","last_clean":"2024-09-10T15:27:28.332881+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:28.332881+0000","last_undegraded":"2024-09-10T15:27:28.332881+0000","last_fullsized":"2024-09-10T15:27:28.332881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341427+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341427+0000","last_peered":"2024-09-10T15:27:28.341427+0000","last_clean":"2024-09-10T15:27:28.341427+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341427+0000","last_undegraded":"2024-09-10T15:27:28.341427+0000","last_fullsized":"2024-09-10T15:27:28.341427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947386+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:27:28.947386+0000","last_peered":"2024-09-10T15:27:28.947386+0000","last_clean":"2024-09-10T15:27:28.947386+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:27:28.947386+0000","last_undegraded":"2024-09-10T15:27:28.947386+0000","last_fullsized":"2024-09-10T15:27:28.947386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339988+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:27:28.339988+0000","last_peered":"2024-09-10T15:27:28.339988+0000","last_clean":"2024-09-10T15:27:28.339988+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:27:28.339988+0000","last_undegraded":"2024-09-10T15:27:28.339988+0000","last_fullsized":"2024-09-10T15:27:28.339988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":32786,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331759+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:27:28.331759+0000","last_peered":"2024-09-10T15:27:28.331759+0000","last_clean":"2024-09-10T15:27:28.331759+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:27:28.331759+0000","last_undegraded":"2024-09-10T15:27:28.331759+0000","last_fullsized":"2024-09-10T15:27:28.331759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314343+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:27:28.314343+0000","last_peered":"2024-09-10T15:27:28.314343+0000","last_clean":"2024-09-10T15:27:28.314343+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:27:28.314343+0000","last_undegraded":"2024-09-10T15:27:28.314343+0000","last_fullsized":"2024-09-10T15:27:28.314343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313427+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:28.313427+0000","last_peered":"2024-09-10T15:27:28.313427+0000","last_clean":"2024-09-10T15:27:28.313427+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:28.313427+0000","last_undegraded":"2024-09-10T15:27:28.313427+0000","last_fullsized":"2024-09-10T15:27:28.313427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947771+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947771+0000","last_peered":"2024-09-10T15:27:28.947771+0000","last_clean":"2024-09-10T15:27:28.947771+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947771+0000","last_undegraded":"2024-09-10T15:27:28.947771+0000","last_fullsized":"2024-09-10T15:27:28.947771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340664+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:27:28.340664+0000","last_peered":"2024-09-10T15:27:28.340664+0000","last_clean":"2024-09-10T15:27:28.340664+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:27:28.340664+0000","last_undegraded":"2024-09-10T15:27:28.340664+0000","last_fullsized":"2024-09-10T15:27:28.340664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"69'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416098+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:28.416098+0000","last_peered":"2024-09-10T15:27:28.416098+0000","last_clean":"2024-09-10T15:27:28.416098+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:28.416098+0000","last_undegraded":"2024-09-10T15:27:28.416098+0000","last_fullsized":"2024-09-10T15:27:28.416098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695255+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:28.695255+0000","last_peered":"2024-09-10T15:27:28.695255+0000","last_clean":"2024-09-10T15:27:28.695255+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:28.695255+0000","last_undegraded":"2024-09-10T15:27:28.695255+0000","last_fullsized":"2024-09-10T15:27:28.695255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414864+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:27:28.414864+0000","last_peered":"2024-09-10T15:27:28.414864+0000","last_clean":"2024-09-10T15:27:28.414864+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:27:28.414864+0000","last_undegraded":"2024-09-10T15:27:28.414864+0000","last_fullsized":"2024-09-10T15:27:28.414864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"76'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693521+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:27:28.693521+0000","last_peered":"2024-09-10T15:27:28.693521+0000","last_clean":"2024-09-10T15:27:28.693521+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:27:28.693521+0000","last_undegraded":"2024-09-10T15:27:28.693521+0000","last_fullsized":"2024-09-10T15:27:28.693521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334472+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:28.334472+0000","last_peered":"2024-09-10T15:27:28.334472+0000","last_clean":"2024-09-10T15:27:28.334472+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:28.334472+0000","last_undegraded":"2024-09-10T15:27:28.334472+0000","last_fullsized":"2024-09-10T15:27:28.334472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696128+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:27:28.696128+0000","last_peered":"2024-09-10T15:27:28.696128+0000","last_clean":"2024-09-10T15:27:28.696128+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:27:28.696128+0000","last_undegraded":"2024-09-10T15:27:28.696128+0000","last_fullsized":"2024-09-10T15:27:28.696128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'12","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315573+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:27:28.315573+0000","last_peered":"2024-09-10T15:27:28.315573+0000","last_clean":"2024-09-10T15:27:28.315573+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:27:28.315573+0000","last_undegraded":"2024-09-10T15:27:28.315573+0000","last_fullsized":"2024-09-10T15:27:28.315573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332058+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:27:28.332058+0000","last_peered":"2024-09-10T15:27:28.332058+0000","last_clean":"2024-09-10T15:27:28.332058+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:27:28.332058+0000","last_undegraded":"2024-09-10T15:27:28.332058+0000","last_fullsized":"2024-09-10T15:27:28.332058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'25","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312917+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:27:28.312917+0000","last_peered":"2024-09-10T15:27:28.312917+0000","last_clean":"2024-09-10T15:27:28.312917+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:27:28.312917+0000","last_undegraded":"2024-09-10T15:27:28.312917+0000","last_fullsized":"2024-09-10T15:27:28.312917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":32,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694504+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:27:28.694504+0000","last_peered":"2024-09-10T15:27:28.694504+0000","last_clean":"2024-09-10T15:27:28.694504+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:27:28.694504+0000","last_undegraded":"2024-09-10T15:27:28.694504+0000","last_fullsized":"2024-09-10T15:27:28.694504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492730+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:28.492730+0000","last_peered":"2024-09-10T15:27:28.492730+0000","last_clean":"2024-09-10T15:27:28.492730+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:28.492730+0000","last_undegraded":"2024-09-10T15:27:28.492730+0000","last_fullsized":"2024-09-10T15:27:28.492730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315251+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.315251+0000","last_peered":"2024-09-10T15:27:28.315251+0000","last_clean":"2024-09-10T15:27:28.315251+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:27:28.315251+0000","last_undegraded":"2024-09-10T15:27:28.315251+0000","last_fullsized":"2024-09-10T15:27:28.315251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490986+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:27:28.490986+0000","last_peered":"2024-09-10T15:27:28.490986+0000","last_clean":"2024-09-10T15:27:28.490986+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:27:28.490986+0000","last_undegraded":"2024-09-10T15:27:28.490986+0000","last_fullsized":"2024-09-10T15:27:28.490986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491173+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:27:28.491173+0000","last_peered":"2024-09-10T15:27:28.491173+0000","last_clean":"2024-09-10T15:27:28.491173+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:27:28.491173+0000","last_undegraded":"2024-09-10T15:27:28.491173+0000","last_fullsized":"2024-09-10T15:27:28.491173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"76'18","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948238+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:27:28.948238+0000","last_peered":"2024-09-10T15:27:28.948238+0000","last_clean":"2024-09-10T15:27:28.948238+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:27:28.948238+0000","last_undegraded":"2024-09-10T15:27:28.948238+0000","last_fullsized":"2024-09-10T15:27:28.948238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":27,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489211+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:28.489211+0000","last_peered":"2024-09-10T15:27:28.489211+0000","last_clean":"2024-09-10T15:27:28.489211+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:28.489211+0000","last_undegraded":"2024-09-10T15:27:28.489211+0000","last_fullsized":"2024-09-10T15:27:28.489211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693570+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693570+0000","last_peered":"2024-09-10T15:27:28.693570+0000","last_clean":"2024-09-10T15:27:28.693570+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693570+0000","last_undegraded":"2024-09-10T15:27:28.693570+0000","last_fullsized":"2024-09-10T15:27:28.693570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416540+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416540+0000","last_peered":"2024-09-10T15:27:28.416540+0000","last_clean":"2024-09-10T15:27:28.416540+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416540+0000","last_undegraded":"2024-09-10T15:27:28.416540+0000","last_fullsized":"2024-09-10T15:27:28.416540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"76'6","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415506+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:28.415506+0000","last_peered":"2024-09-10T15:27:28.415506+0000","last_clean":"2024-09-10T15:27:28.415506+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:28.415506+0000","last_undegraded":"2024-09-10T15:27:28.415506+0000","last_fullsized":"2024-09-10T15:27:28.415506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696078+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:28.696078+0000","last_peered":"2024-09-10T15:27:28.696078+0000","last_clean":"2024-09-10T15:27:28.696078+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:28.696078+0000","last_undegraded":"2024-09-10T15:27:28.696078+0000","last_fullsized":"2024-09-10T15:27:28.696078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"76'19","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695963+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:28.695963+0000","last_peered":"2024-09-10T15:27:28.695963+0000","last_clean":"2024-09-10T15:27:28.695963+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:28.695963+0000","last_undegraded":"2024-09-10T15:27:28.695963+0000","last_fullsized":"2024-09-10T15:27:28.695963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492088+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:27:28.492088+0000","last_peered":"2024-09-10T15:27:28.492088+0000","last_clean":"2024-09-10T15:27:28.492088+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:27:28.492088+0000","last_undegraded":"2024-09-10T15:27:28.492088+0000","last_fullsized":"2024-09-10T15:27:28.492088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331612+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331612+0000","last_peered":"2024-09-10T15:27:28.331612+0000","last_clean":"2024-09-10T15:27:28.331612+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331612+0000","last_undegraded":"2024-09-10T15:27:28.331612+0000","last_fullsized":"2024-09-10T15:27:28.331612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341512+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341512+0000","last_peered":"2024-09-10T15:27:28.341512+0000","last_clean":"2024-09-10T15:27:28.341512+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341512+0000","last_undegraded":"2024-09-10T15:27:28.341512+0000","last_fullsized":"2024-09-10T15:27:28.341512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"71'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414253+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:28.414253+0000","last_peered":"2024-09-10T15:27:28.414253+0000","last_clean":"2024-09-10T15:27:28.414253+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:28.414253+0000","last_undegraded":"2024-09-10T15:27:28.414253+0000","last_fullsized":"2024-09-10T15:27:28.414253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948449+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:27:28.948449+0000","last_peered":"2024-09-10T15:27:28.948449+0000","last_clean":"2024-09-10T15:27:28.948449+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:27:28.948449+0000","last_undegraded":"2024-09-10T15:27:28.948449+0000","last_fullsized":"2024-09-10T15:27:28.948449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333188+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:28.333188+0000","last_peered":"2024-09-10T15:27:28.333188+0000","last_clean":"2024-09-10T15:27:28.333188+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:28.333188+0000","last_undegraded":"2024-09-10T15:27:28.333188+0000","last_fullsized":"2024-09-10T15:27:28.333188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"76'14","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947945+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:27:28.947945+0000","last_peered":"2024-09-10T15:27:28.947945+0000","last_clean":"2024-09-10T15:27:28.947945+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:27:28.947945+0000","last_undegraded":"2024-09-10T15:27:28.947945+0000","last_fullsized":"2024-09-10T15:27:28.947945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340473+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340473+0000","last_peered":"2024-09-10T15:27:28.340473+0000","last_clean":"2024-09-10T15:27:28.340473+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340473+0000","last_undegraded":"2024-09-10T15:27:28.340473+0000","last_fullsized":"2024-09-10T15:27:28.340473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493307+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:27:28.493307+0000","last_peered":"2024-09-10T15:27:28.493307+0000","last_clean":"2024-09-10T15:27:28.493307+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:27:28.493307+0000","last_undegraded":"2024-09-10T15:27:28.493307+0000","last_fullsized":"2024-09-10T15:27:28.493307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"76'11","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313936+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:28.313936+0000","last_peered":"2024-09-10T15:27:28.313936+0000","last_clean":"2024-09-10T15:27:28.313936+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:28.313936+0000","last_undegraded":"2024-09-10T15:27:28.313936+0000","last_fullsized":"2024-09-10T15:27:28.313936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416658+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:27:28.416658+0000","last_peered":"2024-09-10T15:27:28.416658+0000","last_clean":"2024-09-10T15:27:28.416658+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:27:28.416658+0000","last_undegraded":"2024-09-10T15:27:28.416658+0000","last_fullsized":"2024-09-10T15:27:28.416658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"76'21","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947848+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:27:28.947848+0000","last_peered":"2024-09-10T15:27:28.947848+0000","last_clean":"2024-09-10T15:27:28.947848+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:27:28.947848+0000","last_undegraded":"2024-09-10T15:27:28.947848+0000","last_fullsized":"2024-09-10T15:27:28.947848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341970+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:28.341970+0000","last_peered":"2024-09-10T15:27:28.341970+0000","last_clean":"2024-09-10T15:27:28.341970+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:28.341970+0000","last_undegraded":"2024-09-10T15:27:28.341970+0000","last_fullsized":"2024-09-10T15:27:28.341970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489952+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.489952+0000","last_peered":"2024-09-10T15:27:28.489952+0000","last_clean":"2024-09-10T15:27:28.489952+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.489952+0000","last_undegraded":"2024-09-10T15:27:28.489952+0000","last_fullsized":"2024-09-10T15:27:28.489952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416212+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416212+0000","last_peered":"2024-09-10T15:27:28.416212+0000","last_clean":"2024-09-10T15:27:28.416212+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416212+0000","last_undegraded":"2024-09-10T15:27:28.416212+0000","last_fullsized":"2024-09-10T15:27:28.416212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":315,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947773+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:27:28.947773+0000","last_peered":"2024-09-10T15:27:28.947773+0000","last_clean":"2024-09-10T15:27:28.947773+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:27:28.947773+0000","last_undegraded":"2024-09-10T15:27:28.947773+0000","last_fullsized":"2024-09-10T15:27:28.947773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415740+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415740+0000","last_peered":"2024-09-10T15:27:28.415740+0000","last_clean":"2024-09-10T15:27:28.415740+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415740+0000","last_undegraded":"2024-09-10T15:27:28.415740+0000","last_fullsized":"2024-09-10T15:27:28.415740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314357+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:28.314357+0000","last_peered":"2024-09-10T15:27:28.314357+0000","last_clean":"2024-09-10T15:27:28.314357+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:28.314357+0000","last_undegraded":"2024-09-10T15:27:28.314357+0000","last_fullsized":"2024-09-10T15:27:28.314357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":49176,"num_write":56,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314018+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:27:28.314018+0000","last_peered":"2024-09-10T15:27:28.314018+0000","last_clean":"2024-09-10T15:27:28.314018+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:27:28.314018+0000","last_undegraded":"2024-09-10T15:27:28.314018+0000","last_fullsized":"2024-09-10T15:27:28.314018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'30","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416630+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:27:28.416630+0000","last_peered":"2024-09-10T15:27:28.416630+0000","last_clean":"2024-09-10T15:27:28.416630+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:27:28.416630+0000","last_undegraded":"2024-09-10T15:27:28.416630+0000","last_fullsized":"2024-09-10T15:27:28.416630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28500,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693638+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:27:28.693638+0000","last_peered":"2024-09-10T15:27:28.693638+0000","last_clean":"2024-09-10T15:27:28.693638+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:27:28.693638+0000","last_undegraded":"2024-09-10T15:27:28.693638+0000","last_fullsized":"2024-09-10T15:27:28.693638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313993+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:28.313993+0000","last_peered":"2024-09-10T15:27:28.313993+0000","last_clean":"2024-09-10T15:27:28.313993+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:28.313993+0000","last_undegraded":"2024-09-10T15:27:28.313993+0000","last_fullsized":"2024-09-10T15:27:28.313993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696870+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:27:28.696870+0000","last_peered":"2024-09-10T15:27:28.696870+0000","last_clean":"2024-09-10T15:27:28.696870+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:27:28.696870+0000","last_undegraded":"2024-09-10T15:27:28.696870+0000","last_fullsized":"2024-09-10T15:27:28.696870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415458+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415458+0000","last_peered":"2024-09-10T15:27:28.415458+0000","last_clean":"2024-09-10T15:27:28.415458+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415458+0000","last_undegraded":"2024-09-10T15:27:28.415458+0000","last_fullsized":"2024-09-10T15:27:28.415458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"76'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332661+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:27:28.332661+0000","last_peered":"2024-09-10T15:27:28.332661+0000","last_clean":"2024-09-10T15:27:28.332661+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:27:28.332661+0000","last_undegraded":"2024-09-10T15:27:28.332661+0000","last_fullsized":"2024-09-10T15:27:28.332661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":24,"num_read_kb":49164,"num_write":36,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416394+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:27:28.416394+0000","last_peered":"2024-09-10T15:27:28.416394+0000","last_clean":"2024-09-10T15:27:28.416394+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:27:28.416394+0000","last_undegraded":"2024-09-10T15:27:28.416394+0000","last_fullsized":"2024-09-10T15:27:28.416394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'48","reported_seq":230,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491018+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:27:28.491018+0000","last_peered":"2024-09-10T15:27:28.491018+0000","last_clean":"2024-09-10T15:27:28.491018+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:27:28.491018+0000","last_undegraded":"2024-09-10T15:27:28.491018+0000","last_fullsized":"2024-09-10T15:27:28.491018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":85,"num_write":48,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416482+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:27:28.416482+0000","last_peered":"2024-09-10T15:27:28.416482+0000","last_clean":"2024-09-10T15:27:28.416482+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:27:28.416482+0000","last_undegraded":"2024-09-10T15:27:28.416482+0000","last_fullsized":"2024-09-10T15:27:28.416482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694797+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:28.694797+0000","last_peered":"2024-09-10T15:27:28.694797+0000","last_clean":"2024-09-10T15:27:28.694797+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:28.694797+0000","last_undegraded":"2024-09-10T15:27:28.694797+0000","last_fullsized":"2024-09-10T15:27:28.694797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334556+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:27:28.334556+0000","last_peered":"2024-09-10T15:27:28.334556+0000","last_clean":"2024-09-10T15:27:28.334556+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:27:28.334556+0000","last_undegraded":"2024-09-10T15:27:28.334556+0000","last_fullsized":"2024-09-10T15:27:28.334556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490049+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:27:28.490049+0000","last_peered":"2024-09-10T15:27:28.490049+0000","last_clean":"2024-09-10T15:27:28.490049+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:27:28.490049+0000","last_undegraded":"2024-09-10T15:27:28.490049+0000","last_fullsized":"2024-09-10T15:27:28.490049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694409+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:28.694409+0000","last_peered":"2024-09-10T15:27:28.694409+0000","last_clean":"2024-09-10T15:27:28.694409+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:28.694409+0000","last_undegraded":"2024-09-10T15:27:28.694409+0000","last_fullsized":"2024-09-10T15:27:28.694409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24588,"num_write":29,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492515+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:27:28.492515+0000","last_peered":"2024-09-10T15:27:28.492515+0000","last_clean":"2024-09-10T15:27:28.492515+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:27:28.492515+0000","last_undegraded":"2024-09-10T15:27:28.492515+0000","last_fullsized":"2024-09-10T15:27:28.492515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314997+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:27:28.314997+0000","last_peered":"2024-09-10T15:27:28.314997+0000","last_clean":"2024-09-10T15:27:28.314997+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:27:28.314997+0000","last_undegraded":"2024-09-10T15:27:28.314997+0000","last_fullsized":"2024-09-10T15:27:28.314997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314725+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.314725+0000","last_peered":"2024-09-10T15:27:28.314725+0000","last_clean":"2024-09-10T15:27:28.314725+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.314725+0000","last_undegraded":"2024-09-10T15:27:28.314725+0000","last_fullsized":"2024-09-10T15:27:28.314725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314024+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:28.314024+0000","last_peered":"2024-09-10T15:27:28.314024+0000","last_clean":"2024-09-10T15:27:28.314024+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:28.314024+0000","last_undegraded":"2024-09-10T15:27:28.314024+0000","last_fullsized":"2024-09-10T15:27:28.314024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333823+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333823+0000","last_peered":"2024-09-10T15:27:28.333823+0000","last_clean":"2024-09-10T15:27:28.333823+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333823+0000","last_undegraded":"2024-09-10T15:27:28.333823+0000","last_fullsized":"2024-09-10T15:27:28.333823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415593+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415593+0000","last_peered":"2024-09-10T15:27:28.415593+0000","last_clean":"2024-09-10T15:27:28.415593+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415593+0000","last_undegraded":"2024-09-10T15:27:28.415593+0000","last_fullsized":"2024-09-10T15:27:28.415593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"76'9","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489746+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:28.489746+0000","last_peered":"2024-09-10T15:27:28.489746+0000","last_clean":"2024-09-10T15:27:28.489746+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:28.489746+0000","last_undegraded":"2024-09-10T15:27:28.489746+0000","last_fullsized":"2024-09-10T15:27:28.489746+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:22.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491363+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:27:28.491363+0000","last_peered":"2024-09-10T15:27:28.491363+0000","last_clean":"2024-09-10T15:27:28.491363+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:27:28.491363+0000","last_undegraded":"2024-09-10T15:27:28.491363+0000","last_fullsized":"2024-09-10T15:27:28.491363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696503+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:27:28.696503+0000","last_peered":"2024-09-10T15:27:28.696503+0000","last_clean":"2024-09-10T15:27:28.696503+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:27:28.696503+0000","last_undegraded":"2024-09-10T15:27:28.696503+0000","last_fullsized":"2024-09-10T15:27:28.696503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416956+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:28.416956+0000","last_peered":"2024-09-10T15:27:28.416956+0000","last_clean":"2024-09-10T15:27:28.416956+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:28.416956+0000","last_undegraded":"2024-09-10T15:27:28.416956+0000","last_fullsized":"2024-09-10T15:27:28.416956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.946988+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:28.946988+0000","last_peered":"2024-09-10T15:27:28.946988+0000","last_clean":"2024-09-10T15:27:28.946988+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:28.946988+0000","last_undegraded":"2024-09-10T15:27:28.946988+0000","last_fullsized":"2024-09-10T15:27:28.946988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332108+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332108+0000","last_peered":"2024-09-10T15:27:28.332108+0000","last_clean":"2024-09-10T15:27:28.332108+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332108+0000","last_undegraded":"2024-09-10T15:27:28.332108+0000","last_fullsized":"2024-09-10T15:27:28.332108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341413+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:27:28.341413+0000","last_peered":"2024-09-10T15:27:28.341413+0000","last_clean":"2024-09-10T15:27:28.341413+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:27:28.341413+0000","last_undegraded":"2024-09-10T15:27:28.341413+0000","last_fullsized":"2024-09-10T15:27:28.341413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697320+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697320+0000","last_peered":"2024-09-10T15:27:28.697320+0000","last_clean":"2024-09-10T15:27:28.697320+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697320+0000","last_undegraded":"2024-09-10T15:27:28.697320+0000","last_fullsized":"2024-09-10T15:27:28.697320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314579+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:27:28.314579+0000","last_peered":"2024-09-10T15:27:28.314579+0000","last_clean":"2024-09-10T15:27:28.314579+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:27:28.314579+0000","last_undegraded":"2024-09-10T15:27:28.314579+0000","last_fullsized":"2024-09-10T15:27:28.314579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"76'28","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490320+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:27:28.490320+0000","last_peered":"2024-09-10T15:27:28.490320+0000","last_clean":"2024-09-10T15:27:28.490320+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:27:28.490320+0000","last_undegraded":"2024-09-10T15:27:28.490320+0000","last_fullsized":"2024-09-10T15:27:28.490320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16571,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340394+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340394+0000","last_peered":"2024-09-10T15:27:28.340394+0000","last_clean":"2024-09-10T15:27:28.340394+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340394+0000","last_undegraded":"2024-09-10T15:27:28.340394+0000","last_fullsized":"2024-09-10T15:27:28.340394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696065+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:28.696065+0000","last_peered":"2024-09-10T15:27:28.696065+0000","last_clean":"2024-09-10T15:27:28.696065+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:28.696065+0000","last_undegraded":"2024-09-10T15:27:28.696065+0000","last_fullsized":"2024-09-10T15:27:28.696065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333620+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:27:28.333620+0000","last_peered":"2024-09-10T15:27:28.333620+0000","last_clean":"2024-09-10T15:27:28.333620+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:27:28.333620+0000","last_undegraded":"2024-09-10T15:27:28.333620+0000","last_fullsized":"2024-09-10T15:27:28.333620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334268+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:27:28.334268+0000","last_peered":"2024-09-10T15:27:28.334268+0000","last_clean":"2024-09-10T15:27:28.334268+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:27:28.334268+0000","last_undegraded":"2024-09-10T15:27:28.334268+0000","last_fullsized":"2024-09-10T15:27:28.334268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414797+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414797+0000","last_peered":"2024-09-10T15:27:28.414797+0000","last_clean":"2024-09-10T15:27:28.414797+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414797+0000","last_undegraded":"2024-09-10T15:27:28.414797+0000","last_fullsized":"2024-09-10T15:27:28.414797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313704+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:27:28.313704+0000","last_peered":"2024-09-10T15:27:28.313704+0000","last_clean":"2024-09-10T15:27:28.313704+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:27:28.313704+0000","last_undegraded":"2024-09-10T15:27:28.313704+0000","last_fullsized":"2024-09-10T15:27:28.313704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331980+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.331980+0000","last_peered":"2024-09-10T15:27:28.331980+0000","last_clean":"2024-09-10T15:27:28.331980+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.331980+0000","last_undegraded":"2024-09-10T15:27:28.331980+0000","last_fullsized":"2024-09-10T15:27:28.331980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"76'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947096+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:28.947096+0000","last_peered":"2024-09-10T15:27:28.947096+0000","last_clean":"2024-09-10T15:27:28.947096+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:28.947096+0000","last_undegraded":"2024-09-10T15:27:28.947096+0000","last_fullsized":"2024-09-10T15:27:28.947096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492299+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:28.492299+0000","last_peered":"2024-09-10T15:27:28.492299+0000","last_clean":"2024-09-10T15:27:28.492299+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:28.492299+0000","last_undegraded":"2024-09-10T15:27:28.492299+0000","last_fullsized":"2024-09-10T15:27:28.492299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313734+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:27:28.313734+0000","last_peered":"2024-09-10T15:27:28.313734+0000","last_clean":"2024-09-10T15:27:28.313734+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:27:28.313734+0000","last_undegraded":"2024-09-10T15:27:28.313734+0000","last_fullsized":"2024-09-10T15:27:28.313734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"76'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316031+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:28.316031+0000","last_peered":"2024-09-10T15:27:28.316031+0000","last_clean":"2024-09-10T15:27:28.316031+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:28.316031+0000","last_undegraded":"2024-09-10T15:27:28.316031+0000","last_fullsized":"2024-09-10T15:27:28.316031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316149+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316149+0000","last_peered":"2024-09-10T15:27:28.316149+0000","last_clean":"2024-09-10T15:27:28.316149+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316149+0000","last_undegraded":"2024-09-10T15:27:28.316149+0000","last_fullsized":"2024-09-10T15:27:28.316149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414992+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:27:28.414992+0000","last_peered":"2024-09-10T15:27:28.414992+0000","last_clean":"2024-09-10T15:27:28.414992+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:27:28.414992+0000","last_undegraded":"2024-09-10T15:27:28.414992+0000","last_fullsized":"2024-09-10T15:27:28.414992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415219+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:27:28.415219+0000","last_peered":"2024-09-10T15:27:28.415219+0000","last_clean":"2024-09-10T15:27:28.415219+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:27:28.415219+0000","last_undegraded":"2024-09-10T15:27:28.415219+0000","last_fullsized":"2024-09-10T15:27:28.415219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"76'14","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696278+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:27:28.696278+0000","last_peered":"2024-09-10T15:27:28.696278+0000","last_clean":"2024-09-10T15:27:28.696278+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:27:28.696278+0000","last_undegraded":"2024-09-10T15:27:28.696278+0000","last_fullsized":"2024-09-10T15:27:28.696278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695215+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:28.695215+0000","last_peered":"2024-09-10T15:27:28.695215+0000","last_clean":"2024-09-10T15:27:28.695215+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:28.695215+0000","last_undegraded":"2024-09-10T15:27:28.695215+0000","last_fullsized":"2024-09-10T15:27:28.695215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340766+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:27:28.340766+0000","last_peered":"2024-09-10T15:27:28.340766+0000","last_clean":"2024-09-10T15:27:28.340766+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:27:28.340766+0000","last_undegraded":"2024-09-10T15:27:28.340766+0000","last_fullsized":"2024-09-10T15:27:28.340766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'8","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315897+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:28.315897+0000","last_peered":"2024-09-10T15:27:28.315897+0000","last_clean":"2024-09-10T15:27:28.315897+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:28.315897+0000","last_undegraded":"2024-09-10T15:27:28.315897+0000","last_fullsized":"2024-09-10T15:27:28.315897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414338+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414338+0000","last_peered":"2024-09-10T15:27:28.414338+0000","last_clean":"2024-09-10T15:27:28.414338+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414338+0000","last_undegraded":"2024-09-10T15:27:28.414338+0000","last_fullsized":"2024-09-10T15:27:28.414338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313222+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:27:28.313222+0000","last_peered":"2024-09-10T15:27:28.313222+0000","last_clean":"2024-09-10T15:27:28.313222+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:27:28.313222+0000","last_undegraded":"2024-09-10T15:27:28.313222+0000","last_fullsized":"2024-09-10T15:27:28.313222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"76'30","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313533+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:28.313533+0000","last_peered":"2024-09-10T15:27:28.313533+0000","last_clean":"2024-09-10T15:27:28.313533+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:28.313533+0000","last_undegraded":"2024-09-10T15:27:28.313533+0000","last_fullsized":"2024-09-10T15:27:28.313533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16131,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314089+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314089+0000","last_peered":"2024-09-10T15:27:28.314089+0000","last_clean":"2024-09-10T15:27:28.314089+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314089+0000","last_undegraded":"2024-09-10T15:27:28.314089+0000","last_fullsized":"2024-09-10T15:27:28.314089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341292+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:28.341292+0000","last_peered":"2024-09-10T15:27:28.341292+0000","last_clean":"2024-09-10T15:27:28.341292+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:28.341292+0000","last_undegraded":"2024-09-10T15:27:28.341292+0000","last_fullsized":"2024-09-10T15:27:28.341292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314871+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314871+0000","last_peered":"2024-09-10T15:27:28.314871+0000","last_clean":"2024-09-10T15:27:28.314871+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314871+0000","last_undegraded":"2024-09-10T15:27:28.314871+0000","last_fullsized":"2024-09-10T15:27:28.314871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341098+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:27:28.341098+0000","last_peered":"2024-09-10T15:27:28.341098+0000","last_clean":"2024-09-10T15:27:28.341098+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:27:28.341098+0000","last_undegraded":"2024-09-10T15:27:28.341098+0000","last_fullsized":"2024-09-10T15:27:28.341098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416157+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:27:28.416157+0000","last_peered":"2024-09-10T15:27:28.416157+0000","last_clean":"2024-09-10T15:27:28.416157+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:27:28.416157+0000","last_undegraded":"2024-09-10T15:27:28.416157+0000","last_fullsized":"2024-09-10T15:27:28.416157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":45068,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332482+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:27:28.332482+0000","last_peered":"2024-09-10T15:27:28.332482+0000","last_clean":"2024-09-10T15:27:28.332482+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:27:28.332482+0000","last_undegraded":"2024-09-10T15:27:28.332482+0000","last_fullsized":"2024-09-10T15:27:28.332482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"76'18","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331938+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:27:28.331938+0000","last_peered":"2024-09-10T15:27:28.331938+0000","last_clean":"2024-09-10T15:27:28.331938+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:27:28.331938+0000","last_undegraded":"2024-09-10T15:27:28.331938+0000","last_fullsized":"2024-09-10T15:27:28.331938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489034+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:27:28.489034+0000","last_peered":"2024-09-10T15:27:28.489034+0000","last_clean":"2024-09-10T15:27:28.489034+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:27:28.489034+0000","last_undegraded":"2024-09-10T15:27:28.489034+0000","last_fullsized":"2024-09-10T15:27:28.489034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492067+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492067+0000","last_peered":"2024-09-10T15:27:28.492067+0000","last_clean":"2024-09-10T15:27:28.492067+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492067+0000","last_undegraded":"2024-09-10T15:27:28.492067+0000","last_fullsized":"2024-09-10T15:27:28.492067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313879+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:28.313879+0000","last_peered":"2024-09-10T15:27:28.313879+0000","last_clean":"2024-09-10T15:27:28.313879+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:28.313879+0000","last_undegraded":"2024-09-10T15:27:28.313879+0000","last_fullsized":"2024-09-10T15:27:28.313879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316289+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:27:28.316289+0000","last_peered":"2024-09-10T15:27:28.316289+0000","last_clean":"2024-09-10T15:27:28.316289+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:27:28.316289+0000","last_undegraded":"2024-09-10T15:27:28.316289+0000","last_fullsized":"2024-09-10T15:27:28.316289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314243+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:27:28.314243+0000","last_peered":"2024-09-10T15:27:28.314243+0000","last_clean":"2024-09-10T15:27:28.314243+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:27:28.314243+0000","last_undegraded":"2024-09-10T15:27:28.314243+0000","last_fullsized":"2024-09-10T15:27:28.314243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312937+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:27:28.312937+0000","last_peered":"2024-09-10T15:27:28.312937+0000","last_clean":"2024-09-10T15:27:28.312937+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:27:28.312937+0000","last_undegraded":"2024-09-10T15:27:28.312937+0000","last_fullsized":"2024-09-10T15:27:28.312937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339809+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:28.339809+0000","last_peered":"2024-09-10T15:27:28.339809+0000","last_clean":"2024-09-10T15:27:28.339809+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:28.339809+0000","last_undegraded":"2024-09-10T15:27:28.339809+0000","last_fullsized":"2024-09-10T15:27:28.339809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333472+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:28.333472+0000","last_peered":"2024-09-10T15:27:28.333472+0000","last_clean":"2024-09-10T15:27:28.333472+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:28.333472+0000","last_undegraded":"2024-09-10T15:27:28.333472+0000","last_fullsized":"2024-09-10T15:27:28.333472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313480+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:27:28.313480+0000","last_peered":"2024-09-10T15:27:28.313480+0000","last_clean":"2024-09-10T15:27:28.313480+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:27:28.313480+0000","last_undegraded":"2024-09-10T15:27:28.313480+0000","last_fullsized":"2024-09-10T15:27:28.313480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"76'6","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341902+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:27:28.341902+0000","last_peered":"2024-09-10T15:27:28.341902+0000","last_clean":"2024-09-10T15:27:28.341902+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:27:28.341902+0000","last_undegraded":"2024-09-10T15:27:28.341902+0000","last_fullsized":"2024-09-10T15:27:28.341902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340071+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:27:28.340071+0000","last_peered":"2024-09-10T15:27:28.340071+0000","last_clean":"2024-09-10T15:27:28.340071+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:27:28.340071+0000","last_undegraded":"2024-09-10T15:27:28.340071+0000","last_fullsized":"2024-09-10T15:27:28.340071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"76'14","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490857+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:27:28.490857+0000","last_peered":"2024-09-10T15:27:28.490857+0000","last_clean":"2024-09-10T15:27:28.490857+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:27:28.490857+0000","last_undegraded":"2024-09-10T15:27:28.490857+0000","last_fullsized":"2024-09-10T15:27:28.490857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947403+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:28.947403+0000","last_peered":"2024-09-10T15:27:28.947403+0000","last_clean":"2024-09-10T15:27:28.947403+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:28.947403+0000","last_undegraded":"2024-09-10T15:27:28.947403+0000","last_fullsized":"2024-09-10T15:27:28.947403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415856+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:28.415856+0000","last_peered":"2024-09-10T15:27:28.415856+0000","last_clean":"2024-09-10T15:27:28.415856+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:28.415856+0000","last_undegraded":"2024-09-10T15:27:28.415856+0000","last_fullsized":"2024-09-10T15:27:28.415856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490524+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:27:28.490524+0000","last_peered":"2024-09-10T15:27:28.490524+0000","last_clean":"2024-09-10T15:27:28.490524+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:27:28.490524+0000","last_undegraded":"2024-09-10T15:27:28.490524+0000","last_fullsized":"2024-09-10T15:27:28.490524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'11","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697872+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:28.697872+0000","last_peered":"2024-09-10T15:27:28.697872+0000","last_clean":"2024-09-10T15:27:28.697872+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:28.697872+0000","last_undegraded":"2024-09-10T15:27:28.697872+0000","last_fullsized":"2024-09-10T15:27:28.697872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415020+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:27:28.415020+0000","last_peered":"2024-09-10T15:27:28.415020+0000","last_clean":"2024-09-10T15:27:28.415020+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:27:28.415020+0000","last_undegraded":"2024-09-10T15:27:28.415020+0000","last_fullsized":"2024-09-10T15:27:28.415020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"76'16","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313670+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:27:28.313670+0000","last_peered":"2024-09-10T15:27:28.313670+0000","last_clean":"2024-09-10T15:27:28.313670+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:27:28.313670+0000","last_undegraded":"2024-09-10T15:27:28.313670+0000","last_fullsized":"2024-09-10T15:27:28.313670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490222+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:27:28.490222+0000","last_peered":"2024-09-10T15:27:28.490222+0000","last_clean":"2024-09-10T15:27:28.490222+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:27:28.490222+0000","last_undegraded":"2024-09-10T15:27:28.490222+0000","last_fullsized":"2024-09-10T15:27:28.490222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416768+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:27:28.416768+0000","last_peered":"2024-09-10T15:27:28.416768+0000","last_clean":"2024-09-10T15:27:28.416768+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:27:28.416768+0000","last_undegraded":"2024-09-10T15:27:28.416768+0000","last_fullsized":"2024-09-10T15:27:28.416768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"76'13","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694889+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:27:28.694889+0000","last_peered":"2024-09-10T15:27:28.694889+0000","last_clean":"2024-09-10T15:27:28.694889+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:27:28.694889+0000","last_undegraded":"2024-09-10T15:27:28.694889+0000","last_fullsized":"2024-09-10T15:27:28.694889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334748+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:27:28.334748+0000","last_peered":"2024-09-10T15:27:28.334748+0000","last_clean":"2024-09-10T15:27:28.334748+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:27:28.334748+0000","last_undegraded":"2024-09-10T15:27:28.334748+0000","last_fullsized":"2024-09-10T15:27:28.334748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333447+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:28.333447+0000","last_peered":"2024-09-10T15:27:28.333447+0000","last_clean":"2024-09-10T15:27:28.333447+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:28.333447+0000","last_undegraded":"2024-09-10T15:27:28.333447+0000","last_fullsized":"2024-09-10T15:27:28.333447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339886+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:28.339886+0000","last_peered":"2024-09-10T15:27:28.339886+0000","last_clean":"2024-09-10T15:27:28.339886+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:28.339886+0000","last_undegraded":"2024-09-10T15:27:28.339886+0000","last_fullsized":"2024-09-10T15:27:28.339886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694923+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:28.694923+0000","last_peered":"2024-09-10T15:27:28.694923+0000","last_clean":"2024-09-10T15:27:28.694923+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:28.694923+0000","last_undegraded":"2024-09-10T15:27:28.694923+0000","last_fullsized":"2024-09-10T15:27:28.694923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315808+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:27:28.315808+0000","last_peered":"2024-09-10T15:27:28.315808+0000","last_clean":"2024-09-10T15:27:28.315808+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:27:28.315808+0000","last_undegraded":"2024-09-10T15:27:28.315808+0000","last_fullsized":"2024-09-10T15:27:28.315808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313943+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:28.313943+0000","last_peered":"2024-09-10T15:27:28.313943+0000","last_clean":"2024-09-10T15:27:28.313943+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:28.313943+0000","last_undegraded":"2024-09-10T15:27:28.313943+0000","last_fullsized":"2024-09-10T15:27:28.313943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341227+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:27:28.341227+0000","last_peered":"2024-09-10T15:27:28.341227+0000","last_clean":"2024-09-10T15:27:28.341227+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:27:28.341227+0000","last_undegraded":"2024-09-10T15:27:28.341227+0000","last_fullsized":"2024-09-10T15:27:28.341227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"76'20","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416068+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:27:28.416068+0000","last_peered":"2024-09-10T15:27:28.416068+0000","last_clean":"2024-09-10T15:27:28.416068+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:27:28.416068+0000","last_undegraded":"2024-09-10T15:27:28.416068+0000","last_fullsized":"2024-09-10T15:27:28.416068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695544+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:28.695544+0000","last_peered":"2024-09-10T15:27:28.695544+0000","last_clean":"2024-09-10T15:27:28.695544+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:28.695544+0000","last_undegraded":"2024-09-10T15:27:28.695544+0000","last_fullsized":"2024-09-10T15:27:28.695544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415564+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:28.415564+0000","last_peered":"2024-09-10T15:27:28.415564+0000","last_clean":"2024-09-10T15:27:28.415564+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:28.415564+0000","last_undegraded":"2024-09-10T15:27:28.415564+0000","last_fullsized":"2024-09-10T15:27:28.415564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491484+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:27:28.491484+0000","last_peered":"2024-09-10T15:27:28.491484+0000","last_clean":"2024-09-10T15:27:28.491484+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:27:28.491484+0000","last_undegraded":"2024-09-10T15:27:28.491484+0000","last_fullsized":"2024-09-10T15:27:28.491484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"71'6","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947921+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:27:28.947921+0000","last_peered":"2024-09-10T15:27:28.947921+0000","last_clean":"2024-09-10T15:27:28.947921+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:27:28.947921+0000","last_undegraded":"2024-09-10T15:27:28.947921+0000","last_fullsized":"2024-09-10T15:27:28.947921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341593+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:27:28.341593+0000","last_peered":"2024-09-10T15:27:28.341593+0000","last_clean":"2024-09-10T15:27:28.341593+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:27:28.341593+0000","last_undegraded":"2024-09-10T15:27:28.341593+0000","last_fullsized":"2024-09-10T15:27:28.341593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"76'14","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333989+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:27:28.333989+0000","last_peered":"2024-09-10T15:27:28.333989+0000","last_clean":"2024-09-10T15:27:28.333989+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:27:28.333989+0000","last_undegraded":"2024-09-10T15:27:28.333989+0000","last_fullsized":"2024-09-10T15:27:28.333989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489208+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489208+0000","last_peered":"2024-09-10T15:27:28.489208+0000","last_clean":"2024-09-10T15:27:28.489208+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489208+0000","last_undegraded":"2024-09-10T15:27:28.489208+0000","last_fullsized":"2024-09-10T15:27:28.489208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414492+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:28.414492+0000","last_peered":"2024-09-10T15:27:28.414492+0000","last_clean":"2024-09-10T15:27:28.414492+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:28.414492+0000","last_undegraded":"2024-09-10T15:27:28.414492+0000","last_fullsized":"2024-09-10T15:27:28.414492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315293+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:27:28.315293+0000","last_peered":"2024-09-10T15:27:28.315293+0000","last_clean":"2024-09-10T15:27:28.315293+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:27:28.315293+0000","last_undegraded":"2024-09-10T15:27:28.315293+0000","last_fullsized":"2024-09-10T15:27:28.315293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"76'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315661+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:28.315661+0000","last_peered":"2024-09-10T15:27:28.315661+0000","last_clean":"2024-09-10T15:27:28.315661+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:28.315661+0000","last_undegraded":"2024-09-10T15:27:28.315661+0000","last_fullsized":"2024-09-10T15:27:28.315661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47122,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314820+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:27:28.314820+0000","last_peered":"2024-09-10T15:27:28.314820+0000","last_clean":"2024-09-10T15:27:28.314820+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:27:28.314820+0000","last_undegraded":"2024-09-10T15:27:28.314820+0000","last_fullsized":"2024-09-10T15:27:28.314820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"88'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416555+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:27:28.416555+0000","last_peered":"2024-09-10T15:27:28.416555+0000","last_clean":"2024-09-10T15:27:28.416555+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:27:28.416555+0000","last_undegraded":"2024-09-10T15:27:28.416555+0000","last_fullsized":"2024-09-10T15:27:28.416555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"76'14","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315714+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:28.315714+0000","last_peered":"2024-09-10T15:27:28.315714+0000","last_clean":"2024-09-10T15:27:28.315714+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:28.315714+0000","last_undegraded":"2024-09-10T15:27:28.315714+0000","last_fullsized":"2024-09-10T15:27:28.315714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414669+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:28.414669+0000","last_peered":"2024-09-10T15:27:28.414669+0000","last_clean":"2024-09-10T15:27:28.414669+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:28.414669+0000","last_undegraded":"2024-09-10T15:27:28.414669+0000","last_fullsized":"2024-09-10T15:27:28.414669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341049+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:27:28.341049+0000","last_peered":"2024-09-10T15:27:28.341049+0000","last_clean":"2024-09-10T15:27:28.341049+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:27:28.341049+0000","last_undegraded":"2024-09-10T15:27:28.341049+0000","last_fullsized":"2024-09-10T15:27:28.341049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"76'10","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947889+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:27:28.947889+0000","last_peered":"2024-09-10T15:27:28.947889+0000","last_clean":"2024-09-10T15:27:28.947889+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:27:28.947889+0000","last_undegraded":"2024-09-10T15:27:28.947889+0000","last_fullsized":"2024-09-10T15:27:28.947889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947527+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:27:28.947527+0000","last_peered":"2024-09-10T15:27:28.947527+0000","last_clean":"2024-09-10T15:27:28.947527+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:27:28.947527+0000","last_undegraded":"2024-09-10T15:27:28.947527+0000","last_fullsized":"2024-09-10T15:27:28.947527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"76'20","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314075+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:27:28.314075+0000","last_peered":"2024-09-10T15:27:28.314075+0000","last_clean":"2024-09-10T15:27:28.314075+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:27:28.314075+0000","last_undegraded":"2024-09-10T15:27:28.314075+0000","last_fullsized":"2024-09-10T15:27:28.314075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313100+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:28.313100+0000","last_peered":"2024-09-10T15:27:28.313100+0000","last_clean":"2024-09-10T15:27:28.313100+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:28.313100+0000","last_undegraded":"2024-09-10T15:27:28.313100+0000","last_fullsized":"2024-09-10T15:27:28.313100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948209+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:28.948209+0000","last_peered":"2024-09-10T15:27:28.948209+0000","last_clean":"2024-09-10T15:27:28.948209+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:28.948209+0000","last_undegraded":"2024-09-10T15:27:28.948209+0000","last_fullsized":"2024-09-10T15:27:28.948209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340586+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:27:28.340586+0000","last_peered":"2024-09-10T15:27:28.340586+0000","last_clean":"2024-09-10T15:27:28.340586+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:27:28.340586+0000","last_undegraded":"2024-09-10T15:27:28.340586+0000","last_fullsized":"2024-09-10T15:27:28.340586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414646+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:28.414646+0000","last_peered":"2024-09-10T15:27:28.414646+0000","last_clean":"2024-09-10T15:27:28.414646+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:28.414646+0000","last_undegraded":"2024-09-10T15:27:28.414646+0000","last_fullsized":"2024-09-10T15:27:28.414646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24594,"num_write":40,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340861+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:27:28.340861+0000","last_peered":"2024-09-10T15:27:28.340861+0000","last_clean":"2024-09-10T15:27:28.340861+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:27:28.340861+0000","last_undegraded":"2024-09-10T15:27:28.340861+0000","last_fullsized":"2024-09-10T15:27:28.340861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313664+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:27:28.313664+0000","last_peered":"2024-09-10T15:27:28.313664+0000","last_clean":"2024-09-10T15:27:28.313664+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:27:28.313664+0000","last_undegraded":"2024-09-10T15:27:28.313664+0000","last_fullsized":"2024-09-10T15:27:28.313664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414818+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:28.414818+0000","last_peered":"2024-09-10T15:27:28.414818+0000","last_clean":"2024-09-10T15:27:28.414818+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:28.414818+0000","last_undegraded":"2024-09-10T15:27:28.414818+0000","last_fullsized":"2024-09-10T15:27:28.414818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695793+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:28.695793+0000","last_peered":"2024-09-10T15:27:28.695793+0000","last_clean":"2024-09-10T15:27:28.695793+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:28.695793+0000","last_undegraded":"2024-09-10T15:27:28.695793+0000","last_fullsized":"2024-09-10T15:27:28.695793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490133+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:27:28.490133+0000","last_peered":"2024-09-10T15:27:28.490133+0000","last_clean":"2024-09-10T15:27:28.490133+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:27:28.490133+0000","last_undegraded":"2024-09-10T15:27:28.490133+0000","last_fullsized":"2024-09-10T15:27:28.490133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697170+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:28.697170+0000","last_peered":"2024-09-10T15:27:28.697170+0000","last_clean":"2024-09-10T15:27:28.697170+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:28.697170+0000","last_undegraded":"2024-09-10T15:27:28.697170+0000","last_fullsized":"2024-09-10T15:27:28.697170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947124+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:27:28.947124+0000","last_peered":"2024-09-10T15:27:28.947124+0000","last_clean":"2024-09-10T15:27:28.947124+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:27:28.947124+0000","last_undegraded":"2024-09-10T15:27:28.947124+0000","last_fullsized":"2024-09-10T15:27:28.947124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"76'13","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333230+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:27:28.333230+0000","last_peered":"2024-09-10T15:27:28.333230+0000","last_clean":"2024-09-10T15:27:28.333230+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:27:28.333230+0000","last_undegraded":"2024-09-10T15:27:28.333230+0000","last_fullsized":"2024-09-10T15:27:28.333230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":34,"num_write":18,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414704+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:27:28.414704+0000","last_peered":"2024-09-10T15:27:28.414704+0000","last_clean":"2024-09-10T15:27:28.414704+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:27:28.414704+0000","last_undegraded":"2024-09-10T15:27:28.414704+0000","last_fullsized":"2024-09-10T15:27:28.414704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415928+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:28.415928+0000","last_peered":"2024-09-10T15:27:28.415928+0000","last_clean":"2024-09-10T15:27:28.415928+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:28.415928+0000","last_undegraded":"2024-09-10T15:27:28.415928+0000","last_fullsized":"2024-09-10T15:27:28.415928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340195+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:27:28.340195+0000","last_peered":"2024-09-10T15:27:28.340195+0000","last_clean":"2024-09-10T15:27:28.340195+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:27:28.340195+0000","last_undegraded":"2024-09-10T15:27:28.340195+0000","last_fullsized":"2024-09-10T15:27:28.340195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697494+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:28.697494+0000","last_peered":"2024-09-10T15:27:28.697494+0000","last_clean":"2024-09-10T15:27:28.697494+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:28.697494+0000","last_undegraded":"2024-09-10T15:27:28.697494+0000","last_fullsized":"2024-09-10T15:27:28.697494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313080+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:27:28.313080+0000","last_peered":"2024-09-10T15:27:28.313080+0000","last_clean":"2024-09-10T15:27:28.313080+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:27:28.313080+0000","last_undegraded":"2024-09-10T15:27:28.313080+0000","last_fullsized":"2024-09-10T15:27:28.313080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"76'13","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414935+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:27:28.414935+0000","last_peered":"2024-09-10T15:27:28.414935+0000","last_clean":"2024-09-10T15:27:28.414935+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:27:28.414935+0000","last_undegraded":"2024-09-10T15:27:28.414935+0000","last_fullsized":"2024-09-10T15:27:28.414935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314837+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:28.314837+0000","last_peered":"2024-09-10T15:27:28.314837+0000","last_clean":"2024-09-10T15:27:28.314837+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:28.314837+0000","last_undegraded":"2024-09-10T15:27:28.314837+0000","last_fullsized":"2024-09-10T15:27:28.314837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315508+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:28.315508+0000","last_peered":"2024-09-10T15:27:28.315508+0000","last_clean":"2024-09-10T15:27:28.315508+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:28.315508+0000","last_undegraded":"2024-09-10T15:27:28.315508+0000","last_fullsized":"2024-09-10T15:27:28.315508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315999+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:27:28.315999+0000","last_peered":"2024-09-10T15:27:28.315999+0000","last_clean":"2024-09-10T15:27:28.315999+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:27:28.315999+0000","last_undegraded":"2024-09-10T15:27:28.315999+0000","last_fullsized":"2024-09-10T15:27:28.315999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340407+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:27:28.340407+0000","last_peered":"2024-09-10T15:27:28.340407+0000","last_clean":"2024-09-10T15:27:28.340407+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:27:28.340407+0000","last_undegraded":"2024-09-10T15:27:28.340407+0000","last_fullsized":"2024-09-10T15:27:28.340407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492828+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:27:28.492828+0000","last_peered":"2024-09-10T15:27:28.492828+0000","last_clean":"2024-09-10T15:27:28.492828+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:27:28.492828+0000","last_undegraded":"2024-09-10T15:27:28.492828+0000","last_fullsized":"2024-09-10T15:27:28.492828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"63'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489564+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:27:28.489564+0000","last_peered":"2024-09-10T15:27:28.489564+0000","last_clean":"2024-09-10T15:27:28.489564+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:27:28.489564+0000","last_undegraded":"2024-09-10T15:27:28.489564+0000","last_fullsized":"2024-09-10T15:27:28.489564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416056+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416056+0000","last_peered":"2024-09-10T15:27:28.416056+0000","last_clean":"2024-09-10T15:27:28.416056+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416056+0000","last_undegraded":"2024-09-10T15:27:28.416056+0000","last_fullsized":"2024-09-10T15:27:28.416056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415413+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:28.415413+0000","last_peered":"2024-09-10T15:27:28.415413+0000","last_clean":"2024-09-10T15:27:28.415413+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:28.415413+0000","last_undegraded":"2024-09-10T15:27:28.415413+0000","last_fullsized":"2024-09-10T15:27:28.415413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696973+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:27:28.696973+0000","last_peered":"2024-09-10T15:27:28.696973+0000","last_clean":"2024-09-10T15:27:28.696973+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:27:28.696973+0000","last_undegraded":"2024-09-10T15:27:28.696973+0000","last_fullsized":"2024-09-10T15:27:28.696973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696532+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:28.696532+0000","last_peered":"2024-09-10T15:27:28.696532+0000","last_clean":"2024-09-10T15:27:28.696532+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:28.696532+0000","last_undegraded":"2024-09-10T15:27:28.696532+0000","last_fullsized":"2024-09-10T15:27:28.696532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":51212,"num_write":35,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695873+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:27:28.695873+0000","last_peered":"2024-09-10T15:27:28.695873+0000","last_clean":"2024-09-10T15:27:28.695873+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:27:28.695873+0000","last_undegraded":"2024-09-10T15:27:28.695873+0000","last_fullsized":"2024-09-10T15:27:28.695873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331251+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:27:28.331251+0000","last_peered":"2024-09-10T15:27:28.331251+0000","last_clean":"2024-09-10T15:27:28.331251+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:27:28.331251+0000","last_undegraded":"2024-09-10T15:27:28.331251+0000","last_fullsized":"2024-09-10T15:27:28.331251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314167+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:27:28.314167+0000","last_peered":"2024-09-10T15:27:28.314167+0000","last_clean":"2024-09-10T15:27:28.314167+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:27:28.314167+0000","last_undegraded":"2024-09-10T15:27:28.314167+0000","last_fullsized":"2024-09-10T15:27:28.314167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334348+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:27:28.334348+0000","last_peered":"2024-09-10T15:27:28.334348+0000","last_clean":"2024-09-10T15:27:28.334348+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:27:28.334348+0000","last_undegraded":"2024-09-10T15:27:28.334348+0000","last_fullsized":"2024-09-10T15:27:28.334348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332571+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:27:28.332571+0000","last_peered":"2024-09-10T15:27:28.332571+0000","last_clean":"2024-09-10T15:27:28.332571+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:27:28.332571+0000","last_undegraded":"2024-09-10T15:27:28.332571+0000","last_fullsized":"2024-09-10T15:27:28.332571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341835+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:27:28.341835+0000","last_peered":"2024-09-10T15:27:28.341835+0000","last_clean":"2024-09-10T15:27:28.341835+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:27:28.341835+0000","last_undegraded":"2024-09-10T15:27:28.341835+0000","last_fullsized":"2024-09-10T15:27:28.341835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947641+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:27:28.947641+0000","last_peered":"2024-09-10T15:27:28.947641+0000","last_clean":"2024-09-10T15:27:28.947641+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:27:28.947641+0000","last_undegraded":"2024-09-10T15:27:28.947641+0000","last_fullsized":"2024-09-10T15:27:28.947641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697192+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:27:28.697192+0000","last_peered":"2024-09-10T15:27:28.697192+0000","last_clean":"2024-09-10T15:27:28.697192+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:27:28.697192+0000","last_undegraded":"2024-09-10T15:27:28.697192+0000","last_fullsized":"2024-09-10T15:27:28.697192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28684,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493145+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:28.493145+0000","last_peered":"2024-09-10T15:27:28.493145+0000","last_clean":"2024-09-10T15:27:28.493145+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:28.493145+0000","last_undegraded":"2024-09-10T15:27:28.493145+0000","last_fullsized":"2024-09-10T15:27:28.493145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"76'9","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415276+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:27:28.415276+0000","last_peered":"2024-09-10T15:27:28.415276+0000","last_clean":"2024-09-10T15:27:28.415276+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:27:28.415276+0000","last_undegraded":"2024-09-10T15:27:28.415276+0000","last_fullsized":"2024-09-10T15:27:28.415276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315776+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:27:28.315776+0000","last_peered":"2024-09-10T15:27:28.315776+0000","last_clean":"2024-09-10T15:27:28.315776+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:27:28.315776+0000","last_undegraded":"2024-09-10T15:27:28.315776+0000","last_fullsized":"2024-09-10T15:27:28.315776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"69'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694776+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:28.694776+0000","last_peered":"2024-09-10T15:27:28.694776+0000","last_clean":"2024-09-10T15:27:28.694776+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:28.694776+0000","last_undegraded":"2024-09-10T15:27:28.694776+0000","last_fullsized":"2024-09-10T15:27:28.694776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696443+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:27:28.696443+0000","last_peered":"2024-09-10T15:27:28.696443+0000","last_clean":"2024-09-10T15:27:28.696443+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:27:28.696443+0000","last_undegraded":"2024-09-10T15:27:28.696443+0000","last_fullsized":"2024-09-10T15:27:28.696443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"76'7","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947713+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:27:28.947713+0000","last_peered":"2024-09-10T15:27:28.947713+0000","last_clean":"2024-09-10T15:27:28.947713+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:27:28.947713+0000","last_undegraded":"2024-09-10T15:27:28.947713+0000","last_fullsized":"2024-09-10T15:27:28.947713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18438,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947692+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.947692+0000","last_peered":"2024-09-10T15:27:28.947692+0000","last_clean":"2024-09-10T15:27:28.947692+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:27:28.947692+0000","last_undegraded":"2024-09-10T15:27:28.947692+0000","last_fullsized":"2024-09-10T15:27:28.947692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315424+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:28.315424+0000","last_peered":"2024-09-10T15:27:28.315424+0000","last_clean":"2024-09-10T15:27:28.315424+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:28.315424+0000","last_undegraded":"2024-09-10T15:27:28.315424+0000","last_fullsized":"2024-09-10T15:27:28.315424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":20,"num_read_kb":53254,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947595+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:27:28.947595+0000","last_peered":"2024-09-10T15:27:28.947595+0000","last_clean":"2024-09-10T15:27:28.947595+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:27:28.947595+0000","last_undegraded":"2024-09-10T15:27:28.947595+0000","last_fullsized":"2024-09-10T15:27:28.947595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315275+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:27:28.315275+0000","last_peered":"2024-09-10T15:27:28.315275+0000","last_clean":"2024-09-10T15:27:28.315275+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:27:28.315275+0000","last_undegraded":"2024-09-10T15:27:28.315275+0000","last_fullsized":"2024-09-10T15:27:28.315275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490207+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490207+0000","last_peered":"2024-09-10T15:27:28.490207+0000","last_clean":"2024-09-10T15:27:28.490207+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490207+0000","last_undegraded":"2024-09-10T15:27:28.490207+0000","last_fullsized":"2024-09-10T15:27:28.490207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414460+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:28.414460+0000","last_peered":"2024-09-10T15:27:28.414460+0000","last_clean":"2024-09-10T15:27:28.414460+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:28.414460+0000","last_undegraded":"2024-09-10T15:27:28.414460+0000","last_fullsized":"2024-09-10T15:27:28.414460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":18,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313708+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:27:28.313708+0000","last_peered":"2024-09-10T15:27:28.313708+0000","last_clean":"2024-09-10T15:27:28.313708+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:27:28.313708+0000","last_undegraded":"2024-09-10T15:27:28.313708+0000","last_fullsized":"2024-09-10T15:27:28.313708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"70'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493135+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:27:28.493135+0000","last_peered":"2024-09-10T15:27:28.493135+0000","last_clean":"2024-09-10T15:27:28.493135+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:27:28.493135+0000","last_undegraded":"2024-09-10T15:27:28.493135+0000","last_fullsized":"2024-09-10T15:27:28.493135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947471+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:27:28.947471+0000","last_peered":"2024-09-10T15:27:28.947471+0000","last_clean":"2024-09-10T15:27:28.947471+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:27:28.947471+0000","last_undegraded":"2024-09-10T15:27:28.947471+0000","last_fullsized":"2024-09-10T15:27:28.947471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414474+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:28.414474+0000","last_peered":"2024-09-10T15:27:28.414474+0000","last_clean":"2024-09-10T15:27:28.414474+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:28.414474+0000","last_undegraded":"2024-09-10T15:27:28.414474+0000","last_fullsized":"2024-09-10T15:27:28.414474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"70'7","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415267+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:28.415267+0000","last_peered":"2024-09-10T15:27:28.415267+0000","last_clean":"2024-09-10T15:27:28.415267+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:28.415267+0000","last_undegraded":"2024-09-10T15:27:28.415267+0000","last_fullsized":"2024-09-10T15:27:28.415267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315839+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:27:28.315839+0000","last_peered":"2024-09-10T15:27:28.315839+0000","last_clean":"2024-09-10T15:27:28.315839+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:27:28.315839+0000","last_undegraded":"2024-09-10T15:27:28.315839+0000","last_fullsized":"2024-09-10T15:27:28.315839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"71'4","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693307+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:28.693307+0000","last_peered":"2024-09-10T15:27:28.693307+0000","last_clean":"2024-09-10T15:27:28.693307+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:28.693307+0000","last_undegraded":"2024-09-10T15:27:28.693307+0000","last_fullsized":"2024-09-10T15:27:28.693307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948341+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:27:28.948341+0000","last_peered":"2024-09-10T15:27:28.948341+0000","last_clean":"2024-09-10T15:27:28.948341+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:27:28.948341+0000","last_undegraded":"2024-09-10T15:27:28.948341+0000","last_fullsized":"2024-09-10T15:27:28.948341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238917,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":923,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":271476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":277991424,"data_stored":277466410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405080,"kb_used_data":373880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93966760,"statfs":{"total":96636764160,"available":96221962240,"internally_reserved":0,"allocated":382853120,"data_stored":382316635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434332,"kb_used_data":403136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93937508,"statfs":{"total":96636764160,"available":96192008192,"internally_reserved":0,"allocated":412811264,"data_stored":412275769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370296,"kb_used_data":339104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94001544,"statfs":{"total":96636764160,"available":96257581056,"internally_reserved":0,"allocated":347242496,"data_stored":346695811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":509504,"kb_used_data":478316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93862336,"statfs":{"total":96636764160,"available":96115032064,"internally_reserved":0,"allocated":489795584,"data_stored":489272490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501288,"kb_used_data":470096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93870552,"statfs":{"total":96636764160,"available":96123445248,"internally_reserved":0,"allocated":481378304,"data_stored":480880706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356568,"kb_used_data":325376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94015272,"statfs":{"total":96636764160,"available":96271638528,"internally_reserved":0,"allocated":333185024,"data_stored":332610464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575120,"kb_used_data":543928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93796720,"statfs":{"total":96636764160,"available":96047841280,"internally_reserved":0,"allocated":556982272,"data_stored":556408695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":555745280,"data_stored":555745280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":346030080,"data_stored":346030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":35596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":30035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":28726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:27:33.245 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:27:33.607 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:27:33.615 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:27:33.630 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-10T15:27:32.968055+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609477,"num_objects":639,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":639,"num_whiteouts":0,"num_read":3875,"num_read_kb":2050994,"num_write":3330,"num_write_kb":2051084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1981,"ondisk_log_size":1981,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3454856,"kb_used_data":3205312,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751519864,"statfs":{"total":773094113280,"available":769556340736,"internally_reserved":0,"allocated":3282239488,"data_stored":3277926980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.672337"},"pg_stats":[{"pgid":"3.3f","version":"76'7","reported_seq":109,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492506+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:28.492506+0000","last_peered":"2024-09-10T15:27:28.492506+0000","last_clean":"2024-09-10T15:27:28.492506+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:28.492506+0000","last_undegraded":"2024-09-10T15:27:28.492506+0000","last_fullsized":"2024-09-10T15:27:28.492506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:35.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947344+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:28.947344+0000","last_peered":"2024-09-10T15:27:28.947344+0000","last_clean":"2024-09-10T15:27:28.947344+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:28.947344+0000","last_undegraded":"2024-09-10T15:27:28.947344+0000","last_fullsized":"2024-09-10T15:27:28.947344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696971+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:27:28.696971+0000","last_peered":"2024-09-10T15:27:28.696971+0000","last_clean":"2024-09-10T15:27:28.696971+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:27:28.696971+0000","last_undegraded":"2024-09-10T15:27:28.696971+0000","last_fullsized":"2024-09-10T15:27:28.696971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415197+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:28.415197+0000","last_peered":"2024-09-10T15:27:28.415197+0000","last_clean":"2024-09-10T15:27:28.415197+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:28.415197+0000","last_undegraded":"2024-09-10T15:27:28.415197+0000","last_fullsized":"2024-09-10T15:27:28.415197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"76'16","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693506+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:28.693506+0000","last_peered":"2024-09-10T15:27:28.693506+0000","last_clean":"2024-09-10T15:27:28.693506+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:28.693506+0000","last_undegraded":"2024-09-10T15:27:28.693506+0000","last_fullsized":"2024-09-10T15:27:28.693506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415200+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:27:28.415200+0000","last_peered":"2024-09-10T15:27:28.415200+0000","last_clean":"2024-09-10T15:27:28.415200+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:27:28.415200+0000","last_undegraded":"2024-09-10T15:27:28.415200+0000","last_fullsized":"2024-09-10T15:27:28.415200+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"71'2","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315609+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:27:28.315609+0000","last_peered":"2024-09-10T15:27:28.315609+0000","last_clean":"2024-09-10T15:27:28.315609+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:27:28.315609+0000","last_undegraded":"2024-09-10T15:27:28.315609+0000","last_fullsized":"2024-09-10T15:27:28.315609+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'15","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314458+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:27:28.314458+0000","last_peered":"2024-09-10T15:27:28.314458+0000","last_clean":"2024-09-10T15:27:28.314458+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:27:28.314458+0000","last_undegraded":"2024-09-10T15:27:28.314458+0000","last_fullsized":"2024-09-10T15:27:28.314458+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":45074,"num_write":45,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314283+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:27:28.314283+0000","last_peered":"2024-09-10T15:27:28.314283+0000","last_clean":"2024-09-10T15:27:28.314283+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:27:28.314283+0000","last_undegraded":"2024-09-10T15:27:28.314283+0000","last_fullsized":"2024-09-10T15:27:28.314283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"76'12","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339817+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:27:28.339817+0000","last_peered":"2024-09-10T15:27:28.339817+0000","last_clean":"2024-09-10T15:27:28.339817+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:27:28.339817+0000","last_undegraded":"2024-09-10T15:27:28.339817+0000","last_fullsized":"2024-09-10T15:27:28.339817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315735+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:27:28.315735+0000","last_peered":"2024-09-10T15:27:28.315735+0000","last_clean":"2024-09-10T15:27:28.315735+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:27:28.315735+0000","last_undegraded":"2024-09-10T15:27:28.315735+0000","last_fullsized":"2024-09-10T15:27:28.315735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314686+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:27:28.314686+0000","last_peered":"2024-09-10T15:27:28.314686+0000","last_clean":"2024-09-10T15:27:28.314686+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:27:28.314686+0000","last_undegraded":"2024-09-10T15:27:28.314686+0000","last_fullsized":"2024-09-10T15:27:28.314686+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341680+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:27:28.341680+0000","last_peered":"2024-09-10T15:27:28.341680+0000","last_clean":"2024-09-10T15:27:28.341680+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:27:28.341680+0000","last_undegraded":"2024-09-10T15:27:28.341680+0000","last_fullsized":"2024-09-10T15:27:28.341680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"76'12","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693194+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:28.693194+0000","last_peered":"2024-09-10T15:27:28.693194+0000","last_clean":"2024-09-10T15:27:28.693194+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:28.693194+0000","last_undegraded":"2024-09-10T15:27:28.693194+0000","last_fullsized":"2024-09-10T15:27:28.693194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697665+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:27:28.697665+0000","last_peered":"2024-09-10T15:27:28.697665+0000","last_clean":"2024-09-10T15:27:28.697665+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:27:28.697665+0000","last_undegraded":"2024-09-10T15:27:28.697665+0000","last_fullsized":"2024-09-10T15:27:28.697665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415014+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:28.415014+0000","last_peered":"2024-09-10T15:27:28.415014+0000","last_clean":"2024-09-10T15:27:28.415014+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:28.415014+0000","last_undegraded":"2024-09-10T15:27:28.415014+0000","last_fullsized":"2024-09-10T15:27:28.415014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'10","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948574+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:27:28.948574+0000","last_peered":"2024-09-10T15:27:28.948574+0000","last_clean":"2024-09-10T15:27:28.948574+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:27:28.948574+0000","last_undegraded":"2024-09-10T15:27:28.948574+0000","last_fullsized":"2024-09-10T15:27:28.948574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314356+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:27:28.314356+0000","last_peered":"2024-09-10T15:27:28.314356+0000","last_clean":"2024-09-10T15:27:28.314356+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:27:28.314356+0000","last_undegraded":"2024-09-10T15:27:28.314356+0000","last_fullsized":"2024-09-10T15:27:28.314356+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315753+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:27:28.315753+0000","last_peered":"2024-09-10T15:27:28.315753+0000","last_clean":"2024-09-10T15:27:28.315753+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:27:28.315753+0000","last_undegraded":"2024-09-10T15:27:28.315753+0000","last_fullsized":"2024-09-10T15:27:28.315753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948004+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:27:28.948004+0000","last_peered":"2024-09-10T15:27:28.948004+0000","last_clean":"2024-09-10T15:27:28.948004+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:27:28.948004+0000","last_undegraded":"2024-09-10T15:27:28.948004+0000","last_fullsized":"2024-09-10T15:27:28.948004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"70'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316138+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:27:28.316138+0000","last_peered":"2024-09-10T15:27:28.316138+0000","last_clean":"2024-09-10T15:27:28.316138+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:27:28.316138+0000","last_undegraded":"2024-09-10T15:27:28.316138+0000","last_fullsized":"2024-09-10T15:27:28.316138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":34816,"num_write":10,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333287+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:27:28.333287+0000","last_peered":"2024-09-10T15:27:28.333287+0000","last_clean":"2024-09-10T15:27:28.333287+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:27:28.333287+0000","last_undegraded":"2024-09-10T15:27:28.333287+0000","last_fullsized":"2024-09-10T15:27:28.333287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314957+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:27:28.314957+0000","last_peered":"2024-09-10T15:27:28.314957+0000","last_clean":"2024-09-10T15:27:28.314957+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:27:28.314957+0000","last_undegraded":"2024-09-10T15:27:28.314957+0000","last_fullsized":"2024-09-10T15:27:28.314957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695584+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:27:28.695584+0000","last_peered":"2024-09-10T15:27:28.695584+0000","last_clean":"2024-09-10T15:27:28.695584+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:27:28.695584+0000","last_undegraded":"2024-09-10T15:27:28.695584+0000","last_fullsized":"2024-09-10T15:27:28.695584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331238+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:27:28.331238+0000","last_peered":"2024-09-10T15:27:28.331238+0000","last_clean":"2024-09-10T15:27:28.331238+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:27:28.331238+0000","last_undegraded":"2024-09-10T15:27:28.331238+0000","last_fullsized":"2024-09-10T15:27:28.331238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948009+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:28.948009+0000","last_peered":"2024-09-10T15:27:28.948009+0000","last_clean":"2024-09-10T15:27:28.948009+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:28.948009+0000","last_undegraded":"2024-09-10T15:27:28.948009+0000","last_fullsized":"2024-09-10T15:27:28.948009+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"76'12","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313280+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:27:28.313280+0000","last_peered":"2024-09-10T15:27:28.313280+0000","last_clean":"2024-09-10T15:27:28.313280+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:27:28.313280+0000","last_undegraded":"2024-09-10T15:27:28.313280+0000","last_fullsized":"2024-09-10T15:27:28.313280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:57.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312903+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:28.312903+0000","last_peered":"2024-09-10T15:27:28.312903+0000","last_clean":"2024-09-10T15:27:28.312903+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:28.312903+0000","last_undegraded":"2024-09-10T15:27:28.312903+0000","last_fullsized":"2024-09-10T15:27:28.312903+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333674+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:27:28.333674+0000","last_peered":"2024-09-10T15:27:28.333674+0000","last_clean":"2024-09-10T15:27:28.333674+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:27:28.333674+0000","last_undegraded":"2024-09-10T15:27:28.333674+0000","last_fullsized":"2024-09-10T15:27:28.333674+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414255+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:28.414255+0000","last_peered":"2024-09-10T15:27:28.414255+0000","last_clean":"2024-09-10T15:27:28.414255+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:28.414255+0000","last_undegraded":"2024-09-10T15:27:28.414255+0000","last_fullsized":"2024-09-10T15:27:28.414255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416647+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:27:28.416647+0000","last_peered":"2024-09-10T15:27:28.416647+0000","last_clean":"2024-09-10T15:27:28.416647+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:27:28.416647+0000","last_undegraded":"2024-09-10T15:27:28.416647+0000","last_fullsized":"2024-09-10T15:27:28.416647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"76'19","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315306+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:27:28.315306+0000","last_peered":"2024-09-10T15:27:28.315306+0000","last_clean":"2024-09-10T15:27:28.315306+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:27:28.315306+0000","last_undegraded":"2024-09-10T15:27:28.315306+0000","last_fullsized":"2024-09-10T15:27:28.315306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":48,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948263+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:28.948263+0000","last_peered":"2024-09-10T15:27:28.948263+0000","last_clean":"2024-09-10T15:27:28.948263+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:28.948263+0000","last_undegraded":"2024-09-10T15:27:28.948263+0000","last_fullsized":"2024-09-10T15:27:28.948263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947099+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:28.947099+0000","last_peered":"2024-09-10T15:27:28.947099+0000","last_clean":"2024-09-10T15:27:28.947099+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:28.947099+0000","last_undegraded":"2024-09-10T15:27:28.947099+0000","last_fullsized":"2024-09-10T15:27:28.947099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416300+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:28.416300+0000","last_peered":"2024-09-10T15:27:28.416300+0000","last_clean":"2024-09-10T15:27:28.416300+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:28.416300+0000","last_undegraded":"2024-09-10T15:27:28.416300+0000","last_fullsized":"2024-09-10T15:27:28.416300+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332989+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:27:28.332989+0000","last_peered":"2024-09-10T15:27:28.332989+0000","last_clean":"2024-09-10T15:27:28.332989+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:27:28.332989+0000","last_undegraded":"2024-09-10T15:27:28.332989+0000","last_fullsized":"2024-09-10T15:27:28.332989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314591+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:27:28.314591+0000","last_peered":"2024-09-10T15:27:28.314591+0000","last_clean":"2024-09-10T15:27:28.314591+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:27:28.314591+0000","last_undegraded":"2024-09-10T15:27:28.314591+0000","last_fullsized":"2024-09-10T15:27:28.314591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948326+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:27:28.948326+0000","last_peered":"2024-09-10T15:27:28.948326+0000","last_clean":"2024-09-10T15:27:28.948326+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:27:28.948326+0000","last_undegraded":"2024-09-10T15:27:28.948326+0000","last_fullsized":"2024-09-10T15:27:28.948326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948156+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:28.948156+0000","last_peered":"2024-09-10T15:27:28.948156+0000","last_clean":"2024-09-10T15:27:28.948156+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:28.948156+0000","last_undegraded":"2024-09-10T15:27:28.948156+0000","last_fullsized":"2024-09-10T15:27:28.948156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331643+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:28.331643+0000","last_peered":"2024-09-10T15:27:28.331643+0000","last_clean":"2024-09-10T15:27:28.331643+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:28.331643+0000","last_undegraded":"2024-09-10T15:27:28.331643+0000","last_fullsized":"2024-09-10T15:27:28.331643+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696783+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:27:28.696783+0000","last_peered":"2024-09-10T15:27:28.696783+0000","last_clean":"2024-09-10T15:27:28.696783+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:27:28.696783+0000","last_undegraded":"2024-09-10T15:27:28.696783+0000","last_fullsized":"2024-09-10T15:27:28.696783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415343+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:28.415343+0000","last_peered":"2024-09-10T15:27:28.415343+0000","last_clean":"2024-09-10T15:27:28.415343+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:28.415343+0000","last_undegraded":"2024-09-10T15:27:28.415343+0000","last_fullsized":"2024-09-10T15:27:28.415343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315663+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:28.315663+0000","last_peered":"2024-09-10T15:27:28.315663+0000","last_clean":"2024-09-10T15:27:28.315663+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:28.315663+0000","last_undegraded":"2024-09-10T15:27:28.315663+0000","last_fullsized":"2024-09-10T15:27:28.315663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314318+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:28.314318+0000","last_peered":"2024-09-10T15:27:28.314318+0000","last_clean":"2024-09-10T15:27:28.314318+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:28.314318+0000","last_undegraded":"2024-09-10T15:27:28.314318+0000","last_fullsized":"2024-09-10T15:27:28.314318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"76'14","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416702+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:27:28.416702+0000","last_peered":"2024-09-10T15:27:28.416702+0000","last_clean":"2024-09-10T15:27:28.416702+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:27:28.416702+0000","last_undegraded":"2024-09-10T15:27:28.416702+0000","last_fullsized":"2024-09-10T15:27:28.416702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340580+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:28.340580+0000","last_peered":"2024-09-10T15:27:28.340580+0000","last_clean":"2024-09-10T15:27:28.340580+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:28.340580+0000","last_undegraded":"2024-09-10T15:27:28.340580+0000","last_fullsized":"2024-09-10T15:27:28.340580+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696860+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:27:28.696860+0000","last_peered":"2024-09-10T15:27:28.696860+0000","last_clean":"2024-09-10T15:27:28.696860+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:27:28.696860+0000","last_undegraded":"2024-09-10T15:27:28.696860+0000","last_fullsized":"2024-09-10T15:27:28.696860+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"76'8","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947752+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:28.947752+0000","last_peered":"2024-09-10T15:27:28.947752+0000","last_clean":"2024-09-10T15:27:28.947752+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:28.947752+0000","last_undegraded":"2024-09-10T15:27:28.947752+0000","last_fullsized":"2024-09-10T15:27:28.947752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20492,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416251+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:27:28.416251+0000","last_peered":"2024-09-10T15:27:28.416251+0000","last_clean":"2024-09-10T15:27:28.416251+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:27:28.416251+0000","last_undegraded":"2024-09-10T15:27:28.416251+0000","last_fullsized":"2024-09-10T15:27:28.416251+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"76'18","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341390+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:27:28.341390+0000","last_peered":"2024-09-10T15:27:28.341390+0000","last_clean":"2024-09-10T15:27:28.341390+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:27:28.341390+0000","last_undegraded":"2024-09-10T15:27:28.341390+0000","last_fullsized":"2024-09-10T15:27:28.341390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":43,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"76'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693890+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:27:28.693890+0000","last_peered":"2024-09-10T15:27:28.693890+0000","last_clean":"2024-09-10T15:27:28.693890+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:27:28.693890+0000","last_undegraded":"2024-09-10T15:27:28.693890+0000","last_fullsized":"2024-09-10T15:27:28.693890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415061+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415061+0000","last_peered":"2024-09-10T15:27:28.415061+0000","last_clean":"2024-09-10T15:27:28.415061+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415061+0000","last_undegraded":"2024-09-10T15:27:28.415061+0000","last_fullsized":"2024-09-10T15:27:28.415061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"76'7","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316110+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:27:28.316110+0000","last_peered":"2024-09-10T15:27:28.316110+0000","last_clean":"2024-09-10T15:27:28.316110+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:27:28.316110+0000","last_undegraded":"2024-09-10T15:27:28.316110+0000","last_fullsized":"2024-09-10T15:27:28.316110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":27,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947301+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:27:28.947301+0000","last_peered":"2024-09-10T15:27:28.947301+0000","last_clean":"2024-09-10T15:27:28.947301+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:27:28.947301+0000","last_undegraded":"2024-09-10T15:27:28.947301+0000","last_fullsized":"2024-09-10T15:27:28.947301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313995+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:28.313995+0000","last_peered":"2024-09-10T15:27:28.313995+0000","last_clean":"2024-09-10T15:27:28.313995+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:28.313995+0000","last_undegraded":"2024-09-10T15:27:28.313995+0000","last_fullsized":"2024-09-10T15:27:28.313995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332881+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:28.332881+0000","last_peered":"2024-09-10T15:27:28.332881+0000","last_clean":"2024-09-10T15:27:28.332881+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:28.332881+0000","last_undegraded":"2024-09-10T15:27:28.332881+0000","last_fullsized":"2024-09-10T15:27:28.332881+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341427+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341427+0000","last_peered":"2024-09-10T15:27:28.341427+0000","last_clean":"2024-09-10T15:27:28.341427+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341427+0000","last_undegraded":"2024-09-10T15:27:28.341427+0000","last_fullsized":"2024-09-10T15:27:28.341427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947386+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:27:28.947386+0000","last_peered":"2024-09-10T15:27:28.947386+0000","last_clean":"2024-09-10T15:27:28.947386+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:27:28.947386+0000","last_undegraded":"2024-09-10T15:27:28.947386+0000","last_fullsized":"2024-09-10T15:27:28.947386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339988+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:27:28.339988+0000","last_peered":"2024-09-10T15:27:28.339988+0000","last_clean":"2024-09-10T15:27:28.339988+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:27:28.339988+0000","last_undegraded":"2024-09-10T15:27:28.339988+0000","last_fullsized":"2024-09-10T15:27:28.339988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":32786,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331759+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:27:28.331759+0000","last_peered":"2024-09-10T15:27:28.331759+0000","last_clean":"2024-09-10T15:27:28.331759+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:27:28.331759+0000","last_undegraded":"2024-09-10T15:27:28.331759+0000","last_fullsized":"2024-09-10T15:27:28.331759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314343+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:27:28.314343+0000","last_peered":"2024-09-10T15:27:28.314343+0000","last_clean":"2024-09-10T15:27:28.314343+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:27:28.314343+0000","last_undegraded":"2024-09-10T15:27:28.314343+0000","last_fullsized":"2024-09-10T15:27:28.314343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313427+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:28.313427+0000","last_peered":"2024-09-10T15:27:28.313427+0000","last_clean":"2024-09-10T15:27:28.313427+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:28.313427+0000","last_undegraded":"2024-09-10T15:27:28.313427+0000","last_fullsized":"2024-09-10T15:27:28.313427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947771+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947771+0000","last_peered":"2024-09-10T15:27:28.947771+0000","last_clean":"2024-09-10T15:27:28.947771+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947771+0000","last_undegraded":"2024-09-10T15:27:28.947771+0000","last_fullsized":"2024-09-10T15:27:28.947771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340664+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:27:28.340664+0000","last_peered":"2024-09-10T15:27:28.340664+0000","last_clean":"2024-09-10T15:27:28.340664+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:27:28.340664+0000","last_undegraded":"2024-09-10T15:27:28.340664+0000","last_fullsized":"2024-09-10T15:27:28.340664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"69'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416098+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:28.416098+0000","last_peered":"2024-09-10T15:27:28.416098+0000","last_clean":"2024-09-10T15:27:28.416098+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:28.416098+0000","last_undegraded":"2024-09-10T15:27:28.416098+0000","last_fullsized":"2024-09-10T15:27:28.416098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695255+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:28.695255+0000","last_peered":"2024-09-10T15:27:28.695255+0000","last_clean":"2024-09-10T15:27:28.695255+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:28.695255+0000","last_undegraded":"2024-09-10T15:27:28.695255+0000","last_fullsized":"2024-09-10T15:27:28.695255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414864+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:27:28.414864+0000","last_peered":"2024-09-10T15:27:28.414864+0000","last_clean":"2024-09-10T15:27:28.414864+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:27:28.414864+0000","last_undegraded":"2024-09-10T15:27:28.414864+0000","last_fullsized":"2024-09-10T15:27:28.414864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"76'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693521+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:27:28.693521+0000","last_peered":"2024-09-10T15:27:28.693521+0000","last_clean":"2024-09-10T15:27:28.693521+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:27:28.693521+0000","last_undegraded":"2024-09-10T15:27:28.693521+0000","last_fullsized":"2024-09-10T15:27:28.693521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334472+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:28.334472+0000","last_peered":"2024-09-10T15:27:28.334472+0000","last_clean":"2024-09-10T15:27:28.334472+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:28.334472+0000","last_undegraded":"2024-09-10T15:27:28.334472+0000","last_fullsized":"2024-09-10T15:27:28.334472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696128+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:27:28.696128+0000","last_peered":"2024-09-10T15:27:28.696128+0000","last_clean":"2024-09-10T15:27:28.696128+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:27:28.696128+0000","last_undegraded":"2024-09-10T15:27:28.696128+0000","last_fullsized":"2024-09-10T15:27:28.696128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'12","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315573+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:27:28.315573+0000","last_peered":"2024-09-10T15:27:28.315573+0000","last_clean":"2024-09-10T15:27:28.315573+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:27:28.315573+0000","last_undegraded":"2024-09-10T15:27:28.315573+0000","last_fullsized":"2024-09-10T15:27:28.315573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332058+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:27:28.332058+0000","last_peered":"2024-09-10T15:27:28.332058+0000","last_clean":"2024-09-10T15:27:28.332058+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:27:28.332058+0000","last_undegraded":"2024-09-10T15:27:28.332058+0000","last_fullsized":"2024-09-10T15:27:28.332058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'25","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312917+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:27:28.312917+0000","last_peered":"2024-09-10T15:27:28.312917+0000","last_clean":"2024-09-10T15:27:28.312917+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:27:28.312917+0000","last_undegraded":"2024-09-10T15:27:28.312917+0000","last_fullsized":"2024-09-10T15:27:28.312917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":32,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694504+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:27:28.694504+0000","last_peered":"2024-09-10T15:27:28.694504+0000","last_clean":"2024-09-10T15:27:28.694504+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:27:28.694504+0000","last_undegraded":"2024-09-10T15:27:28.694504+0000","last_fullsized":"2024-09-10T15:27:28.694504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492730+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:28.492730+0000","last_peered":"2024-09-10T15:27:28.492730+0000","last_clean":"2024-09-10T15:27:28.492730+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:28.492730+0000","last_undegraded":"2024-09-10T15:27:28.492730+0000","last_fullsized":"2024-09-10T15:27:28.492730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315251+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.315251+0000","last_peered":"2024-09-10T15:27:28.315251+0000","last_clean":"2024-09-10T15:27:28.315251+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:27:28.315251+0000","last_undegraded":"2024-09-10T15:27:28.315251+0000","last_fullsized":"2024-09-10T15:27:28.315251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490986+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:27:28.490986+0000","last_peered":"2024-09-10T15:27:28.490986+0000","last_clean":"2024-09-10T15:27:28.490986+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:27:28.490986+0000","last_undegraded":"2024-09-10T15:27:28.490986+0000","last_fullsized":"2024-09-10T15:27:28.490986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491173+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:27:28.491173+0000","last_peered":"2024-09-10T15:27:28.491173+0000","last_clean":"2024-09-10T15:27:28.491173+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:27:28.491173+0000","last_undegraded":"2024-09-10T15:27:28.491173+0000","last_fullsized":"2024-09-10T15:27:28.491173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"76'18","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948238+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:27:28.948238+0000","last_peered":"2024-09-10T15:27:28.948238+0000","last_clean":"2024-09-10T15:27:28.948238+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:27:28.948238+0000","last_undegraded":"2024-09-10T15:27:28.948238+0000","last_fullsized":"2024-09-10T15:27:28.948238+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":27,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489211+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:28.489211+0000","last_peered":"2024-09-10T15:27:28.489211+0000","last_clean":"2024-09-10T15:27:28.489211+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:28.489211+0000","last_undegraded":"2024-09-10T15:27:28.489211+0000","last_fullsized":"2024-09-10T15:27:28.489211+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693570+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693570+0000","last_peered":"2024-09-10T15:27:28.693570+0000","last_clean":"2024-09-10T15:27:28.693570+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693570+0000","last_undegraded":"2024-09-10T15:27:28.693570+0000","last_fullsized":"2024-09-10T15:27:28.693570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416540+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416540+0000","last_peered":"2024-09-10T15:27:28.416540+0000","last_clean":"2024-09-10T15:27:28.416540+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416540+0000","last_undegraded":"2024-09-10T15:27:28.416540+0000","last_fullsized":"2024-09-10T15:27:28.416540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"76'6","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415506+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:28.415506+0000","last_peered":"2024-09-10T15:27:28.415506+0000","last_clean":"2024-09-10T15:27:28.415506+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:28.415506+0000","last_undegraded":"2024-09-10T15:27:28.415506+0000","last_fullsized":"2024-09-10T15:27:28.415506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696078+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:28.696078+0000","last_peered":"2024-09-10T15:27:28.696078+0000","last_clean":"2024-09-10T15:27:28.696078+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:28.696078+0000","last_undegraded":"2024-09-10T15:27:28.696078+0000","last_fullsized":"2024-09-10T15:27:28.696078+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"76'19","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695963+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:28.695963+0000","last_peered":"2024-09-10T15:27:28.695963+0000","last_clean":"2024-09-10T15:27:28.695963+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:28.695963+0000","last_undegraded":"2024-09-10T15:27:28.695963+0000","last_fullsized":"2024-09-10T15:27:28.695963+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492088+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:27:28.492088+0000","last_peered":"2024-09-10T15:27:28.492088+0000","last_clean":"2024-09-10T15:27:28.492088+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:27:28.492088+0000","last_undegraded":"2024-09-10T15:27:28.492088+0000","last_fullsized":"2024-09-10T15:27:28.492088+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331612+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331612+0000","last_peered":"2024-09-10T15:27:28.331612+0000","last_clean":"2024-09-10T15:27:28.331612+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331612+0000","last_undegraded":"2024-09-10T15:27:28.331612+0000","last_fullsized":"2024-09-10T15:27:28.331612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341512+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341512+0000","last_peered":"2024-09-10T15:27:28.341512+0000","last_clean":"2024-09-10T15:27:28.341512+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341512+0000","last_undegraded":"2024-09-10T15:27:28.341512+0000","last_fullsized":"2024-09-10T15:27:28.341512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"71'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414253+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:28.414253+0000","last_peered":"2024-09-10T15:27:28.414253+0000","last_clean":"2024-09-10T15:27:28.414253+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:28.414253+0000","last_undegraded":"2024-09-10T15:27:28.414253+0000","last_fullsized":"2024-09-10T15:27:28.414253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948449+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:27:28.948449+0000","last_peered":"2024-09-10T15:27:28.948449+0000","last_clean":"2024-09-10T15:27:28.948449+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:27:28.948449+0000","last_undegraded":"2024-09-10T15:27:28.948449+0000","last_fullsized":"2024-09-10T15:27:28.948449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333188+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:28.333188+0000","last_peered":"2024-09-10T15:27:28.333188+0000","last_clean":"2024-09-10T15:27:28.333188+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:28.333188+0000","last_undegraded":"2024-09-10T15:27:28.333188+0000","last_fullsized":"2024-09-10T15:27:28.333188+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"76'14","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947945+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:27:28.947945+0000","last_peered":"2024-09-10T15:27:28.947945+0000","last_clean":"2024-09-10T15:27:28.947945+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:27:28.947945+0000","last_undegraded":"2024-09-10T15:27:28.947945+0000","last_fullsized":"2024-09-10T15:27:28.947945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340473+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340473+0000","last_peered":"2024-09-10T15:27:28.340473+0000","last_clean":"2024-09-10T15:27:28.340473+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340473+0000","last_undegraded":"2024-09-10T15:27:28.340473+0000","last_fullsized":"2024-09-10T15:27:28.340473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493307+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:27:28.493307+0000","last_peered":"2024-09-10T15:27:28.493307+0000","last_clean":"2024-09-10T15:27:28.493307+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:27:28.493307+0000","last_undegraded":"2024-09-10T15:27:28.493307+0000","last_fullsized":"2024-09-10T15:27:28.493307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"76'11","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313936+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:28.313936+0000","last_peered":"2024-09-10T15:27:28.313936+0000","last_clean":"2024-09-10T15:27:28.313936+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:28.313936+0000","last_undegraded":"2024-09-10T15:27:28.313936+0000","last_fullsized":"2024-09-10T15:27:28.313936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416658+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:27:28.416658+0000","last_peered":"2024-09-10T15:27:28.416658+0000","last_clean":"2024-09-10T15:27:28.416658+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:27:28.416658+0000","last_undegraded":"2024-09-10T15:27:28.416658+0000","last_fullsized":"2024-09-10T15:27:28.416658+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"76'21","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947848+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:27:28.947848+0000","last_peered":"2024-09-10T15:27:28.947848+0000","last_clean":"2024-09-10T15:27:28.947848+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:27:28.947848+0000","last_undegraded":"2024-09-10T15:27:28.947848+0000","last_fullsized":"2024-09-10T15:27:28.947848+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341970+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:28.341970+0000","last_peered":"2024-09-10T15:27:28.341970+0000","last_clean":"2024-09-10T15:27:28.341970+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:28.341970+0000","last_undegraded":"2024-09-10T15:27:28.341970+0000","last_fullsized":"2024-09-10T15:27:28.341970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489952+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.489952+0000","last_peered":"2024-09-10T15:27:28.489952+0000","last_clean":"2024-09-10T15:27:28.489952+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.489952+0000","last_undegraded":"2024-09-10T15:27:28.489952+0000","last_fullsized":"2024-09-10T15:27:28.489952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416212+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416212+0000","last_peered":"2024-09-10T15:27:28.416212+0000","last_clean":"2024-09-10T15:27:28.416212+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416212+0000","last_undegraded":"2024-09-10T15:27:28.416212+0000","last_fullsized":"2024-09-10T15:27:28.416212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":315,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947773+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:27:28.947773+0000","last_peered":"2024-09-10T15:27:28.947773+0000","last_clean":"2024-09-10T15:27:28.947773+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:27:28.947773+0000","last_undegraded":"2024-09-10T15:27:28.947773+0000","last_fullsized":"2024-09-10T15:27:28.947773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415740+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415740+0000","last_peered":"2024-09-10T15:27:28.415740+0000","last_clean":"2024-09-10T15:27:28.415740+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415740+0000","last_undegraded":"2024-09-10T15:27:28.415740+0000","last_fullsized":"2024-09-10T15:27:28.415740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314357+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:28.314357+0000","last_peered":"2024-09-10T15:27:28.314357+0000","last_clean":"2024-09-10T15:27:28.314357+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:28.314357+0000","last_undegraded":"2024-09-10T15:27:28.314357+0000","last_fullsized":"2024-09-10T15:27:28.314357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":49176,"num_write":56,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314018+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:27:28.314018+0000","last_peered":"2024-09-10T15:27:28.314018+0000","last_clean":"2024-09-10T15:27:28.314018+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:27:28.314018+0000","last_undegraded":"2024-09-10T15:27:28.314018+0000","last_fullsized":"2024-09-10T15:27:28.314018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'30","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416630+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:27:28.416630+0000","last_peered":"2024-09-10T15:27:28.416630+0000","last_clean":"2024-09-10T15:27:28.416630+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:27:28.416630+0000","last_undegraded":"2024-09-10T15:27:28.416630+0000","last_fullsized":"2024-09-10T15:27:28.416630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28500,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693638+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:27:28.693638+0000","last_peered":"2024-09-10T15:27:28.693638+0000","last_clean":"2024-09-10T15:27:28.693638+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:27:28.693638+0000","last_undegraded":"2024-09-10T15:27:28.693638+0000","last_fullsized":"2024-09-10T15:27:28.693638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313993+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:28.313993+0000","last_peered":"2024-09-10T15:27:28.313993+0000","last_clean":"2024-09-10T15:27:28.313993+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:28.313993+0000","last_undegraded":"2024-09-10T15:27:28.313993+0000","last_fullsized":"2024-09-10T15:27:28.313993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696870+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:27:28.696870+0000","last_peered":"2024-09-10T15:27:28.696870+0000","last_clean":"2024-09-10T15:27:28.696870+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:27:28.696870+0000","last_undegraded":"2024-09-10T15:27:28.696870+0000","last_fullsized":"2024-09-10T15:27:28.696870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415458+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415458+0000","last_peered":"2024-09-10T15:27:28.415458+0000","last_clean":"2024-09-10T15:27:28.415458+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415458+0000","last_undegraded":"2024-09-10T15:27:28.415458+0000","last_fullsized":"2024-09-10T15:27:28.415458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"76'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332661+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:27:28.332661+0000","last_peered":"2024-09-10T15:27:28.332661+0000","last_clean":"2024-09-10T15:27:28.332661+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:27:28.332661+0000","last_undegraded":"2024-09-10T15:27:28.332661+0000","last_fullsized":"2024-09-10T15:27:28.332661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":24,"num_read_kb":49164,"num_write":36,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416394+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:27:28.416394+0000","last_peered":"2024-09-10T15:27:28.416394+0000","last_clean":"2024-09-10T15:27:28.416394+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:27:28.416394+0000","last_undegraded":"2024-09-10T15:27:28.416394+0000","last_fullsized":"2024-09-10T15:27:28.416394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"76'48","reported_seq":230,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491018+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:27:28.491018+0000","last_peered":"2024-09-10T15:27:28.491018+0000","last_clean":"2024-09-10T15:27:28.491018+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:27:28.491018+0000","last_undegraded":"2024-09-10T15:27:28.491018+0000","last_fullsized":"2024-09-10T15:27:28.491018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":85,"num_write":48,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416482+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:27:28.416482+0000","last_peered":"2024-09-10T15:27:28.416482+0000","last_clean":"2024-09-10T15:27:28.416482+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:27:28.416482+0000","last_undegraded":"2024-09-10T15:27:28.416482+0000","last_fullsized":"2024-09-10T15:27:28.416482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694797+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:28.694797+0000","last_peered":"2024-09-10T15:27:28.694797+0000","last_clean":"2024-09-10T15:27:28.694797+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:28.694797+0000","last_undegraded":"2024-09-10T15:27:28.694797+0000","last_fullsized":"2024-09-10T15:27:28.694797+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334556+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:27:28.334556+0000","last_peered":"2024-09-10T15:27:28.334556+0000","last_clean":"2024-09-10T15:27:28.334556+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:27:28.334556+0000","last_undegraded":"2024-09-10T15:27:28.334556+0000","last_fullsized":"2024-09-10T15:27:28.334556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490049+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:27:28.490049+0000","last_peered":"2024-09-10T15:27:28.490049+0000","last_clean":"2024-09-10T15:27:28.490049+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:27:28.490049+0000","last_undegraded":"2024-09-10T15:27:28.490049+0000","last_fullsized":"2024-09-10T15:27:28.490049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694409+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:28.694409+0000","last_peered":"2024-09-10T15:27:28.694409+0000","last_clean":"2024-09-10T15:27:28.694409+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:28.694409+0000","last_undegraded":"2024-09-10T15:27:28.694409+0000","last_fullsized":"2024-09-10T15:27:28.694409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24588,"num_write":29,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492515+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:27:28.492515+0000","last_peered":"2024-09-10T15:27:28.492515+0000","last_clean":"2024-09-10T15:27:28.492515+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:27:28.492515+0000","last_undegraded":"2024-09-10T15:27:28.492515+0000","last_fullsized":"2024-09-10T15:27:28.492515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"35'15","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314997+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:27:28.314997+0000","last_peered":"2024-09-10T15:27:28.314997+0000","last_clean":"2024-09-10T15:27:28.314997+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:27:28.314997+0000","last_undegraded":"2024-09-10T15:27:28.314997+0000","last_fullsized":"2024-09-10T15:27:28.314997+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314725+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.314725+0000","last_peered":"2024-09-10T15:27:28.314725+0000","last_clean":"2024-09-10T15:27:28.314725+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.314725+0000","last_undegraded":"2024-09-10T15:27:28.314725+0000","last_fullsized":"2024-09-10T15:27:28.314725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314024+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:28.314024+0000","last_peered":"2024-09-10T15:27:28.314024+0000","last_clean":"2024-09-10T15:27:28.314024+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:28.314024+0000","last_undegraded":"2024-09-10T15:27:28.314024+0000","last_fullsized":"2024-09-10T15:27:28.314024+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333823+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333823+0000","last_peered":"2024-09-10T15:27:28.333823+0000","last_clean":"2024-09-10T15:27:28.333823+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333823+0000","last_undegraded":"2024-09-10T15:27:28.333823+0000","last_fullsized":"2024-09-10T15:27:28.333823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415593+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415593+0000","last_peered":"2024-09-10T15:27:28.415593+0000","last_clean":"2024-09-10T15:27:28.415593+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415593+0000","last_undegraded":"2024-09-10T15:27:28.415593+0000","last_fullsized":"2024-09-10T15:27:28.415593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"76'9","reported_seq":112,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489746+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:28.489746+0000","last_peered":"2024-09-10T15:27:28.489746+0000","last_clean":"2024-09-10T15:27:28.489746+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:28.489746+0000","last_undegraded":"2024-09-10T15:27:28.489746+0000","last_fullsized":"2024-09-10T15:27:28.489746+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:22.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491363+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:27:28.491363+0000","last_peered":"2024-09-10T15:27:28.491363+0000","last_clean":"2024-09-10T15:27:28.491363+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:27:28.491363+0000","last_undegraded":"2024-09-10T15:27:28.491363+0000","last_fullsized":"2024-09-10T15:27:28.491363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696503+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:27:28.696503+0000","last_peered":"2024-09-10T15:27:28.696503+0000","last_clean":"2024-09-10T15:27:28.696503+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:27:28.696503+0000","last_undegraded":"2024-09-10T15:27:28.696503+0000","last_fullsized":"2024-09-10T15:27:28.696503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416956+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:28.416956+0000","last_peered":"2024-09-10T15:27:28.416956+0000","last_clean":"2024-09-10T15:27:28.416956+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:28.416956+0000","last_undegraded":"2024-09-10T15:27:28.416956+0000","last_fullsized":"2024-09-10T15:27:28.416956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.946988+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:28.946988+0000","last_peered":"2024-09-10T15:27:28.946988+0000","last_clean":"2024-09-10T15:27:28.946988+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:28.946988+0000","last_undegraded":"2024-09-10T15:27:28.946988+0000","last_fullsized":"2024-09-10T15:27:28.946988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332108+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332108+0000","last_peered":"2024-09-10T15:27:28.332108+0000","last_clean":"2024-09-10T15:27:28.332108+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332108+0000","last_undegraded":"2024-09-10T15:27:28.332108+0000","last_fullsized":"2024-09-10T15:27:28.332108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341413+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:27:28.341413+0000","last_peered":"2024-09-10T15:27:28.341413+0000","last_clean":"2024-09-10T15:27:28.341413+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:27:28.341413+0000","last_undegraded":"2024-09-10T15:27:28.341413+0000","last_fullsized":"2024-09-10T15:27:28.341413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697320+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697320+0000","last_peered":"2024-09-10T15:27:28.697320+0000","last_clean":"2024-09-10T15:27:28.697320+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697320+0000","last_undegraded":"2024-09-10T15:27:28.697320+0000","last_fullsized":"2024-09-10T15:27:28.697320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314579+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:27:28.314579+0000","last_peered":"2024-09-10T15:27:28.314579+0000","last_clean":"2024-09-10T15:27:28.314579+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:27:28.314579+0000","last_undegraded":"2024-09-10T15:27:28.314579+0000","last_fullsized":"2024-09-10T15:27:28.314579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"76'28","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490320+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:27:28.490320+0000","last_peered":"2024-09-10T15:27:28.490320+0000","last_clean":"2024-09-10T15:27:28.490320+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:27:28.490320+0000","last_undegraded":"2024-09-10T15:27:28.490320+0000","last_fullsized":"2024-09-10T15:27:28.490320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16571,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340394+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340394+0000","last_peered":"2024-09-10T15:27:28.340394+0000","last_clean":"2024-09-10T15:27:28.340394+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340394+0000","last_undegraded":"2024-09-10T15:27:28.340394+0000","last_fullsized":"2024-09-10T15:27:28.340394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696065+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:28.696065+0000","last_peered":"2024-09-10T15:27:28.696065+0000","last_clean":"2024-09-10T15:27:28.696065+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:28.696065+0000","last_undegraded":"2024-09-10T15:27:28.696065+0000","last_fullsized":"2024-09-10T15:27:28.696065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333620+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:27:28.333620+0000","last_peered":"2024-09-10T15:27:28.333620+0000","last_clean":"2024-09-10T15:27:28.333620+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:27:28.333620+0000","last_undegraded":"2024-09-10T15:27:28.333620+0000","last_fullsized":"2024-09-10T15:27:28.333620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334268+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:27:28.334268+0000","last_peered":"2024-09-10T15:27:28.334268+0000","last_clean":"2024-09-10T15:27:28.334268+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:27:28.334268+0000","last_undegraded":"2024-09-10T15:27:28.334268+0000","last_fullsized":"2024-09-10T15:27:28.334268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414797+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414797+0000","last_peered":"2024-09-10T15:27:28.414797+0000","last_clean":"2024-09-10T15:27:28.414797+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414797+0000","last_undegraded":"2024-09-10T15:27:28.414797+0000","last_fullsized":"2024-09-10T15:27:28.414797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313704+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:27:28.313704+0000","last_peered":"2024-09-10T15:27:28.313704+0000","last_clean":"2024-09-10T15:27:28.313704+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:27:28.313704+0000","last_undegraded":"2024-09-10T15:27:28.313704+0000","last_fullsized":"2024-09-10T15:27:28.313704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331980+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.331980+0000","last_peered":"2024-09-10T15:27:28.331980+0000","last_clean":"2024-09-10T15:27:28.331980+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.331980+0000","last_undegraded":"2024-09-10T15:27:28.331980+0000","last_fullsized":"2024-09-10T15:27:28.331980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"76'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947096+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:28.947096+0000","last_peered":"2024-09-10T15:27:28.947096+0000","last_clean":"2024-09-10T15:27:28.947096+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:28.947096+0000","last_undegraded":"2024-09-10T15:27:28.947096+0000","last_fullsized":"2024-09-10T15:27:28.947096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492299+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:28.492299+0000","last_peered":"2024-09-10T15:27:28.492299+0000","last_clean":"2024-09-10T15:27:28.492299+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:28.492299+0000","last_undegraded":"2024-09-10T15:27:28.492299+0000","last_fullsized":"2024-09-10T15:27:28.492299+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313734+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:27:28.313734+0000","last_peered":"2024-09-10T15:27:28.313734+0000","last_clean":"2024-09-10T15:27:28.313734+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:27:28.313734+0000","last_undegraded":"2024-09-10T15:27:28.313734+0000","last_fullsized":"2024-09-10T15:27:28.313734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"76'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316031+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:28.316031+0000","last_peered":"2024-09-10T15:27:28.316031+0000","last_clean":"2024-09-10T15:27:28.316031+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:28.316031+0000","last_undegraded":"2024-09-10T15:27:28.316031+0000","last_fullsized":"2024-09-10T15:27:28.316031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316149+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316149+0000","last_peered":"2024-09-10T15:27:28.316149+0000","last_clean":"2024-09-10T15:27:28.316149+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316149+0000","last_undegraded":"2024-09-10T15:27:28.316149+0000","last_fullsized":"2024-09-10T15:27:28.316149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414992+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:27:28.414992+0000","last_peered":"2024-09-10T15:27:28.414992+0000","last_clean":"2024-09-10T15:27:28.414992+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:27:28.414992+0000","last_undegraded":"2024-09-10T15:27:28.414992+0000","last_fullsized":"2024-09-10T15:27:28.414992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415219+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:27:28.415219+0000","last_peered":"2024-09-10T15:27:28.415219+0000","last_clean":"2024-09-10T15:27:28.415219+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:27:28.415219+0000","last_undegraded":"2024-09-10T15:27:28.415219+0000","last_fullsized":"2024-09-10T15:27:28.415219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"76'14","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696278+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:27:28.696278+0000","last_peered":"2024-09-10T15:27:28.696278+0000","last_clean":"2024-09-10T15:27:28.696278+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:27:28.696278+0000","last_undegraded":"2024-09-10T15:27:28.696278+0000","last_fullsized":"2024-09-10T15:27:28.696278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695215+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:28.695215+0000","last_peered":"2024-09-10T15:27:28.695215+0000","last_clean":"2024-09-10T15:27:28.695215+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:28.695215+0000","last_undegraded":"2024-09-10T15:27:28.695215+0000","last_fullsized":"2024-09-10T15:27:28.695215+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340766+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:27:28.340766+0000","last_peered":"2024-09-10T15:27:28.340766+0000","last_clean":"2024-09-10T15:27:28.340766+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:27:28.340766+0000","last_undegraded":"2024-09-10T15:27:28.340766+0000","last_fullsized":"2024-09-10T15:27:28.340766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'8","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315897+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:28.315897+0000","last_peered":"2024-09-10T15:27:28.315897+0000","last_clean":"2024-09-10T15:27:28.315897+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:28.315897+0000","last_undegraded":"2024-09-10T15:27:28.315897+0000","last_fullsized":"2024-09-10T15:27:28.315897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414338+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414338+0000","last_peered":"2024-09-10T15:27:28.414338+0000","last_clean":"2024-09-10T15:27:28.414338+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414338+0000","last_undegraded":"2024-09-10T15:27:28.414338+0000","last_fullsized":"2024-09-10T15:27:28.414338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313222+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:27:28.313222+0000","last_peered":"2024-09-10T15:27:28.313222+0000","last_clean":"2024-09-10T15:27:28.313222+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:27:28.313222+0000","last_undegraded":"2024-09-10T15:27:28.313222+0000","last_fullsized":"2024-09-10T15:27:28.313222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"76'30","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313533+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:28.313533+0000","last_peered":"2024-09-10T15:27:28.313533+0000","last_clean":"2024-09-10T15:27:28.313533+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:28.313533+0000","last_undegraded":"2024-09-10T15:27:28.313533+0000","last_fullsized":"2024-09-10T15:27:28.313533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16131,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314089+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314089+0000","last_peered":"2024-09-10T15:27:28.314089+0000","last_clean":"2024-09-10T15:27:28.314089+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314089+0000","last_undegraded":"2024-09-10T15:27:28.314089+0000","last_fullsized":"2024-09-10T15:27:28.314089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341292+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:28.341292+0000","last_peered":"2024-09-10T15:27:28.341292+0000","last_clean":"2024-09-10T15:27:28.341292+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:28.341292+0000","last_undegraded":"2024-09-10T15:27:28.341292+0000","last_fullsized":"2024-09-10T15:27:28.341292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314871+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314871+0000","last_peered":"2024-09-10T15:27:28.314871+0000","last_clean":"2024-09-10T15:27:28.314871+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314871+0000","last_undegraded":"2024-09-10T15:27:28.314871+0000","last_fullsized":"2024-09-10T15:27:28.314871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341098+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:27:28.341098+0000","last_peered":"2024-09-10T15:27:28.341098+0000","last_clean":"2024-09-10T15:27:28.341098+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:27:28.341098+0000","last_undegraded":"2024-09-10T15:27:28.341098+0000","last_fullsized":"2024-09-10T15:27:28.341098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416157+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:27:28.416157+0000","last_peered":"2024-09-10T15:27:28.416157+0000","last_clean":"2024-09-10T15:27:28.416157+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:27:28.416157+0000","last_undegraded":"2024-09-10T15:27:28.416157+0000","last_fullsized":"2024-09-10T15:27:28.416157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":45068,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332482+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:27:28.332482+0000","last_peered":"2024-09-10T15:27:28.332482+0000","last_clean":"2024-09-10T15:27:28.332482+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:27:28.332482+0000","last_undegraded":"2024-09-10T15:27:28.332482+0000","last_fullsized":"2024-09-10T15:27:28.332482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"76'18","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331938+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:27:28.331938+0000","last_peered":"2024-09-10T15:27:28.331938+0000","last_clean":"2024-09-10T15:27:28.331938+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:27:28.331938+0000","last_undegraded":"2024-09-10T15:27:28.331938+0000","last_fullsized":"2024-09-10T15:27:28.331938+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489034+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:27:28.489034+0000","last_peered":"2024-09-10T15:27:28.489034+0000","last_clean":"2024-09-10T15:27:28.489034+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:27:28.489034+0000","last_undegraded":"2024-09-10T15:27:28.489034+0000","last_fullsized":"2024-09-10T15:27:28.489034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492067+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492067+0000","last_peered":"2024-09-10T15:27:28.492067+0000","last_clean":"2024-09-10T15:27:28.492067+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492067+0000","last_undegraded":"2024-09-10T15:27:28.492067+0000","last_fullsized":"2024-09-10T15:27:28.492067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313879+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:28.313879+0000","last_peered":"2024-09-10T15:27:28.313879+0000","last_clean":"2024-09-10T15:27:28.313879+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:28.313879+0000","last_undegraded":"2024-09-10T15:27:28.313879+0000","last_fullsized":"2024-09-10T15:27:28.313879+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316289+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:27:28.316289+0000","last_peered":"2024-09-10T15:27:28.316289+0000","last_clean":"2024-09-10T15:27:28.316289+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:27:28.316289+0000","last_undegraded":"2024-09-10T15:27:28.316289+0000","last_fullsized":"2024-09-10T15:27:28.316289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314243+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:27:28.314243+0000","last_peered":"2024-09-10T15:27:28.314243+0000","last_clean":"2024-09-10T15:27:28.314243+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:27:28.314243+0000","last_undegraded":"2024-09-10T15:27:28.314243+0000","last_fullsized":"2024-09-10T15:27:28.314243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312937+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:27:28.312937+0000","last_peered":"2024-09-10T15:27:28.312937+0000","last_clean":"2024-09-10T15:27:28.312937+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:27:28.312937+0000","last_undegraded":"2024-09-10T15:27:28.312937+0000","last_fullsized":"2024-09-10T15:27:28.312937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339809+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:28.339809+0000","last_peered":"2024-09-10T15:27:28.339809+0000","last_clean":"2024-09-10T15:27:28.339809+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:28.339809+0000","last_undegraded":"2024-09-10T15:27:28.339809+0000","last_fullsized":"2024-09-10T15:27:28.339809+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333472+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:28.333472+0000","last_peered":"2024-09-10T15:27:28.333472+0000","last_clean":"2024-09-10T15:27:28.333472+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:28.333472+0000","last_undegraded":"2024-09-10T15:27:28.333472+0000","last_fullsized":"2024-09-10T15:27:28.333472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313480+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:27:28.313480+0000","last_peered":"2024-09-10T15:27:28.313480+0000","last_clean":"2024-09-10T15:27:28.313480+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:27:28.313480+0000","last_undegraded":"2024-09-10T15:27:28.313480+0000","last_fullsized":"2024-09-10T15:27:28.313480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"76'6","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341902+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:27:28.341902+0000","last_peered":"2024-09-10T15:27:28.341902+0000","last_clean":"2024-09-10T15:27:28.341902+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:27:28.341902+0000","last_undegraded":"2024-09-10T15:27:28.341902+0000","last_fullsized":"2024-09-10T15:27:28.341902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340071+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:27:28.340071+0000","last_peered":"2024-09-10T15:27:28.340071+0000","last_clean":"2024-09-10T15:27:28.340071+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:27:28.340071+0000","last_undegraded":"2024-09-10T15:27:28.340071+0000","last_fullsized":"2024-09-10T15:27:28.340071+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"76'14","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490857+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:27:28.490857+0000","last_peered":"2024-09-10T15:27:28.490857+0000","last_clean":"2024-09-10T15:27:28.490857+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:27:28.490857+0000","last_undegraded":"2024-09-10T15:27:28.490857+0000","last_fullsized":"2024-09-10T15:27:28.490857+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947403+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:28.947403+0000","last_peered":"2024-09-10T15:27:28.947403+0000","last_clean":"2024-09-10T15:27:28.947403+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:28.947403+0000","last_undegraded":"2024-09-10T15:27:28.947403+0000","last_fullsized":"2024-09-10T15:27:28.947403+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415856+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:28.415856+0000","last_peered":"2024-09-10T15:27:28.415856+0000","last_clean":"2024-09-10T15:27:28.415856+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:28.415856+0000","last_undegraded":"2024-09-10T15:27:28.415856+0000","last_fullsized":"2024-09-10T15:27:28.415856+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490524+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:27:28.490524+0000","last_peered":"2024-09-10T15:27:28.490524+0000","last_clean":"2024-09-10T15:27:28.490524+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:27:28.490524+0000","last_undegraded":"2024-09-10T15:27:28.490524+0000","last_fullsized":"2024-09-10T15:27:28.490524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'11","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697872+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:28.697872+0000","last_peered":"2024-09-10T15:27:28.697872+0000","last_clean":"2024-09-10T15:27:28.697872+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:28.697872+0000","last_undegraded":"2024-09-10T15:27:28.697872+0000","last_fullsized":"2024-09-10T15:27:28.697872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415020+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:27:28.415020+0000","last_peered":"2024-09-10T15:27:28.415020+0000","last_clean":"2024-09-10T15:27:28.415020+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:27:28.415020+0000","last_undegraded":"2024-09-10T15:27:28.415020+0000","last_fullsized":"2024-09-10T15:27:28.415020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"76'16","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313670+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:27:28.313670+0000","last_peered":"2024-09-10T15:27:28.313670+0000","last_clean":"2024-09-10T15:27:28.313670+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:27:28.313670+0000","last_undegraded":"2024-09-10T15:27:28.313670+0000","last_fullsized":"2024-09-10T15:27:28.313670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490222+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:27:28.490222+0000","last_peered":"2024-09-10T15:27:28.490222+0000","last_clean":"2024-09-10T15:27:28.490222+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:27:28.490222+0000","last_undegraded":"2024-09-10T15:27:28.490222+0000","last_fullsized":"2024-09-10T15:27:28.490222+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416768+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:27:28.416768+0000","last_peered":"2024-09-10T15:27:28.416768+0000","last_clean":"2024-09-10T15:27:28.416768+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:27:28.416768+0000","last_undegraded":"2024-09-10T15:27:28.416768+0000","last_fullsized":"2024-09-10T15:27:28.416768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"76'13","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694889+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:27:28.694889+0000","last_peered":"2024-09-10T15:27:28.694889+0000","last_clean":"2024-09-10T15:27:28.694889+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:27:28.694889+0000","last_undegraded":"2024-09-10T15:27:28.694889+0000","last_fullsized":"2024-09-10T15:27:28.694889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334748+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:27:28.334748+0000","last_peered":"2024-09-10T15:27:28.334748+0000","last_clean":"2024-09-10T15:27:28.334748+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:27:28.334748+0000","last_undegraded":"2024-09-10T15:27:28.334748+0000","last_fullsized":"2024-09-10T15:27:28.334748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333447+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:28.333447+0000","last_peered":"2024-09-10T15:27:28.333447+0000","last_clean":"2024-09-10T15:27:28.333447+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:28.333447+0000","last_undegraded":"2024-09-10T15:27:28.333447+0000","last_fullsized":"2024-09-10T15:27:28.333447+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339886+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:28.339886+0000","last_peered":"2024-09-10T15:27:28.339886+0000","last_clean":"2024-09-10T15:27:28.339886+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:28.339886+0000","last_undegraded":"2024-09-10T15:27:28.339886+0000","last_fullsized":"2024-09-10T15:27:28.339886+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":125,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694923+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:28.694923+0000","last_peered":"2024-09-10T15:27:28.694923+0000","last_clean":"2024-09-10T15:27:28.694923+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:28.694923+0000","last_undegraded":"2024-09-10T15:27:28.694923+0000","last_fullsized":"2024-09-10T15:27:28.694923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315808+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:27:28.315808+0000","last_peered":"2024-09-10T15:27:28.315808+0000","last_clean":"2024-09-10T15:27:28.315808+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:27:28.315808+0000","last_undegraded":"2024-09-10T15:27:28.315808+0000","last_fullsized":"2024-09-10T15:27:28.315808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313943+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:28.313943+0000","last_peered":"2024-09-10T15:27:28.313943+0000","last_clean":"2024-09-10T15:27:28.313943+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:28.313943+0000","last_undegraded":"2024-09-10T15:27:28.313943+0000","last_fullsized":"2024-09-10T15:27:28.313943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341227+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:27:28.341227+0000","last_peered":"2024-09-10T15:27:28.341227+0000","last_clean":"2024-09-10T15:27:28.341227+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:27:28.341227+0000","last_undegraded":"2024-09-10T15:27:28.341227+0000","last_fullsized":"2024-09-10T15:27:28.341227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"76'20","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416068+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:27:28.416068+0000","last_peered":"2024-09-10T15:27:28.416068+0000","last_clean":"2024-09-10T15:27:28.416068+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:27:28.416068+0000","last_undegraded":"2024-09-10T15:27:28.416068+0000","last_fullsized":"2024-09-10T15:27:28.416068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695544+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:28.695544+0000","last_peered":"2024-09-10T15:27:28.695544+0000","last_clean":"2024-09-10T15:27:28.695544+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:28.695544+0000","last_undegraded":"2024-09-10T15:27:28.695544+0000","last_fullsized":"2024-09-10T15:27:28.695544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415564+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:28.415564+0000","last_peered":"2024-09-10T15:27:28.415564+0000","last_clean":"2024-09-10T15:27:28.415564+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:28.415564+0000","last_undegraded":"2024-09-10T15:27:28.415564+0000","last_fullsized":"2024-09-10T15:27:28.415564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491484+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:27:28.491484+0000","last_peered":"2024-09-10T15:27:28.491484+0000","last_clean":"2024-09-10T15:27:28.491484+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:27:28.491484+0000","last_undegraded":"2024-09-10T15:27:28.491484+0000","last_fullsized":"2024-09-10T15:27:28.491484+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"71'6","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947921+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:27:28.947921+0000","last_peered":"2024-09-10T15:27:28.947921+0000","last_clean":"2024-09-10T15:27:28.947921+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:27:28.947921+0000","last_undegraded":"2024-09-10T15:27:28.947921+0000","last_fullsized":"2024-09-10T15:27:28.947921+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341593+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:27:28.341593+0000","last_peered":"2024-09-10T15:27:28.341593+0000","last_clean":"2024-09-10T15:27:28.341593+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:27:28.341593+0000","last_undegraded":"2024-09-10T15:27:28.341593+0000","last_fullsized":"2024-09-10T15:27:28.341593+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"76'14","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333989+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:27:28.333989+0000","last_peered":"2024-09-10T15:27:28.333989+0000","last_clean":"2024-09-10T15:27:28.333989+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:27:28.333989+0000","last_undegraded":"2024-09-10T15:27:28.333989+0000","last_fullsized":"2024-09-10T15:27:28.333989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489208+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489208+0000","last_peered":"2024-09-10T15:27:28.489208+0000","last_clean":"2024-09-10T15:27:28.489208+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489208+0000","last_undegraded":"2024-09-10T15:27:28.489208+0000","last_fullsized":"2024-09-10T15:27:28.489208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414492+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:28.414492+0000","last_peered":"2024-09-10T15:27:28.414492+0000","last_clean":"2024-09-10T15:27:28.414492+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:28.414492+0000","last_undegraded":"2024-09-10T15:27:28.414492+0000","last_fullsized":"2024-09-10T15:27:28.414492+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315293+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:27:28.315293+0000","last_peered":"2024-09-10T15:27:28.315293+0000","last_clean":"2024-09-10T15:27:28.315293+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:27:28.315293+0000","last_undegraded":"2024-09-10T15:27:28.315293+0000","last_fullsized":"2024-09-10T15:27:28.315293+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"76'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315661+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:28.315661+0000","last_peered":"2024-09-10T15:27:28.315661+0000","last_clean":"2024-09-10T15:27:28.315661+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:28.315661+0000","last_undegraded":"2024-09-10T15:27:28.315661+0000","last_fullsized":"2024-09-10T15:27:28.315661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47122,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314820+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:27:28.314820+0000","last_peered":"2024-09-10T15:27:28.314820+0000","last_clean":"2024-09-10T15:27:28.314820+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:27:28.314820+0000","last_undegraded":"2024-09-10T15:27:28.314820+0000","last_fullsized":"2024-09-10T15:27:28.314820+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"88'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416555+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:27:28.416555+0000","last_peered":"2024-09-10T15:27:28.416555+0000","last_clean":"2024-09-10T15:27:28.416555+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:27:28.416555+0000","last_undegraded":"2024-09-10T15:27:28.416555+0000","last_fullsized":"2024-09-10T15:27:28.416555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"76'14","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315714+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:28.315714+0000","last_peered":"2024-09-10T15:27:28.315714+0000","last_clean":"2024-09-10T15:27:28.315714+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:28.315714+0000","last_undegraded":"2024-09-10T15:27:28.315714+0000","last_fullsized":"2024-09-10T15:27:28.315714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414669+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:28.414669+0000","last_peered":"2024-09-10T15:27:28.414669+0000","last_clean":"2024-09-10T15:27:28.414669+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:28.414669+0000","last_undegraded":"2024-09-10T15:27:28.414669+0000","last_fullsized":"2024-09-10T15:27:28.414669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341049+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:27:28.341049+0000","last_peered":"2024-09-10T15:27:28.341049+0000","last_clean":"2024-09-10T15:27:28.341049+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:27:28.341049+0000","last_undegraded":"2024-09-10T15:27:28.341049+0000","last_fullsized":"2024-09-10T15:27:28.341049+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"76'10","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947889+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:27:28.947889+0000","last_peered":"2024-09-10T15:27:28.947889+0000","last_clean":"2024-09-10T15:27:28.947889+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:27:28.947889+0000","last_undegraded":"2024-09-10T15:27:28.947889+0000","last_fullsized":"2024-09-10T15:27:28.947889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947527+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:27:28.947527+0000","last_peered":"2024-09-10T15:27:28.947527+0000","last_clean":"2024-09-10T15:27:28.947527+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:27:28.947527+0000","last_undegraded":"2024-09-10T15:27:28.947527+0000","last_fullsized":"2024-09-10T15:27:28.947527+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"76'20","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314075+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:27:28.314075+0000","last_peered":"2024-09-10T15:27:28.314075+0000","last_clean":"2024-09-10T15:27:28.314075+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:27:28.314075+0000","last_undegraded":"2024-09-10T15:27:28.314075+0000","last_fullsized":"2024-09-10T15:27:28.314075+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313100+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:28.313100+0000","last_peered":"2024-09-10T15:27:28.313100+0000","last_clean":"2024-09-10T15:27:28.313100+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:28.313100+0000","last_undegraded":"2024-09-10T15:27:28.313100+0000","last_fullsized":"2024-09-10T15:27:28.313100+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948209+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:28.948209+0000","last_peered":"2024-09-10T15:27:28.948209+0000","last_clean":"2024-09-10T15:27:28.948209+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:28.948209+0000","last_undegraded":"2024-09-10T15:27:28.948209+0000","last_fullsized":"2024-09-10T15:27:28.948209+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340586+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:27:28.340586+0000","last_peered":"2024-09-10T15:27:28.340586+0000","last_clean":"2024-09-10T15:27:28.340586+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:27:28.340586+0000","last_undegraded":"2024-09-10T15:27:28.340586+0000","last_fullsized":"2024-09-10T15:27:28.340586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414646+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:28.414646+0000","last_peered":"2024-09-10T15:27:28.414646+0000","last_clean":"2024-09-10T15:27:28.414646+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:28.414646+0000","last_undegraded":"2024-09-10T15:27:28.414646+0000","last_fullsized":"2024-09-10T15:27:28.414646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24594,"num_write":40,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340861+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:27:28.340861+0000","last_peered":"2024-09-10T15:27:28.340861+0000","last_clean":"2024-09-10T15:27:28.340861+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:27:28.340861+0000","last_undegraded":"2024-09-10T15:27:28.340861+0000","last_fullsized":"2024-09-10T15:27:28.340861+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313664+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:27:28.313664+0000","last_peered":"2024-09-10T15:27:28.313664+0000","last_clean":"2024-09-10T15:27:28.313664+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:27:28.313664+0000","last_undegraded":"2024-09-10T15:27:28.313664+0000","last_fullsized":"2024-09-10T15:27:28.313664+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414818+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:28.414818+0000","last_peered":"2024-09-10T15:27:28.414818+0000","last_clean":"2024-09-10T15:27:28.414818+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:28.414818+0000","last_undegraded":"2024-09-10T15:27:28.414818+0000","last_fullsized":"2024-09-10T15:27:28.414818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695793+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:28.695793+0000","last_peered":"2024-09-10T15:27:28.695793+0000","last_clean":"2024-09-10T15:27:28.695793+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:28.695793+0000","last_undegraded":"2024-09-10T15:27:28.695793+0000","last_fullsized":"2024-09-10T15:27:28.695793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490133+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:27:28.490133+0000","last_peered":"2024-09-10T15:27:28.490133+0000","last_clean":"2024-09-10T15:27:28.490133+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:27:28.490133+0000","last_undegraded":"2024-09-10T15:27:28.490133+0000","last_fullsized":"2024-09-10T15:27:28.490133+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697170+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:28.697170+0000","last_peered":"2024-09-10T15:27:28.697170+0000","last_clean":"2024-09-10T15:27:28.697170+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:28.697170+0000","last_undegraded":"2024-09-10T15:27:28.697170+0000","last_fullsized":"2024-09-10T15:27:28.697170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947124+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:27:28.947124+0000","last_peered":"2024-09-10T15:27:28.947124+0000","last_clean":"2024-09-10T15:27:28.947124+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:27:28.947124+0000","last_undegraded":"2024-09-10T15:27:28.947124+0000","last_fullsized":"2024-09-10T15:27:28.947124+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"76'13","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333230+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:27:28.333230+0000","last_peered":"2024-09-10T15:27:28.333230+0000","last_clean":"2024-09-10T15:27:28.333230+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:27:28.333230+0000","last_undegraded":"2024-09-10T15:27:28.333230+0000","last_fullsized":"2024-09-10T15:27:28.333230+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":34,"num_write":18,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414704+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:27:28.414704+0000","last_peered":"2024-09-10T15:27:28.414704+0000","last_clean":"2024-09-10T15:27:28.414704+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:27:28.414704+0000","last_undegraded":"2024-09-10T15:27:28.414704+0000","last_fullsized":"2024-09-10T15:27:28.414704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415928+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:28.415928+0000","last_peered":"2024-09-10T15:27:28.415928+0000","last_clean":"2024-09-10T15:27:28.415928+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:28.415928+0000","last_undegraded":"2024-09-10T15:27:28.415928+0000","last_fullsized":"2024-09-10T15:27:28.415928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340195+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:27:28.340195+0000","last_peered":"2024-09-10T15:27:28.340195+0000","last_clean":"2024-09-10T15:27:28.340195+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:27:28.340195+0000","last_undegraded":"2024-09-10T15:27:28.340195+0000","last_fullsized":"2024-09-10T15:27:28.340195+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697494+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:28.697494+0000","last_peered":"2024-09-10T15:27:28.697494+0000","last_clean":"2024-09-10T15:27:28.697494+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:28.697494+0000","last_undegraded":"2024-09-10T15:27:28.697494+0000","last_fullsized":"2024-09-10T15:27:28.697494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313080+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:27:28.313080+0000","last_peered":"2024-09-10T15:27:28.313080+0000","last_clean":"2024-09-10T15:27:28.313080+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:27:28.313080+0000","last_undegraded":"2024-09-10T15:27:28.313080+0000","last_fullsized":"2024-09-10T15:27:28.313080+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"76'13","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414935+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:27:28.414935+0000","last_peered":"2024-09-10T15:27:28.414935+0000","last_clean":"2024-09-10T15:27:28.414935+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:27:28.414935+0000","last_undegraded":"2024-09-10T15:27:28.414935+0000","last_fullsized":"2024-09-10T15:27:28.414935+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314837+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:28.314837+0000","last_peered":"2024-09-10T15:27:28.314837+0000","last_clean":"2024-09-10T15:27:28.314837+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:28.314837+0000","last_undegraded":"2024-09-10T15:27:28.314837+0000","last_fullsized":"2024-09-10T15:27:28.314837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315508+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:28.315508+0000","last_peered":"2024-09-10T15:27:28.315508+0000","last_clean":"2024-09-10T15:27:28.315508+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:28.315508+0000","last_undegraded":"2024-09-10T15:27:28.315508+0000","last_fullsized":"2024-09-10T15:27:28.315508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315999+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:27:28.315999+0000","last_peered":"2024-09-10T15:27:28.315999+0000","last_clean":"2024-09-10T15:27:28.315999+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:27:28.315999+0000","last_undegraded":"2024-09-10T15:27:28.315999+0000","last_fullsized":"2024-09-10T15:27:28.315999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340407+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:27:28.340407+0000","last_peered":"2024-09-10T15:27:28.340407+0000","last_clean":"2024-09-10T15:27:28.340407+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:27:28.340407+0000","last_undegraded":"2024-09-10T15:27:28.340407+0000","last_fullsized":"2024-09-10T15:27:28.340407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492828+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:27:28.492828+0000","last_peered":"2024-09-10T15:27:28.492828+0000","last_clean":"2024-09-10T15:27:28.492828+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:27:28.492828+0000","last_undegraded":"2024-09-10T15:27:28.492828+0000","last_fullsized":"2024-09-10T15:27:28.492828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"63'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489564+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:27:28.489564+0000","last_peered":"2024-09-10T15:27:28.489564+0000","last_clean":"2024-09-10T15:27:28.489564+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:27:28.489564+0000","last_undegraded":"2024-09-10T15:27:28.489564+0000","last_fullsized":"2024-09-10T15:27:28.489564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416056+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416056+0000","last_peered":"2024-09-10T15:27:28.416056+0000","last_clean":"2024-09-10T15:27:28.416056+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416056+0000","last_undegraded":"2024-09-10T15:27:28.416056+0000","last_fullsized":"2024-09-10T15:27:28.416056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415413+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:28.415413+0000","last_peered":"2024-09-10T15:27:28.415413+0000","last_clean":"2024-09-10T15:27:28.415413+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:28.415413+0000","last_undegraded":"2024-09-10T15:27:28.415413+0000","last_fullsized":"2024-09-10T15:27:28.415413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696973+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:27:28.696973+0000","last_peered":"2024-09-10T15:27:28.696973+0000","last_clean":"2024-09-10T15:27:28.696973+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:27:28.696973+0000","last_undegraded":"2024-09-10T15:27:28.696973+0000","last_fullsized":"2024-09-10T15:27:28.696973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696532+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:28.696532+0000","last_peered":"2024-09-10T15:27:28.696532+0000","last_clean":"2024-09-10T15:27:28.696532+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:28.696532+0000","last_undegraded":"2024-09-10T15:27:28.696532+0000","last_fullsized":"2024-09-10T15:27:28.696532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":51212,"num_write":35,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695873+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:27:28.695873+0000","last_peered":"2024-09-10T15:27:28.695873+0000","last_clean":"2024-09-10T15:27:28.695873+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:27:28.695873+0000","last_undegraded":"2024-09-10T15:27:28.695873+0000","last_fullsized":"2024-09-10T15:27:28.695873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331251+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:27:28.331251+0000","last_peered":"2024-09-10T15:27:28.331251+0000","last_clean":"2024-09-10T15:27:28.331251+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:27:28.331251+0000","last_undegraded":"2024-09-10T15:27:28.331251+0000","last_fullsized":"2024-09-10T15:27:28.331251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314167+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:27:28.314167+0000","last_peered":"2024-09-10T15:27:28.314167+0000","last_clean":"2024-09-10T15:27:28.314167+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:27:28.314167+0000","last_undegraded":"2024-09-10T15:27:28.314167+0000","last_fullsized":"2024-09-10T15:27:28.314167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334348+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:27:28.334348+0000","last_peered":"2024-09-10T15:27:28.334348+0000","last_clean":"2024-09-10T15:27:28.334348+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:27:28.334348+0000","last_undegraded":"2024-09-10T15:27:28.334348+0000","last_fullsized":"2024-09-10T15:27:28.334348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332571+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:27:28.332571+0000","last_peered":"2024-09-10T15:27:28.332571+0000","last_clean":"2024-09-10T15:27:28.332571+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:27:28.332571+0000","last_undegraded":"2024-09-10T15:27:28.332571+0000","last_fullsized":"2024-09-10T15:27:28.332571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341835+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:27:28.341835+0000","last_peered":"2024-09-10T15:27:28.341835+0000","last_clean":"2024-09-10T15:27:28.341835+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:27:28.341835+0000","last_undegraded":"2024-09-10T15:27:28.341835+0000","last_fullsized":"2024-09-10T15:27:28.341835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947641+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:27:28.947641+0000","last_peered":"2024-09-10T15:27:28.947641+0000","last_clean":"2024-09-10T15:27:28.947641+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:27:28.947641+0000","last_undegraded":"2024-09-10T15:27:28.947641+0000","last_fullsized":"2024-09-10T15:27:28.947641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697192+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:27:28.697192+0000","last_peered":"2024-09-10T15:27:28.697192+0000","last_clean":"2024-09-10T15:27:28.697192+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:27:28.697192+0000","last_undegraded":"2024-09-10T15:27:28.697192+0000","last_fullsized":"2024-09-10T15:27:28.697192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28684,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493145+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:28.493145+0000","last_peered":"2024-09-10T15:27:28.493145+0000","last_clean":"2024-09-10T15:27:28.493145+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:28.493145+0000","last_undegraded":"2024-09-10T15:27:28.493145+0000","last_fullsized":"2024-09-10T15:27:28.493145+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"76'9","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415276+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:27:28.415276+0000","last_peered":"2024-09-10T15:27:28.415276+0000","last_clean":"2024-09-10T15:27:28.415276+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:27:28.415276+0000","last_undegraded":"2024-09-10T15:27:28.415276+0000","last_fullsized":"2024-09-10T15:27:28.415276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315776+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:27:28.315776+0000","last_peered":"2024-09-10T15:27:28.315776+0000","last_clean":"2024-09-10T15:27:28.315776+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:27:28.315776+0000","last_undegraded":"2024-09-10T15:27:28.315776+0000","last_fullsized":"2024-09-10T15:27:28.315776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"69'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694776+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:28.694776+0000","last_peered":"2024-09-10T15:27:28.694776+0000","last_clean":"2024-09-10T15:27:28.694776+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:28.694776+0000","last_undegraded":"2024-09-10T15:27:28.694776+0000","last_fullsized":"2024-09-10T15:27:28.694776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696443+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:27:28.696443+0000","last_peered":"2024-09-10T15:27:28.696443+0000","last_clean":"2024-09-10T15:27:28.696443+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:27:28.696443+0000","last_undegraded":"2024-09-10T15:27:28.696443+0000","last_fullsized":"2024-09-10T15:27:28.696443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"76'7","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947713+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:27:28.947713+0000","last_peered":"2024-09-10T15:27:28.947713+0000","last_clean":"2024-09-10T15:27:28.947713+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:27:28.947713+0000","last_undegraded":"2024-09-10T15:27:28.947713+0000","last_fullsized":"2024-09-10T15:27:28.947713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18438,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947692+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.947692+0000","last_peered":"2024-09-10T15:27:28.947692+0000","last_clean":"2024-09-10T15:27:28.947692+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:27:28.947692+0000","last_undegraded":"2024-09-10T15:27:28.947692+0000","last_fullsized":"2024-09-10T15:27:28.947692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315424+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:28.315424+0000","last_peered":"2024-09-10T15:27:28.315424+0000","last_clean":"2024-09-10T15:27:28.315424+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:28.315424+0000","last_undegraded":"2024-09-10T15:27:28.315424+0000","last_fullsized":"2024-09-10T15:27:28.315424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":20,"num_read_kb":53254,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947595+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:27:28.947595+0000","last_peered":"2024-09-10T15:27:28.947595+0000","last_clean":"2024-09-10T15:27:28.947595+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:27:28.947595+0000","last_undegraded":"2024-09-10T15:27:28.947595+0000","last_fullsized":"2024-09-10T15:27:28.947595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315275+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:27:28.315275+0000","last_peered":"2024-09-10T15:27:28.315275+0000","last_clean":"2024-09-10T15:27:28.315275+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:27:28.315275+0000","last_undegraded":"2024-09-10T15:27:28.315275+0000","last_fullsized":"2024-09-10T15:27:28.315275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490207+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490207+0000","last_peered":"2024-09-10T15:27:28.490207+0000","last_clean":"2024-09-10T15:27:28.490207+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490207+0000","last_undegraded":"2024-09-10T15:27:28.490207+0000","last_fullsized":"2024-09-10T15:27:28.490207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414460+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:28.414460+0000","last_peered":"2024-09-10T15:27:28.414460+0000","last_clean":"2024-09-10T15:27:28.414460+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:28.414460+0000","last_undegraded":"2024-09-10T15:27:28.414460+0000","last_fullsized":"2024-09-10T15:27:28.414460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":18,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313708+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:27:28.313708+0000","last_peered":"2024-09-10T15:27:28.313708+0000","last_clean":"2024-09-10T15:27:28.313708+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:27:28.313708+0000","last_undegraded":"2024-09-10T15:27:28.313708+0000","last_fullsized":"2024-09-10T15:27:28.313708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"70'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493135+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:27:28.493135+0000","last_peered":"2024-09-10T15:27:28.493135+0000","last_clean":"2024-09-10T15:27:28.493135+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:27:28.493135+0000","last_undegraded":"2024-09-10T15:27:28.493135+0000","last_fullsized":"2024-09-10T15:27:28.493135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947471+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:27:28.947471+0000","last_peered":"2024-09-10T15:27:28.947471+0000","last_clean":"2024-09-10T15:27:28.947471+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:27:28.947471+0000","last_undegraded":"2024-09-10T15:27:28.947471+0000","last_fullsized":"2024-09-10T15:27:28.947471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414474+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:28.414474+0000","last_peered":"2024-09-10T15:27:28.414474+0000","last_clean":"2024-09-10T15:27:28.414474+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:28.414474+0000","last_undegraded":"2024-09-10T15:27:28.414474+0000","last_fullsized":"2024-09-10T15:27:28.414474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"70'7","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415267+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:28.415267+0000","last_peered":"2024-09-10T15:27:28.415267+0000","last_clean":"2024-09-10T15:27:28.415267+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:28.415267+0000","last_undegraded":"2024-09-10T15:27:28.415267+0000","last_fullsized":"2024-09-10T15:27:28.415267+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315839+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:27:28.315839+0000","last_peered":"2024-09-10T15:27:28.315839+0000","last_clean":"2024-09-10T15:27:28.315839+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:27:28.315839+0000","last_undegraded":"2024-09-10T15:27:28.315839+0000","last_fullsized":"2024-09-10T15:27:28.315839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"71'4","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693307+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:28.693307+0000","last_peered":"2024-09-10T15:27:28.693307+0000","last_clean":"2024-09-10T15:27:28.693307+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:28.693307+0000","last_undegraded":"2024-09-10T15:27:28.693307+0000","last_fullsized":"2024-09-10T15:27:28.693307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948341+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:27:28.948341+0000","last_peered":"2024-09-10T15:27:28.948341+0000","last_clean":"2024-09-10T15:27:28.948341+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:27:28.948341+0000","last_undegraded":"2024-09-10T15:27:28.948341+0000","last_fullsized":"2024-09-10T15:27:28.948341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238917,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":923,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":575,"ondisk_log_size":575,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302668,"kb_used_data":271476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94069172,"statfs":{"total":96636764160,"available":96326832128,"internally_reserved":0,"allocated":277991424,"data_stored":277466410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405080,"kb_used_data":373880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93966760,"statfs":{"total":96636764160,"available":96221962240,"internally_reserved":0,"allocated":382853120,"data_stored":382316635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434332,"kb_used_data":403136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93937508,"statfs":{"total":96636764160,"available":96192008192,"internally_reserved":0,"allocated":412811264,"data_stored":412275769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574882,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370296,"kb_used_data":339104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94001544,"statfs":{"total":96636764160,"available":96257581056,"internally_reserved":0,"allocated":347242496,"data_stored":346695811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":509504,"kb_used_data":478316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93862336,"statfs":{"total":96636764160,"available":96115032064,"internally_reserved":0,"allocated":489795584,"data_stored":489272490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501288,"kb_used_data":470096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93870552,"statfs":{"total":96636764160,"available":96123445248,"internally_reserved":0,"allocated":481378304,"data_stored":480880706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356568,"kb_used_data":325376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94015272,"statfs":{"total":96636764160,"available":96271638528,"internally_reserved":0,"allocated":333185024,"data_stored":332610464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575120,"kb_used_data":543928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93796720,"statfs":{"total":96636764160,"available":96047841280,"internally_reserved":0,"allocated":556982272,"data_stored":556408695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":555745280,"data_stored":555745280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":346030080,"data_stored":346030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":35596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":30035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":28726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:27:33.639 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-10T15:27:33.640 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-10T15:27:33.987 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-10T15:27:33.999 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-10T15:27:33.999 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:27:34.000 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-10T15:27:33.996+0000 7fa3a83af640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 33148) UID: 0 2024-09-10T15:27:34.000 INFO:tasks.rgw.client.0.smithi099.stdout:2024-09-10T15:27:33.996+0000 7fa3abbf7a40 -1 shutting down 2024-09-10T15:27:54.986 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-10T15:27:58.404 INFO:tasks.rgw.client.0:Stopped 2024-09-10T15:27:58.404 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-10T15:27:58.411 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/vault-root-token 2024-09-10T15:27:58.467 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-10T15:27:58.524 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-10T15:27:58.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-10T15:27:58.524 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-10T15:27:59.418 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T15:27:59.435 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T15:27:59.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:27:59.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:27:59.794 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:27:59.805 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-10T15:27:58.981539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609477,"num_objects":639,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":639,"num_whiteouts":0,"num_read":3875,"num_read_kb":2050994,"num_write":3330,"num_write_kb":2051084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1991,"ondisk_log_size":1991,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3454916,"kb_used_data":3205432,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751519804,"statfs":{"total":773094113280,"available":769556279296,"internally_reserved":0,"allocated":3282362368,"data_stored":3278004590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006099"},"pg_stats":[{"pgid":"3.3f","version":"76'7","reported_seq":110,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492571+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:28.492571+0000","last_peered":"2024-09-10T15:27:28.492571+0000","last_clean":"2024-09-10T15:27:28.492571+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:28.492571+0000","last_undegraded":"2024-09-10T15:27:28.492571+0000","last_fullsized":"2024-09-10T15:27:28.492571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:35.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947463+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:28.947463+0000","last_peered":"2024-09-10T15:27:28.947463+0000","last_clean":"2024-09-10T15:27:28.947463+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:28.947463+0000","last_undegraded":"2024-09-10T15:27:28.947463+0000","last_fullsized":"2024-09-10T15:27:28.947463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696971+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:27:28.696971+0000","last_peered":"2024-09-10T15:27:28.696971+0000","last_clean":"2024-09-10T15:27:28.696971+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:27:28.696971+0000","last_undegraded":"2024-09-10T15:27:28.696971+0000","last_fullsized":"2024-09-10T15:27:28.696971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415253+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:28.415253+0000","last_peered":"2024-09-10T15:27:28.415253+0000","last_clean":"2024-09-10T15:27:28.415253+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:28.415253+0000","last_undegraded":"2024-09-10T15:27:28.415253+0000","last_fullsized":"2024-09-10T15:27:28.415253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"76'16","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693506+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:28.693506+0000","last_peered":"2024-09-10T15:27:28.693506+0000","last_clean":"2024-09-10T15:27:28.693506+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:28.693506+0000","last_undegraded":"2024-09-10T15:27:28.693506+0000","last_fullsized":"2024-09-10T15:27:28.693506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415252+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:27:28.415252+0000","last_peered":"2024-09-10T15:27:28.415252+0000","last_clean":"2024-09-10T15:27:28.415252+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:27:28.415252+0000","last_undegraded":"2024-09-10T15:27:28.415252+0000","last_fullsized":"2024-09-10T15:27:28.415252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"71'2","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315716+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:27:28.315716+0000","last_peered":"2024-09-10T15:27:28.315716+0000","last_clean":"2024-09-10T15:27:28.315716+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:27:28.315716+0000","last_undegraded":"2024-09-10T15:27:28.315716+0000","last_fullsized":"2024-09-10T15:27:28.315716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314620+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:27:28.314620+0000","last_peered":"2024-09-10T15:27:28.314620+0000","last_clean":"2024-09-10T15:27:28.314620+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:27:28.314620+0000","last_undegraded":"2024-09-10T15:27:28.314620+0000","last_fullsized":"2024-09-10T15:27:28.314620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":45074,"num_write":45,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314283+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:27:28.314283+0000","last_peered":"2024-09-10T15:27:28.314283+0000","last_clean":"2024-09-10T15:27:28.314283+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:27:28.314283+0000","last_undegraded":"2024-09-10T15:27:28.314283+0000","last_fullsized":"2024-09-10T15:27:28.314283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339888+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:27:28.339888+0000","last_peered":"2024-09-10T15:27:28.339888+0000","last_clean":"2024-09-10T15:27:28.339888+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:27:28.339888+0000","last_undegraded":"2024-09-10T15:27:28.339888+0000","last_fullsized":"2024-09-10T15:27:28.339888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315735+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:27:28.315735+0000","last_peered":"2024-09-10T15:27:28.315735+0000","last_clean":"2024-09-10T15:27:28.315735+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:27:28.315735+0000","last_undegraded":"2024-09-10T15:27:28.315735+0000","last_fullsized":"2024-09-10T15:27:28.315735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"76'8","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314811+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:27:28.314811+0000","last_peered":"2024-09-10T15:27:28.314811+0000","last_clean":"2024-09-10T15:27:28.314811+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:27:28.314811+0000","last_undegraded":"2024-09-10T15:27:28.314811+0000","last_fullsized":"2024-09-10T15:27:28.314811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341680+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:27:28.341680+0000","last_peered":"2024-09-10T15:27:28.341680+0000","last_clean":"2024-09-10T15:27:28.341680+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:27:28.341680+0000","last_undegraded":"2024-09-10T15:27:28.341680+0000","last_fullsized":"2024-09-10T15:27:28.341680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693325+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:28.693325+0000","last_peered":"2024-09-10T15:27:28.693325+0000","last_clean":"2024-09-10T15:27:28.693325+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:28.693325+0000","last_undegraded":"2024-09-10T15:27:28.693325+0000","last_fullsized":"2024-09-10T15:27:28.693325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697665+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:27:28.697665+0000","last_peered":"2024-09-10T15:27:28.697665+0000","last_clean":"2024-09-10T15:27:28.697665+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:27:28.697665+0000","last_undegraded":"2024-09-10T15:27:28.697665+0000","last_fullsized":"2024-09-10T15:27:28.697665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415085+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:28.415085+0000","last_peered":"2024-09-10T15:27:28.415085+0000","last_clean":"2024-09-10T15:27:28.415085+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:28.415085+0000","last_undegraded":"2024-09-10T15:27:28.415085+0000","last_fullsized":"2024-09-10T15:27:28.415085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'10","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948605+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:27:28.948605+0000","last_peered":"2024-09-10T15:27:28.948605+0000","last_clean":"2024-09-10T15:27:28.948605+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:27:28.948605+0000","last_undegraded":"2024-09-10T15:27:28.948605+0000","last_fullsized":"2024-09-10T15:27:28.948605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314573+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:27:28.314573+0000","last_peered":"2024-09-10T15:27:28.314573+0000","last_clean":"2024-09-10T15:27:28.314573+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:27:28.314573+0000","last_undegraded":"2024-09-10T15:27:28.314573+0000","last_fullsized":"2024-09-10T15:27:28.314573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"76'11","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315801+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:27:28.315801+0000","last_peered":"2024-09-10T15:27:28.315801+0000","last_clean":"2024-09-10T15:27:28.315801+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:27:28.315801+0000","last_undegraded":"2024-09-10T15:27:28.315801+0000","last_fullsized":"2024-09-10T15:27:28.315801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948029+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:27:28.948029+0000","last_peered":"2024-09-10T15:27:28.948029+0000","last_clean":"2024-09-10T15:27:28.948029+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:27:28.948029+0000","last_undegraded":"2024-09-10T15:27:28.948029+0000","last_fullsized":"2024-09-10T15:27:28.948029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"70'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316211+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:27:28.316211+0000","last_peered":"2024-09-10T15:27:28.316211+0000","last_clean":"2024-09-10T15:27:28.316211+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:27:28.316211+0000","last_undegraded":"2024-09-10T15:27:28.316211+0000","last_fullsized":"2024-09-10T15:27:28.316211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":34816,"num_write":10,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333429+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:27:28.333429+0000","last_peered":"2024-09-10T15:27:28.333429+0000","last_clean":"2024-09-10T15:27:28.333429+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:27:28.333429+0000","last_undegraded":"2024-09-10T15:27:28.333429+0000","last_fullsized":"2024-09-10T15:27:28.333429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315085+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:27:28.315085+0000","last_peered":"2024-09-10T15:27:28.315085+0000","last_clean":"2024-09-10T15:27:28.315085+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:27:28.315085+0000","last_undegraded":"2024-09-10T15:27:28.315085+0000","last_fullsized":"2024-09-10T15:27:28.315085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695686+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:27:28.695686+0000","last_peered":"2024-09-10T15:27:28.695686+0000","last_clean":"2024-09-10T15:27:28.695686+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:27:28.695686+0000","last_undegraded":"2024-09-10T15:27:28.695686+0000","last_fullsized":"2024-09-10T15:27:28.695686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331520+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:27:28.331520+0000","last_peered":"2024-09-10T15:27:28.331520+0000","last_clean":"2024-09-10T15:27:28.331520+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:27:28.331520+0000","last_undegraded":"2024-09-10T15:27:28.331520+0000","last_fullsized":"2024-09-10T15:27:28.331520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948065+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:28.948065+0000","last_peered":"2024-09-10T15:27:28.948065+0000","last_clean":"2024-09-10T15:27:28.948065+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:28.948065+0000","last_undegraded":"2024-09-10T15:27:28.948065+0000","last_fullsized":"2024-09-10T15:27:28.948065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"76'12","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313280+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:27:28.313280+0000","last_peered":"2024-09-10T15:27:28.313280+0000","last_clean":"2024-09-10T15:27:28.313280+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:27:28.313280+0000","last_undegraded":"2024-09-10T15:27:28.313280+0000","last_fullsized":"2024-09-10T15:27:28.313280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:57.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313061+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:28.313061+0000","last_peered":"2024-09-10T15:27:28.313061+0000","last_clean":"2024-09-10T15:27:28.313061+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:28.313061+0000","last_undegraded":"2024-09-10T15:27:28.313061+0000","last_fullsized":"2024-09-10T15:27:28.313061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333852+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:27:28.333852+0000","last_peered":"2024-09-10T15:27:28.333852+0000","last_clean":"2024-09-10T15:27:28.333852+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:27:28.333852+0000","last_undegraded":"2024-09-10T15:27:28.333852+0000","last_fullsized":"2024-09-10T15:27:28.333852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"76'12","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414504+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:28.414504+0000","last_peered":"2024-09-10T15:27:28.414504+0000","last_clean":"2024-09-10T15:27:28.414504+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:28.414504+0000","last_undegraded":"2024-09-10T15:27:28.414504+0000","last_fullsized":"2024-09-10T15:27:28.414504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416694+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:27:28.416694+0000","last_peered":"2024-09-10T15:27:28.416694+0000","last_clean":"2024-09-10T15:27:28.416694+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:27:28.416694+0000","last_undegraded":"2024-09-10T15:27:28.416694+0000","last_fullsized":"2024-09-10T15:27:28.416694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"76'19","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315429+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:27:28.315429+0000","last_peered":"2024-09-10T15:27:28.315429+0000","last_clean":"2024-09-10T15:27:28.315429+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:27:28.315429+0000","last_undegraded":"2024-09-10T15:27:28.315429+0000","last_fullsized":"2024-09-10T15:27:28.315429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":48,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948332+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:28.948332+0000","last_peered":"2024-09-10T15:27:28.948332+0000","last_clean":"2024-09-10T15:27:28.948332+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:28.948332+0000","last_undegraded":"2024-09-10T15:27:28.948332+0000","last_fullsized":"2024-09-10T15:27:28.948332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947162+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:28.947162+0000","last_peered":"2024-09-10T15:27:28.947162+0000","last_clean":"2024-09-10T15:27:28.947162+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:28.947162+0000","last_undegraded":"2024-09-10T15:27:28.947162+0000","last_fullsized":"2024-09-10T15:27:28.947162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416344+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:28.416344+0000","last_peered":"2024-09-10T15:27:28.416344+0000","last_clean":"2024-09-10T15:27:28.416344+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:28.416344+0000","last_undegraded":"2024-09-10T15:27:28.416344+0000","last_fullsized":"2024-09-10T15:27:28.416344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"71'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333128+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:27:28.333128+0000","last_peered":"2024-09-10T15:27:28.333128+0000","last_clean":"2024-09-10T15:27:28.333128+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:27:28.333128+0000","last_undegraded":"2024-09-10T15:27:28.333128+0000","last_fullsized":"2024-09-10T15:27:28.333128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314735+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:27:28.314735+0000","last_peered":"2024-09-10T15:27:28.314735+0000","last_clean":"2024-09-10T15:27:28.314735+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:27:28.314735+0000","last_undegraded":"2024-09-10T15:27:28.314735+0000","last_fullsized":"2024-09-10T15:27:28.314735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948359+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:27:28.948359+0000","last_peered":"2024-09-10T15:27:28.948359+0000","last_clean":"2024-09-10T15:27:28.948359+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:27:28.948359+0000","last_undegraded":"2024-09-10T15:27:28.948359+0000","last_fullsized":"2024-09-10T15:27:28.948359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948242+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:28.948242+0000","last_peered":"2024-09-10T15:27:28.948242+0000","last_clean":"2024-09-10T15:27:28.948242+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:28.948242+0000","last_undegraded":"2024-09-10T15:27:28.948242+0000","last_fullsized":"2024-09-10T15:27:28.948242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331754+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:28.331754+0000","last_peered":"2024-09-10T15:27:28.331754+0000","last_clean":"2024-09-10T15:27:28.331754+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:28.331754+0000","last_undegraded":"2024-09-10T15:27:28.331754+0000","last_fullsized":"2024-09-10T15:27:28.331754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696836+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:27:28.696836+0000","last_peered":"2024-09-10T15:27:28.696836+0000","last_clean":"2024-09-10T15:27:28.696836+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:27:28.696836+0000","last_undegraded":"2024-09-10T15:27:28.696836+0000","last_fullsized":"2024-09-10T15:27:28.696836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415399+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:28.415399+0000","last_peered":"2024-09-10T15:27:28.415399+0000","last_clean":"2024-09-10T15:27:28.415399+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:28.415399+0000","last_undegraded":"2024-09-10T15:27:28.415399+0000","last_fullsized":"2024-09-10T15:27:28.415399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315726+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:28.315726+0000","last_peered":"2024-09-10T15:27:28.315726+0000","last_clean":"2024-09-10T15:27:28.315726+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:28.315726+0000","last_undegraded":"2024-09-10T15:27:28.315726+0000","last_fullsized":"2024-09-10T15:27:28.315726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314442+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:28.314442+0000","last_peered":"2024-09-10T15:27:28.314442+0000","last_clean":"2024-09-10T15:27:28.314442+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:28.314442+0000","last_undegraded":"2024-09-10T15:27:28.314442+0000","last_fullsized":"2024-09-10T15:27:28.314442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'15","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.073313+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:27:34.073313+0000","last_peered":"2024-09-10T15:27:34.073313+0000","last_clean":"2024-09-10T15:27:34.073313+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:27:34.073313+0000","last_undegraded":"2024-09-10T15:27:34.073313+0000","last_fullsized":"2024-09-10T15:27:34.073313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340622+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:28.340622+0000","last_peered":"2024-09-10T15:27:28.340622+0000","last_clean":"2024-09-10T15:27:28.340622+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:28.340622+0000","last_undegraded":"2024-09-10T15:27:28.340622+0000","last_fullsized":"2024-09-10T15:27:28.340622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696983+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:27:28.696983+0000","last_peered":"2024-09-10T15:27:28.696983+0000","last_clean":"2024-09-10T15:27:28.696983+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:27:28.696983+0000","last_undegraded":"2024-09-10T15:27:28.696983+0000","last_fullsized":"2024-09-10T15:27:28.696983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"76'8","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947752+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:28.947752+0000","last_peered":"2024-09-10T15:27:28.947752+0000","last_clean":"2024-09-10T15:27:28.947752+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:28.947752+0000","last_undegraded":"2024-09-10T15:27:28.947752+0000","last_fullsized":"2024-09-10T15:27:28.947752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20492,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416291+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:27:28.416291+0000","last_peered":"2024-09-10T15:27:28.416291+0000","last_clean":"2024-09-10T15:27:28.416291+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:27:28.416291+0000","last_undegraded":"2024-09-10T15:27:28.416291+0000","last_fullsized":"2024-09-10T15:27:28.416291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"76'18","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341435+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:27:28.341435+0000","last_peered":"2024-09-10T15:27:28.341435+0000","last_clean":"2024-09-10T15:27:28.341435+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:27:28.341435+0000","last_undegraded":"2024-09-10T15:27:28.341435+0000","last_fullsized":"2024-09-10T15:27:28.341435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":43,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.084063+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:27:34.084063+0000","last_peered":"2024-09-10T15:27:34.084063+0000","last_clean":"2024-09-10T15:27:34.084063+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:27:34.084063+0000","last_undegraded":"2024-09-10T15:27:34.084063+0000","last_fullsized":"2024-09-10T15:27:34.084063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415061+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415061+0000","last_peered":"2024-09-10T15:27:28.415061+0000","last_clean":"2024-09-10T15:27:28.415061+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415061+0000","last_undegraded":"2024-09-10T15:27:28.415061+0000","last_fullsized":"2024-09-10T15:27:28.415061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"76'7","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316110+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:27:28.316110+0000","last_peered":"2024-09-10T15:27:28.316110+0000","last_clean":"2024-09-10T15:27:28.316110+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:27:28.316110+0000","last_undegraded":"2024-09-10T15:27:28.316110+0000","last_fullsized":"2024-09-10T15:27:28.316110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":27,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947301+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:27:28.947301+0000","last_peered":"2024-09-10T15:27:28.947301+0000","last_clean":"2024-09-10T15:27:28.947301+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:27:28.947301+0000","last_undegraded":"2024-09-10T15:27:28.947301+0000","last_fullsized":"2024-09-10T15:27:28.947301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313995+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:28.313995+0000","last_peered":"2024-09-10T15:27:28.313995+0000","last_clean":"2024-09-10T15:27:28.313995+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:28.313995+0000","last_undegraded":"2024-09-10T15:27:28.313995+0000","last_fullsized":"2024-09-10T15:27:28.313995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332970+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:28.332970+0000","last_peered":"2024-09-10T15:27:28.332970+0000","last_clean":"2024-09-10T15:27:28.332970+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:28.332970+0000","last_undegraded":"2024-09-10T15:27:28.332970+0000","last_fullsized":"2024-09-10T15:27:28.332970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341427+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341427+0000","last_peered":"2024-09-10T15:27:28.341427+0000","last_clean":"2024-09-10T15:27:28.341427+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341427+0000","last_undegraded":"2024-09-10T15:27:28.341427+0000","last_fullsized":"2024-09-10T15:27:28.341427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947386+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:27:28.947386+0000","last_peered":"2024-09-10T15:27:28.947386+0000","last_clean":"2024-09-10T15:27:28.947386+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:27:28.947386+0000","last_undegraded":"2024-09-10T15:27:28.947386+0000","last_fullsized":"2024-09-10T15:27:28.947386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339988+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:27:28.339988+0000","last_peered":"2024-09-10T15:27:28.339988+0000","last_clean":"2024-09-10T15:27:28.339988+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:27:28.339988+0000","last_undegraded":"2024-09-10T15:27:28.339988+0000","last_fullsized":"2024-09-10T15:27:28.339988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":32786,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331759+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:27:28.331759+0000","last_peered":"2024-09-10T15:27:28.331759+0000","last_clean":"2024-09-10T15:27:28.331759+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:27:28.331759+0000","last_undegraded":"2024-09-10T15:27:28.331759+0000","last_fullsized":"2024-09-10T15:27:28.331759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314343+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:27:28.314343+0000","last_peered":"2024-09-10T15:27:28.314343+0000","last_clean":"2024-09-10T15:27:28.314343+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:27:28.314343+0000","last_undegraded":"2024-09-10T15:27:28.314343+0000","last_fullsized":"2024-09-10T15:27:28.314343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313553+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:28.313553+0000","last_peered":"2024-09-10T15:27:28.313553+0000","last_clean":"2024-09-10T15:27:28.313553+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:28.313553+0000","last_undegraded":"2024-09-10T15:27:28.313553+0000","last_fullsized":"2024-09-10T15:27:28.313553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947771+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947771+0000","last_peered":"2024-09-10T15:27:28.947771+0000","last_clean":"2024-09-10T15:27:28.947771+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947771+0000","last_undegraded":"2024-09-10T15:27:28.947771+0000","last_fullsized":"2024-09-10T15:27:28.947771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340664+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:27:28.340664+0000","last_peered":"2024-09-10T15:27:28.340664+0000","last_clean":"2024-09-10T15:27:28.340664+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:27:28.340664+0000","last_undegraded":"2024-09-10T15:27:28.340664+0000","last_fullsized":"2024-09-10T15:27:28.340664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"69'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416098+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:28.416098+0000","last_peered":"2024-09-10T15:27:28.416098+0000","last_clean":"2024-09-10T15:27:28.416098+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:28.416098+0000","last_undegraded":"2024-09-10T15:27:28.416098+0000","last_fullsized":"2024-09-10T15:27:28.416098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695255+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:28.695255+0000","last_peered":"2024-09-10T15:27:28.695255+0000","last_clean":"2024-09-10T15:27:28.695255+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:28.695255+0000","last_undegraded":"2024-09-10T15:27:28.695255+0000","last_fullsized":"2024-09-10T15:27:28.695255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414864+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:27:28.414864+0000","last_peered":"2024-09-10T15:27:28.414864+0000","last_clean":"2024-09-10T15:27:28.414864+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:27:28.414864+0000","last_undegraded":"2024-09-10T15:27:28.414864+0000","last_fullsized":"2024-09-10T15:27:28.414864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'15","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.195021+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:27:33.195021+0000","last_peered":"2024-09-10T15:27:33.195021+0000","last_clean":"2024-09-10T15:27:33.195021+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:27:33.195021+0000","last_undegraded":"2024-09-10T15:27:33.195021+0000","last_fullsized":"2024-09-10T15:27:33.195021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334472+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:28.334472+0000","last_peered":"2024-09-10T15:27:28.334472+0000","last_clean":"2024-09-10T15:27:28.334472+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:28.334472+0000","last_undegraded":"2024-09-10T15:27:28.334472+0000","last_fullsized":"2024-09-10T15:27:28.334472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696128+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:27:28.696128+0000","last_peered":"2024-09-10T15:27:28.696128+0000","last_clean":"2024-09-10T15:27:28.696128+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:27:28.696128+0000","last_undegraded":"2024-09-10T15:27:28.696128+0000","last_fullsized":"2024-09-10T15:27:28.696128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'12","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315573+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:27:28.315573+0000","last_peered":"2024-09-10T15:27:28.315573+0000","last_clean":"2024-09-10T15:27:28.315573+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:27:28.315573+0000","last_undegraded":"2024-09-10T15:27:28.315573+0000","last_fullsized":"2024-09-10T15:27:28.315573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332058+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:27:28.332058+0000","last_peered":"2024-09-10T15:27:28.332058+0000","last_clean":"2024-09-10T15:27:28.332058+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:27:28.332058+0000","last_undegraded":"2024-09-10T15:27:28.332058+0000","last_fullsized":"2024-09-10T15:27:28.332058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'25","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312917+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:27:28.312917+0000","last_peered":"2024-09-10T15:27:28.312917+0000","last_clean":"2024-09-10T15:27:28.312917+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:27:28.312917+0000","last_undegraded":"2024-09-10T15:27:28.312917+0000","last_fullsized":"2024-09-10T15:27:28.312917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":32,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694615+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:27:28.694615+0000","last_peered":"2024-09-10T15:27:28.694615+0000","last_clean":"2024-09-10T15:27:28.694615+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:27:28.694615+0000","last_undegraded":"2024-09-10T15:27:28.694615+0000","last_fullsized":"2024-09-10T15:27:28.694615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492786+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:28.492786+0000","last_peered":"2024-09-10T15:27:28.492786+0000","last_clean":"2024-09-10T15:27:28.492786+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:28.492786+0000","last_undegraded":"2024-09-10T15:27:28.492786+0000","last_fullsized":"2024-09-10T15:27:28.492786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315251+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.315251+0000","last_peered":"2024-09-10T15:27:28.315251+0000","last_clean":"2024-09-10T15:27:28.315251+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:27:28.315251+0000","last_undegraded":"2024-09-10T15:27:28.315251+0000","last_fullsized":"2024-09-10T15:27:28.315251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490986+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:27:28.490986+0000","last_peered":"2024-09-10T15:27:28.490986+0000","last_clean":"2024-09-10T15:27:28.490986+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:27:28.490986+0000","last_undegraded":"2024-09-10T15:27:28.490986+0000","last_fullsized":"2024-09-10T15:27:28.490986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491267+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:27:28.491267+0000","last_peered":"2024-09-10T15:27:28.491267+0000","last_clean":"2024-09-10T15:27:28.491267+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:27:28.491267+0000","last_undegraded":"2024-09-10T15:27:28.491267+0000","last_fullsized":"2024-09-10T15:27:28.491267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"76'18","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948281+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:27:28.948281+0000","last_peered":"2024-09-10T15:27:28.948281+0000","last_clean":"2024-09-10T15:27:28.948281+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:27:28.948281+0000","last_undegraded":"2024-09-10T15:27:28.948281+0000","last_fullsized":"2024-09-10T15:27:28.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":27,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489636+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:28.489636+0000","last_peered":"2024-09-10T15:27:28.489636+0000","last_clean":"2024-09-10T15:27:28.489636+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:28.489636+0000","last_undegraded":"2024-09-10T15:27:28.489636+0000","last_fullsized":"2024-09-10T15:27:28.489636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693570+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693570+0000","last_peered":"2024-09-10T15:27:28.693570+0000","last_clean":"2024-09-10T15:27:28.693570+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693570+0000","last_undegraded":"2024-09-10T15:27:28.693570+0000","last_fullsized":"2024-09-10T15:27:28.693570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416540+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416540+0000","last_peered":"2024-09-10T15:27:28.416540+0000","last_clean":"2024-09-10T15:27:28.416540+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416540+0000","last_undegraded":"2024-09-10T15:27:28.416540+0000","last_fullsized":"2024-09-10T15:27:28.416540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"76'6","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415506+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:28.415506+0000","last_peered":"2024-09-10T15:27:28.415506+0000","last_clean":"2024-09-10T15:27:28.415506+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:28.415506+0000","last_undegraded":"2024-09-10T15:27:28.415506+0000","last_fullsized":"2024-09-10T15:27:28.415506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696187+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:28.696187+0000","last_peered":"2024-09-10T15:27:28.696187+0000","last_clean":"2024-09-10T15:27:28.696187+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:28.696187+0000","last_undegraded":"2024-09-10T15:27:28.696187+0000","last_fullsized":"2024-09-10T15:27:28.696187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"76'19","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696345+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:28.696345+0000","last_peered":"2024-09-10T15:27:28.696345+0000","last_clean":"2024-09-10T15:27:28.696345+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:28.696345+0000","last_undegraded":"2024-09-10T15:27:28.696345+0000","last_fullsized":"2024-09-10T15:27:28.696345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.075687+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:27:34.075687+0000","last_peered":"2024-09-10T15:27:34.075687+0000","last_clean":"2024-09-10T15:27:34.075687+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:27:34.075687+0000","last_undegraded":"2024-09-10T15:27:34.075687+0000","last_fullsized":"2024-09-10T15:27:34.075687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331612+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331612+0000","last_peered":"2024-09-10T15:27:28.331612+0000","last_clean":"2024-09-10T15:27:28.331612+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331612+0000","last_undegraded":"2024-09-10T15:27:28.331612+0000","last_fullsized":"2024-09-10T15:27:28.331612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341512+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341512+0000","last_peered":"2024-09-10T15:27:28.341512+0000","last_clean":"2024-09-10T15:27:28.341512+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341512+0000","last_undegraded":"2024-09-10T15:27:28.341512+0000","last_fullsized":"2024-09-10T15:27:28.341512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"71'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414253+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:28.414253+0000","last_peered":"2024-09-10T15:27:28.414253+0000","last_clean":"2024-09-10T15:27:28.414253+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:28.414253+0000","last_undegraded":"2024-09-10T15:27:28.414253+0000","last_fullsized":"2024-09-10T15:27:28.414253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948481+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:27:28.948481+0000","last_peered":"2024-09-10T15:27:28.948481+0000","last_clean":"2024-09-10T15:27:28.948481+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:27:28.948481+0000","last_undegraded":"2024-09-10T15:27:28.948481+0000","last_fullsized":"2024-09-10T15:27:28.948481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333326+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:28.333326+0000","last_peered":"2024-09-10T15:27:28.333326+0000","last_clean":"2024-09-10T15:27:28.333326+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:28.333326+0000","last_undegraded":"2024-09-10T15:27:28.333326+0000","last_fullsized":"2024-09-10T15:27:28.333326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'15","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.078767+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:27:34.078767+0000","last_peered":"2024-09-10T15:27:34.078767+0000","last_clean":"2024-09-10T15:27:34.078767+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:27:34.078767+0000","last_undegraded":"2024-09-10T15:27:34.078767+0000","last_fullsized":"2024-09-10T15:27:34.078767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340473+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340473+0000","last_peered":"2024-09-10T15:27:28.340473+0000","last_clean":"2024-09-10T15:27:28.340473+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340473+0000","last_undegraded":"2024-09-10T15:27:28.340473+0000","last_fullsized":"2024-09-10T15:27:28.340473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493307+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:27:28.493307+0000","last_peered":"2024-09-10T15:27:28.493307+0000","last_clean":"2024-09-10T15:27:28.493307+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:27:28.493307+0000","last_undegraded":"2024-09-10T15:27:28.493307+0000","last_fullsized":"2024-09-10T15:27:28.493307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"76'11","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313936+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:28.313936+0000","last_peered":"2024-09-10T15:27:28.313936+0000","last_clean":"2024-09-10T15:27:28.313936+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:28.313936+0000","last_undegraded":"2024-09-10T15:27:28.313936+0000","last_fullsized":"2024-09-10T15:27:28.313936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416759+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:27:28.416759+0000","last_peered":"2024-09-10T15:27:28.416759+0000","last_clean":"2024-09-10T15:27:28.416759+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:27:28.416759+0000","last_undegraded":"2024-09-10T15:27:28.416759+0000","last_fullsized":"2024-09-10T15:27:28.416759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"76'21","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947901+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:27:28.947901+0000","last_peered":"2024-09-10T15:27:28.947901+0000","last_clean":"2024-09-10T15:27:28.947901+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:27:28.947901+0000","last_undegraded":"2024-09-10T15:27:28.947901+0000","last_fullsized":"2024-09-10T15:27:28.947901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341994+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:28.341994+0000","last_peered":"2024-09-10T15:27:28.341994+0000","last_clean":"2024-09-10T15:27:28.341994+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:28.341994+0000","last_undegraded":"2024-09-10T15:27:28.341994+0000","last_fullsized":"2024-09-10T15:27:28.341994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489952+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.489952+0000","last_peered":"2024-09-10T15:27:28.489952+0000","last_clean":"2024-09-10T15:27:28.489952+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.489952+0000","last_undegraded":"2024-09-10T15:27:28.489952+0000","last_fullsized":"2024-09-10T15:27:28.489952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416212+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416212+0000","last_peered":"2024-09-10T15:27:28.416212+0000","last_clean":"2024-09-10T15:27:28.416212+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416212+0000","last_undegraded":"2024-09-10T15:27:28.416212+0000","last_fullsized":"2024-09-10T15:27:28.416212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":315,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947773+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:27:28.947773+0000","last_peered":"2024-09-10T15:27:28.947773+0000","last_clean":"2024-09-10T15:27:28.947773+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:27:28.947773+0000","last_undegraded":"2024-09-10T15:27:28.947773+0000","last_fullsized":"2024-09-10T15:27:28.947773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415740+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415740+0000","last_peered":"2024-09-10T15:27:28.415740+0000","last_clean":"2024-09-10T15:27:28.415740+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415740+0000","last_undegraded":"2024-09-10T15:27:28.415740+0000","last_fullsized":"2024-09-10T15:27:28.415740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314357+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:28.314357+0000","last_peered":"2024-09-10T15:27:28.314357+0000","last_clean":"2024-09-10T15:27:28.314357+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:28.314357+0000","last_undegraded":"2024-09-10T15:27:28.314357+0000","last_fullsized":"2024-09-10T15:27:28.314357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":49176,"num_write":56,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314018+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:27:28.314018+0000","last_peered":"2024-09-10T15:27:28.314018+0000","last_clean":"2024-09-10T15:27:28.314018+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:27:28.314018+0000","last_undegraded":"2024-09-10T15:27:28.314018+0000","last_fullsized":"2024-09-10T15:27:28.314018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'30","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416630+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:27:28.416630+0000","last_peered":"2024-09-10T15:27:28.416630+0000","last_clean":"2024-09-10T15:27:28.416630+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:27:28.416630+0000","last_undegraded":"2024-09-10T15:27:28.416630+0000","last_fullsized":"2024-09-10T15:27:28.416630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28500,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693638+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:27:28.693638+0000","last_peered":"2024-09-10T15:27:28.693638+0000","last_clean":"2024-09-10T15:27:28.693638+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:27:28.693638+0000","last_undegraded":"2024-09-10T15:27:28.693638+0000","last_fullsized":"2024-09-10T15:27:28.693638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314349+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:28.314349+0000","last_peered":"2024-09-10T15:27:28.314349+0000","last_clean":"2024-09-10T15:27:28.314349+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:28.314349+0000","last_undegraded":"2024-09-10T15:27:28.314349+0000","last_fullsized":"2024-09-10T15:27:28.314349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696870+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:27:28.696870+0000","last_peered":"2024-09-10T15:27:28.696870+0000","last_clean":"2024-09-10T15:27:28.696870+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:27:28.696870+0000","last_undegraded":"2024-09-10T15:27:28.696870+0000","last_fullsized":"2024-09-10T15:27:28.696870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415458+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415458+0000","last_peered":"2024-09-10T15:27:28.415458+0000","last_clean":"2024-09-10T15:27:28.415458+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415458+0000","last_undegraded":"2024-09-10T15:27:28.415458+0000","last_fullsized":"2024-09-10T15:27:28.415458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"76'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332661+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:27:28.332661+0000","last_peered":"2024-09-10T15:27:28.332661+0000","last_clean":"2024-09-10T15:27:28.332661+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:27:28.332661+0000","last_undegraded":"2024-09-10T15:27:28.332661+0000","last_fullsized":"2024-09-10T15:27:28.332661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":24,"num_read_kb":49164,"num_write":36,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416394+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:27:28.416394+0000","last_peered":"2024-09-10T15:27:28.416394+0000","last_clean":"2024-09-10T15:27:28.416394+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:27:28.416394+0000","last_undegraded":"2024-09-10T15:27:28.416394+0000","last_fullsized":"2024-09-10T15:27:28.416394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'49","reported_seq":232,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035688+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:27:31.035688+0000","last_peered":"2024-09-10T15:27:31.035688+0000","last_clean":"2024-09-10T15:27:31.035688+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:27:31.035688+0000","last_undegraded":"2024-09-10T15:27:31.035688+0000","last_fullsized":"2024-09-10T15:27:31.035688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":85,"num_write":48,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416482+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:27:28.416482+0000","last_peered":"2024-09-10T15:27:28.416482+0000","last_clean":"2024-09-10T15:27:28.416482+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:27:28.416482+0000","last_undegraded":"2024-09-10T15:27:28.416482+0000","last_fullsized":"2024-09-10T15:27:28.416482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694935+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:28.694935+0000","last_peered":"2024-09-10T15:27:28.694935+0000","last_clean":"2024-09-10T15:27:28.694935+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:28.694935+0000","last_undegraded":"2024-09-10T15:27:28.694935+0000","last_fullsized":"2024-09-10T15:27:28.694935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334556+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:27:28.334556+0000","last_peered":"2024-09-10T15:27:28.334556+0000","last_clean":"2024-09-10T15:27:28.334556+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:27:28.334556+0000","last_undegraded":"2024-09-10T15:27:28.334556+0000","last_fullsized":"2024-09-10T15:27:28.334556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490049+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:27:28.490049+0000","last_peered":"2024-09-10T15:27:28.490049+0000","last_clean":"2024-09-10T15:27:28.490049+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:27:28.490049+0000","last_undegraded":"2024-09-10T15:27:28.490049+0000","last_fullsized":"2024-09-10T15:27:28.490049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694409+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:28.694409+0000","last_peered":"2024-09-10T15:27:28.694409+0000","last_clean":"2024-09-10T15:27:28.694409+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:28.694409+0000","last_undegraded":"2024-09-10T15:27:28.694409+0000","last_fullsized":"2024-09-10T15:27:28.694409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24588,"num_write":29,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492515+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:27:28.492515+0000","last_peered":"2024-09-10T15:27:28.492515+0000","last_clean":"2024-09-10T15:27:28.492515+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:27:28.492515+0000","last_undegraded":"2024-09-10T15:27:28.492515+0000","last_fullsized":"2024-09-10T15:27:28.492515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035733+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:27:31.035733+0000","last_peered":"2024-09-10T15:27:31.035733+0000","last_clean":"2024-09-10T15:27:31.035733+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:27:31.035733+0000","last_undegraded":"2024-09-10T15:27:31.035733+0000","last_fullsized":"2024-09-10T15:27:31.035733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314725+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.314725+0000","last_peered":"2024-09-10T15:27:28.314725+0000","last_clean":"2024-09-10T15:27:28.314725+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.314725+0000","last_undegraded":"2024-09-10T15:27:28.314725+0000","last_fullsized":"2024-09-10T15:27:28.314725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314109+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:28.314109+0000","last_peered":"2024-09-10T15:27:28.314109+0000","last_clean":"2024-09-10T15:27:28.314109+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:28.314109+0000","last_undegraded":"2024-09-10T15:27:28.314109+0000","last_fullsized":"2024-09-10T15:27:28.314109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333823+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333823+0000","last_peered":"2024-09-10T15:27:28.333823+0000","last_clean":"2024-09-10T15:27:28.333823+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333823+0000","last_undegraded":"2024-09-10T15:27:28.333823+0000","last_fullsized":"2024-09-10T15:27:28.333823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415593+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415593+0000","last_peered":"2024-09-10T15:27:28.415593+0000","last_clean":"2024-09-10T15:27:28.415593+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415593+0000","last_undegraded":"2024-09-10T15:27:28.415593+0000","last_fullsized":"2024-09-10T15:27:28.415593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"76'9","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489894+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:28.489894+0000","last_peered":"2024-09-10T15:27:28.489894+0000","last_clean":"2024-09-10T15:27:28.489894+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:28.489894+0000","last_undegraded":"2024-09-10T15:27:28.489894+0000","last_fullsized":"2024-09-10T15:27:28.489894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:22.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491363+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:27:28.491363+0000","last_peered":"2024-09-10T15:27:28.491363+0000","last_clean":"2024-09-10T15:27:28.491363+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:27:28.491363+0000","last_undegraded":"2024-09-10T15:27:28.491363+0000","last_fullsized":"2024-09-10T15:27:28.491363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696503+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:27:28.696503+0000","last_peered":"2024-09-10T15:27:28.696503+0000","last_clean":"2024-09-10T15:27:28.696503+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:27:28.696503+0000","last_undegraded":"2024-09-10T15:27:28.696503+0000","last_fullsized":"2024-09-10T15:27:28.696503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416993+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:28.416993+0000","last_peered":"2024-09-10T15:27:28.416993+0000","last_clean":"2024-09-10T15:27:28.416993+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:28.416993+0000","last_undegraded":"2024-09-10T15:27:28.416993+0000","last_fullsized":"2024-09-10T15:27:28.416993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947060+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:28.947060+0000","last_peered":"2024-09-10T15:27:28.947060+0000","last_clean":"2024-09-10T15:27:28.947060+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:28.947060+0000","last_undegraded":"2024-09-10T15:27:28.947060+0000","last_fullsized":"2024-09-10T15:27:28.947060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332108+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332108+0000","last_peered":"2024-09-10T15:27:28.332108+0000","last_clean":"2024-09-10T15:27:28.332108+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332108+0000","last_undegraded":"2024-09-10T15:27:28.332108+0000","last_fullsized":"2024-09-10T15:27:28.332108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341413+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:27:28.341413+0000","last_peered":"2024-09-10T15:27:28.341413+0000","last_clean":"2024-09-10T15:27:28.341413+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:27:28.341413+0000","last_undegraded":"2024-09-10T15:27:28.341413+0000","last_fullsized":"2024-09-10T15:27:28.341413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697320+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697320+0000","last_peered":"2024-09-10T15:27:28.697320+0000","last_clean":"2024-09-10T15:27:28.697320+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697320+0000","last_undegraded":"2024-09-10T15:27:28.697320+0000","last_fullsized":"2024-09-10T15:27:28.697320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314579+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:27:28.314579+0000","last_peered":"2024-09-10T15:27:28.314579+0000","last_clean":"2024-09-10T15:27:28.314579+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:27:28.314579+0000","last_undegraded":"2024-09-10T15:27:28.314579+0000","last_fullsized":"2024-09-10T15:27:28.314579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"76'28","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490320+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:27:28.490320+0000","last_peered":"2024-09-10T15:27:28.490320+0000","last_clean":"2024-09-10T15:27:28.490320+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:27:28.490320+0000","last_undegraded":"2024-09-10T15:27:28.490320+0000","last_fullsized":"2024-09-10T15:27:28.490320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16571,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340394+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340394+0000","last_peered":"2024-09-10T15:27:28.340394+0000","last_clean":"2024-09-10T15:27:28.340394+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340394+0000","last_undegraded":"2024-09-10T15:27:28.340394+0000","last_fullsized":"2024-09-10T15:27:28.340394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696197+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:28.696197+0000","last_peered":"2024-09-10T15:27:28.696197+0000","last_clean":"2024-09-10T15:27:28.696197+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:28.696197+0000","last_undegraded":"2024-09-10T15:27:28.696197+0000","last_fullsized":"2024-09-10T15:27:28.696197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333620+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:27:28.333620+0000","last_peered":"2024-09-10T15:27:28.333620+0000","last_clean":"2024-09-10T15:27:28.333620+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:27:28.333620+0000","last_undegraded":"2024-09-10T15:27:28.333620+0000","last_fullsized":"2024-09-10T15:27:28.333620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334268+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:27:28.334268+0000","last_peered":"2024-09-10T15:27:28.334268+0000","last_clean":"2024-09-10T15:27:28.334268+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:27:28.334268+0000","last_undegraded":"2024-09-10T15:27:28.334268+0000","last_fullsized":"2024-09-10T15:27:28.334268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414797+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414797+0000","last_peered":"2024-09-10T15:27:28.414797+0000","last_clean":"2024-09-10T15:27:28.414797+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414797+0000","last_undegraded":"2024-09-10T15:27:28.414797+0000","last_fullsized":"2024-09-10T15:27:28.414797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313704+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:27:28.313704+0000","last_peered":"2024-09-10T15:27:28.313704+0000","last_clean":"2024-09-10T15:27:28.313704+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:27:28.313704+0000","last_undegraded":"2024-09-10T15:27:28.313704+0000","last_fullsized":"2024-09-10T15:27:28.313704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331980+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.331980+0000","last_peered":"2024-09-10T15:27:28.331980+0000","last_clean":"2024-09-10T15:27:28.331980+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.331980+0000","last_undegraded":"2024-09-10T15:27:28.331980+0000","last_fullsized":"2024-09-10T15:27:28.331980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035702+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:31.035702+0000","last_peered":"2024-09-10T15:27:31.035702+0000","last_clean":"2024-09-10T15:27:31.035702+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:31.035702+0000","last_undegraded":"2024-09-10T15:27:31.035702+0000","last_fullsized":"2024-09-10T15:27:31.035702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492360+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:28.492360+0000","last_peered":"2024-09-10T15:27:28.492360+0000","last_clean":"2024-09-10T15:27:28.492360+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:28.492360+0000","last_undegraded":"2024-09-10T15:27:28.492360+0000","last_fullsized":"2024-09-10T15:27:28.492360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313734+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:27:28.313734+0000","last_peered":"2024-09-10T15:27:28.313734+0000","last_clean":"2024-09-10T15:27:28.313734+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:27:28.313734+0000","last_undegraded":"2024-09-10T15:27:28.313734+0000","last_fullsized":"2024-09-10T15:27:28.313734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"76'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316031+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:28.316031+0000","last_peered":"2024-09-10T15:27:28.316031+0000","last_clean":"2024-09-10T15:27:28.316031+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:28.316031+0000","last_undegraded":"2024-09-10T15:27:28.316031+0000","last_fullsized":"2024-09-10T15:27:28.316031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316149+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316149+0000","last_peered":"2024-09-10T15:27:28.316149+0000","last_clean":"2024-09-10T15:27:28.316149+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316149+0000","last_undegraded":"2024-09-10T15:27:28.316149+0000","last_fullsized":"2024-09-10T15:27:28.316149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414992+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:27:28.414992+0000","last_peered":"2024-09-10T15:27:28.414992+0000","last_clean":"2024-09-10T15:27:28.414992+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:27:28.414992+0000","last_undegraded":"2024-09-10T15:27:28.414992+0000","last_fullsized":"2024-09-10T15:27:28.414992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415219+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:27:28.415219+0000","last_peered":"2024-09-10T15:27:28.415219+0000","last_clean":"2024-09-10T15:27:28.415219+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:27:28.415219+0000","last_undegraded":"2024-09-10T15:27:28.415219+0000","last_fullsized":"2024-09-10T15:27:28.415219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'15","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035813+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:27:31.035813+0000","last_peered":"2024-09-10T15:27:31.035813+0000","last_clean":"2024-09-10T15:27:31.035813+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:27:31.035813+0000","last_undegraded":"2024-09-10T15:27:31.035813+0000","last_fullsized":"2024-09-10T15:27:31.035813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695333+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:28.695333+0000","last_peered":"2024-09-10T15:27:28.695333+0000","last_clean":"2024-09-10T15:27:28.695333+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:28.695333+0000","last_undegraded":"2024-09-10T15:27:28.695333+0000","last_fullsized":"2024-09-10T15:27:28.695333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340766+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:27:28.340766+0000","last_peered":"2024-09-10T15:27:28.340766+0000","last_clean":"2024-09-10T15:27:28.340766+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:27:28.340766+0000","last_undegraded":"2024-09-10T15:27:28.340766+0000","last_fullsized":"2024-09-10T15:27:28.340766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'8","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315897+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:28.315897+0000","last_peered":"2024-09-10T15:27:28.315897+0000","last_clean":"2024-09-10T15:27:28.315897+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:28.315897+0000","last_undegraded":"2024-09-10T15:27:28.315897+0000","last_fullsized":"2024-09-10T15:27:28.315897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414338+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414338+0000","last_peered":"2024-09-10T15:27:28.414338+0000","last_clean":"2024-09-10T15:27:28.414338+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414338+0000","last_undegraded":"2024-09-10T15:27:28.414338+0000","last_fullsized":"2024-09-10T15:27:28.414338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313222+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:27:28.313222+0000","last_peered":"2024-09-10T15:27:28.313222+0000","last_clean":"2024-09-10T15:27:28.313222+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:27:28.313222+0000","last_undegraded":"2024-09-10T15:27:28.313222+0000","last_fullsized":"2024-09-10T15:27:28.313222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"76'30","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313533+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:28.313533+0000","last_peered":"2024-09-10T15:27:28.313533+0000","last_clean":"2024-09-10T15:27:28.313533+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:28.313533+0000","last_undegraded":"2024-09-10T15:27:28.313533+0000","last_fullsized":"2024-09-10T15:27:28.313533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16131,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314089+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314089+0000","last_peered":"2024-09-10T15:27:28.314089+0000","last_clean":"2024-09-10T15:27:28.314089+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314089+0000","last_undegraded":"2024-09-10T15:27:28.314089+0000","last_fullsized":"2024-09-10T15:27:28.314089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341327+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:28.341327+0000","last_peered":"2024-09-10T15:27:28.341327+0000","last_clean":"2024-09-10T15:27:28.341327+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:28.341327+0000","last_undegraded":"2024-09-10T15:27:28.341327+0000","last_fullsized":"2024-09-10T15:27:28.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314871+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314871+0000","last_peered":"2024-09-10T15:27:28.314871+0000","last_clean":"2024-09-10T15:27:28.314871+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314871+0000","last_undegraded":"2024-09-10T15:27:28.314871+0000","last_fullsized":"2024-09-10T15:27:28.314871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341154+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:27:28.341154+0000","last_peered":"2024-09-10T15:27:28.341154+0000","last_clean":"2024-09-10T15:27:28.341154+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:27:28.341154+0000","last_undegraded":"2024-09-10T15:27:28.341154+0000","last_fullsized":"2024-09-10T15:27:28.341154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416215+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:27:28.416215+0000","last_peered":"2024-09-10T15:27:28.416215+0000","last_clean":"2024-09-10T15:27:28.416215+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:27:28.416215+0000","last_undegraded":"2024-09-10T15:27:28.416215+0000","last_fullsized":"2024-09-10T15:27:28.416215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":45068,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332605+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:27:28.332605+0000","last_peered":"2024-09-10T15:27:28.332605+0000","last_clean":"2024-09-10T15:27:28.332605+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:27:28.332605+0000","last_undegraded":"2024-09-10T15:27:28.332605+0000","last_fullsized":"2024-09-10T15:27:28.332605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"76'18","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332079+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:27:28.332079+0000","last_peered":"2024-09-10T15:27:28.332079+0000","last_clean":"2024-09-10T15:27:28.332079+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:27:28.332079+0000","last_undegraded":"2024-09-10T15:27:28.332079+0000","last_fullsized":"2024-09-10T15:27:28.332079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489143+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:27:28.489143+0000","last_peered":"2024-09-10T15:27:28.489143+0000","last_clean":"2024-09-10T15:27:28.489143+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:27:28.489143+0000","last_undegraded":"2024-09-10T15:27:28.489143+0000","last_fullsized":"2024-09-10T15:27:28.489143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492067+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492067+0000","last_peered":"2024-09-10T15:27:28.492067+0000","last_clean":"2024-09-10T15:27:28.492067+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492067+0000","last_undegraded":"2024-09-10T15:27:28.492067+0000","last_fullsized":"2024-09-10T15:27:28.492067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314013+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:28.314013+0000","last_peered":"2024-09-10T15:27:28.314013+0000","last_clean":"2024-09-10T15:27:28.314013+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:28.314013+0000","last_undegraded":"2024-09-10T15:27:28.314013+0000","last_fullsized":"2024-09-10T15:27:28.314013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"76'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316348+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:27:28.316348+0000","last_peered":"2024-09-10T15:27:28.316348+0000","last_clean":"2024-09-10T15:27:28.316348+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:27:28.316348+0000","last_undegraded":"2024-09-10T15:27:28.316348+0000","last_fullsized":"2024-09-10T15:27:28.316348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314352+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:27:28.314352+0000","last_peered":"2024-09-10T15:27:28.314352+0000","last_clean":"2024-09-10T15:27:28.314352+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:27:28.314352+0000","last_undegraded":"2024-09-10T15:27:28.314352+0000","last_fullsized":"2024-09-10T15:27:28.314352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313070+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:27:28.313070+0000","last_peered":"2024-09-10T15:27:28.313070+0000","last_clean":"2024-09-10T15:27:28.313070+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:27:28.313070+0000","last_undegraded":"2024-09-10T15:27:28.313070+0000","last_fullsized":"2024-09-10T15:27:28.313070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333594+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:28.333594+0000","last_peered":"2024-09-10T15:27:28.333594+0000","last_clean":"2024-09-10T15:27:28.333594+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:28.333594+0000","last_undegraded":"2024-09-10T15:27:28.333594+0000","last_fullsized":"2024-09-10T15:27:28.333594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313586+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:27:28.313586+0000","last_peered":"2024-09-10T15:27:28.313586+0000","last_clean":"2024-09-10T15:27:28.313586+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:27:28.313586+0000","last_undegraded":"2024-09-10T15:27:28.313586+0000","last_fullsized":"2024-09-10T15:27:28.313586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"76'6","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341923+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:27:28.341923+0000","last_peered":"2024-09-10T15:27:28.341923+0000","last_clean":"2024-09-10T15:27:28.341923+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:27:28.341923+0000","last_undegraded":"2024-09-10T15:27:28.341923+0000","last_fullsized":"2024-09-10T15:27:28.341923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340106+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:27:28.340106+0000","last_peered":"2024-09-10T15:27:28.340106+0000","last_clean":"2024-09-10T15:27:28.340106+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:27:28.340106+0000","last_undegraded":"2024-09-10T15:27:28.340106+0000","last_fullsized":"2024-09-10T15:27:28.340106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"76'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490985+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:27:28.490985+0000","last_peered":"2024-09-10T15:27:28.490985+0000","last_clean":"2024-09-10T15:27:28.490985+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:27:28.490985+0000","last_undegraded":"2024-09-10T15:27:28.490985+0000","last_fullsized":"2024-09-10T15:27:28.490985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947458+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:28.947458+0000","last_peered":"2024-09-10T15:27:28.947458+0000","last_clean":"2024-09-10T15:27:28.947458+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:28.947458+0000","last_undegraded":"2024-09-10T15:27:28.947458+0000","last_fullsized":"2024-09-10T15:27:28.947458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415920+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:28.415920+0000","last_peered":"2024-09-10T15:27:28.415920+0000","last_clean":"2024-09-10T15:27:28.415920+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:28.415920+0000","last_undegraded":"2024-09-10T15:27:28.415920+0000","last_fullsized":"2024-09-10T15:27:28.415920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490524+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:27:28.490524+0000","last_peered":"2024-09-10T15:27:28.490524+0000","last_clean":"2024-09-10T15:27:28.490524+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:27:28.490524+0000","last_undegraded":"2024-09-10T15:27:28.490524+0000","last_fullsized":"2024-09-10T15:27:28.490524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697982+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:28.697982+0000","last_peered":"2024-09-10T15:27:28.697982+0000","last_clean":"2024-09-10T15:27:28.697982+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:28.697982+0000","last_undegraded":"2024-09-10T15:27:28.697982+0000","last_fullsized":"2024-09-10T15:27:28.697982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415092+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:27:28.415092+0000","last_peered":"2024-09-10T15:27:28.415092+0000","last_clean":"2024-09-10T15:27:28.415092+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:27:28.415092+0000","last_undegraded":"2024-09-10T15:27:28.415092+0000","last_fullsized":"2024-09-10T15:27:28.415092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"76'16","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313810+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:27:28.313810+0000","last_peered":"2024-09-10T15:27:28.313810+0000","last_clean":"2024-09-10T15:27:28.313810+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:27:28.313810+0000","last_undegraded":"2024-09-10T15:27:28.313810+0000","last_fullsized":"2024-09-10T15:27:28.313810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490332+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:27:28.490332+0000","last_peered":"2024-09-10T15:27:28.490332+0000","last_clean":"2024-09-10T15:27:28.490332+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:27:28.490332+0000","last_undegraded":"2024-09-10T15:27:28.490332+0000","last_fullsized":"2024-09-10T15:27:28.490332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416768+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:27:28.416768+0000","last_peered":"2024-09-10T15:27:28.416768+0000","last_clean":"2024-09-10T15:27:28.416768+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:27:28.416768+0000","last_undegraded":"2024-09-10T15:27:28.416768+0000","last_fullsized":"2024-09-10T15:27:28.416768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695012+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:27:28.695012+0000","last_peered":"2024-09-10T15:27:28.695012+0000","last_clean":"2024-09-10T15:27:28.695012+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:27:28.695012+0000","last_undegraded":"2024-09-10T15:27:28.695012+0000","last_fullsized":"2024-09-10T15:27:28.695012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334748+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:27:28.334748+0000","last_peered":"2024-09-10T15:27:28.334748+0000","last_clean":"2024-09-10T15:27:28.334748+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:27:28.334748+0000","last_undegraded":"2024-09-10T15:27:28.334748+0000","last_fullsized":"2024-09-10T15:27:28.334748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"76'22","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333589+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:28.333589+0000","last_peered":"2024-09-10T15:27:28.333589+0000","last_clean":"2024-09-10T15:27:28.333589+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:28.333589+0000","last_undegraded":"2024-09-10T15:27:28.333589+0000","last_fullsized":"2024-09-10T15:27:28.333589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339933+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:28.339933+0000","last_peered":"2024-09-10T15:27:28.339933+0000","last_clean":"2024-09-10T15:27:28.339933+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:28.339933+0000","last_undegraded":"2024-09-10T15:27:28.339933+0000","last_fullsized":"2024-09-10T15:27:28.339933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695048+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:28.695048+0000","last_peered":"2024-09-10T15:27:28.695048+0000","last_clean":"2024-09-10T15:27:28.695048+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:28.695048+0000","last_undegraded":"2024-09-10T15:27:28.695048+0000","last_fullsized":"2024-09-10T15:27:28.695048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315808+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:27:28.315808+0000","last_peered":"2024-09-10T15:27:28.315808+0000","last_clean":"2024-09-10T15:27:28.315808+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:27:28.315808+0000","last_undegraded":"2024-09-10T15:27:28.315808+0000","last_fullsized":"2024-09-10T15:27:28.315808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"76'13","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314064+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:28.314064+0000","last_peered":"2024-09-10T15:27:28.314064+0000","last_clean":"2024-09-10T15:27:28.314064+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:28.314064+0000","last_undegraded":"2024-09-10T15:27:28.314064+0000","last_fullsized":"2024-09-10T15:27:28.314064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341227+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:27:28.341227+0000","last_peered":"2024-09-10T15:27:28.341227+0000","last_clean":"2024-09-10T15:27:28.341227+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:27:28.341227+0000","last_undegraded":"2024-09-10T15:27:28.341227+0000","last_fullsized":"2024-09-10T15:27:28.341227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"76'20","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416187+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:27:28.416187+0000","last_peered":"2024-09-10T15:27:28.416187+0000","last_clean":"2024-09-10T15:27:28.416187+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:27:28.416187+0000","last_undegraded":"2024-09-10T15:27:28.416187+0000","last_fullsized":"2024-09-10T15:27:28.416187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695668+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:28.695668+0000","last_peered":"2024-09-10T15:27:28.695668+0000","last_clean":"2024-09-10T15:27:28.695668+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:28.695668+0000","last_undegraded":"2024-09-10T15:27:28.695668+0000","last_fullsized":"2024-09-10T15:27:28.695668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415602+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:28.415602+0000","last_peered":"2024-09-10T15:27:28.415602+0000","last_clean":"2024-09-10T15:27:28.415602+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:28.415602+0000","last_undegraded":"2024-09-10T15:27:28.415602+0000","last_fullsized":"2024-09-10T15:27:28.415602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491600+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:27:28.491600+0000","last_peered":"2024-09-10T15:27:28.491600+0000","last_clean":"2024-09-10T15:27:28.491600+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:27:28.491600+0000","last_undegraded":"2024-09-10T15:27:28.491600+0000","last_fullsized":"2024-09-10T15:27:28.491600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"71'6","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947965+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:27:28.947965+0000","last_peered":"2024-09-10T15:27:28.947965+0000","last_clean":"2024-09-10T15:27:28.947965+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:27:28.947965+0000","last_undegraded":"2024-09-10T15:27:28.947965+0000","last_fullsized":"2024-09-10T15:27:28.947965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341641+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:27:28.341641+0000","last_peered":"2024-09-10T15:27:28.341641+0000","last_clean":"2024-09-10T15:27:28.341641+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:27:28.341641+0000","last_undegraded":"2024-09-10T15:27:28.341641+0000","last_fullsized":"2024-09-10T15:27:28.341641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"76'14","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333989+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:27:28.333989+0000","last_peered":"2024-09-10T15:27:28.333989+0000","last_clean":"2024-09-10T15:27:28.333989+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:27:28.333989+0000","last_undegraded":"2024-09-10T15:27:28.333989+0000","last_fullsized":"2024-09-10T15:27:28.333989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489208+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489208+0000","last_peered":"2024-09-10T15:27:28.489208+0000","last_clean":"2024-09-10T15:27:28.489208+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489208+0000","last_undegraded":"2024-09-10T15:27:28.489208+0000","last_fullsized":"2024-09-10T15:27:28.489208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414558+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:28.414558+0000","last_peered":"2024-09-10T15:27:28.414558+0000","last_clean":"2024-09-10T15:27:28.414558+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:28.414558+0000","last_undegraded":"2024-09-10T15:27:28.414558+0000","last_fullsized":"2024-09-10T15:27:28.414558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315425+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:27:28.315425+0000","last_peered":"2024-09-10T15:27:28.315425+0000","last_clean":"2024-09-10T15:27:28.315425+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:27:28.315425+0000","last_undegraded":"2024-09-10T15:27:28.315425+0000","last_fullsized":"2024-09-10T15:27:28.315425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315796+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:28.315796+0000","last_peered":"2024-09-10T15:27:28.315796+0000","last_clean":"2024-09-10T15:27:28.315796+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:28.315796+0000","last_undegraded":"2024-09-10T15:27:28.315796+0000","last_fullsized":"2024-09-10T15:27:28.315796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47122,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314946+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:27:28.314946+0000","last_peered":"2024-09-10T15:27:28.314946+0000","last_clean":"2024-09-10T15:27:28.314946+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:27:28.314946+0000","last_undegraded":"2024-09-10T15:27:28.314946+0000","last_fullsized":"2024-09-10T15:27:28.314946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"88'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416555+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:27:28.416555+0000","last_peered":"2024-09-10T15:27:28.416555+0000","last_clean":"2024-09-10T15:27:28.416555+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:27:28.416555+0000","last_undegraded":"2024-09-10T15:27:28.416555+0000","last_fullsized":"2024-09-10T15:27:28.416555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'15","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035948+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:31.035948+0000","last_peered":"2024-09-10T15:27:31.035948+0000","last_clean":"2024-09-10T15:27:31.035948+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:31.035948+0000","last_undegraded":"2024-09-10T15:27:31.035948+0000","last_fullsized":"2024-09-10T15:27:31.035948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414710+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:28.414710+0000","last_peered":"2024-09-10T15:27:28.414710+0000","last_clean":"2024-09-10T15:27:28.414710+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:28.414710+0000","last_undegraded":"2024-09-10T15:27:28.414710+0000","last_fullsized":"2024-09-10T15:27:28.414710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341111+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:27:28.341111+0000","last_peered":"2024-09-10T15:27:28.341111+0000","last_clean":"2024-09-10T15:27:28.341111+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:27:28.341111+0000","last_undegraded":"2024-09-10T15:27:28.341111+0000","last_fullsized":"2024-09-10T15:27:28.341111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"76'10","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947928+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:27:28.947928+0000","last_peered":"2024-09-10T15:27:28.947928+0000","last_clean":"2024-09-10T15:27:28.947928+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:27:28.947928+0000","last_undegraded":"2024-09-10T15:27:28.947928+0000","last_fullsized":"2024-09-10T15:27:28.947928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947579+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:27:28.947579+0000","last_peered":"2024-09-10T15:27:28.947579+0000","last_clean":"2024-09-10T15:27:28.947579+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:27:28.947579+0000","last_undegraded":"2024-09-10T15:27:28.947579+0000","last_fullsized":"2024-09-10T15:27:28.947579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"76'20","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314207+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:27:28.314207+0000","last_peered":"2024-09-10T15:27:28.314207+0000","last_clean":"2024-09-10T15:27:28.314207+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:27:28.314207+0000","last_undegraded":"2024-09-10T15:27:28.314207+0000","last_fullsized":"2024-09-10T15:27:28.314207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313219+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:28.313219+0000","last_peered":"2024-09-10T15:27:28.313219+0000","last_clean":"2024-09-10T15:27:28.313219+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:28.313219+0000","last_undegraded":"2024-09-10T15:27:28.313219+0000","last_fullsized":"2024-09-10T15:27:28.313219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948271+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:28.948271+0000","last_peered":"2024-09-10T15:27:28.948271+0000","last_clean":"2024-09-10T15:27:28.948271+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:28.948271+0000","last_undegraded":"2024-09-10T15:27:28.948271+0000","last_fullsized":"2024-09-10T15:27:28.948271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340645+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:27:28.340645+0000","last_peered":"2024-09-10T15:27:28.340645+0000","last_clean":"2024-09-10T15:27:28.340645+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:27:28.340645+0000","last_undegraded":"2024-09-10T15:27:28.340645+0000","last_fullsized":"2024-09-10T15:27:28.340645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414699+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:28.414699+0000","last_peered":"2024-09-10T15:27:28.414699+0000","last_clean":"2024-09-10T15:27:28.414699+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:28.414699+0000","last_undegraded":"2024-09-10T15:27:28.414699+0000","last_fullsized":"2024-09-10T15:27:28.414699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24594,"num_write":40,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340914+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:27:28.340914+0000","last_peered":"2024-09-10T15:27:28.340914+0000","last_clean":"2024-09-10T15:27:28.340914+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:27:28.340914+0000","last_undegraded":"2024-09-10T15:27:28.340914+0000","last_fullsized":"2024-09-10T15:27:28.340914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313782+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:27:28.313782+0000","last_peered":"2024-09-10T15:27:28.313782+0000","last_clean":"2024-09-10T15:27:28.313782+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:27:28.313782+0000","last_undegraded":"2024-09-10T15:27:28.313782+0000","last_fullsized":"2024-09-10T15:27:28.313782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414873+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:28.414873+0000","last_peered":"2024-09-10T15:27:28.414873+0000","last_clean":"2024-09-10T15:27:28.414873+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:28.414873+0000","last_undegraded":"2024-09-10T15:27:28.414873+0000","last_fullsized":"2024-09-10T15:27:28.414873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696568+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:28.696568+0000","last_peered":"2024-09-10T15:27:28.696568+0000","last_clean":"2024-09-10T15:27:28.696568+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:28.696568+0000","last_undegraded":"2024-09-10T15:27:28.696568+0000","last_fullsized":"2024-09-10T15:27:28.696568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490260+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:27:28.490260+0000","last_peered":"2024-09-10T15:27:28.490260+0000","last_clean":"2024-09-10T15:27:28.490260+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:27:28.490260+0000","last_undegraded":"2024-09-10T15:27:28.490260+0000","last_fullsized":"2024-09-10T15:27:28.490260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697170+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:28.697170+0000","last_peered":"2024-09-10T15:27:28.697170+0000","last_clean":"2024-09-10T15:27:28.697170+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:28.697170+0000","last_undegraded":"2024-09-10T15:27:28.697170+0000","last_fullsized":"2024-09-10T15:27:28.697170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947192+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:27:28.947192+0000","last_peered":"2024-09-10T15:27:28.947192+0000","last_clean":"2024-09-10T15:27:28.947192+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:27:28.947192+0000","last_undegraded":"2024-09-10T15:27:28.947192+0000","last_fullsized":"2024-09-10T15:27:28.947192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"76'13","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333357+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:27:28.333357+0000","last_peered":"2024-09-10T15:27:28.333357+0000","last_clean":"2024-09-10T15:27:28.333357+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:27:28.333357+0000","last_undegraded":"2024-09-10T15:27:28.333357+0000","last_fullsized":"2024-09-10T15:27:28.333357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":34,"num_write":18,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414746+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:27:28.414746+0000","last_peered":"2024-09-10T15:27:28.414746+0000","last_clean":"2024-09-10T15:27:28.414746+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:27:28.414746+0000","last_undegraded":"2024-09-10T15:27:28.414746+0000","last_fullsized":"2024-09-10T15:27:28.414746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415981+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:28.415981+0000","last_peered":"2024-09-10T15:27:28.415981+0000","last_clean":"2024-09-10T15:27:28.415981+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:28.415981+0000","last_undegraded":"2024-09-10T15:27:28.415981+0000","last_fullsized":"2024-09-10T15:27:28.415981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:27:28.340248+0000","last_peered":"2024-09-10T15:27:28.340248+0000","last_clean":"2024-09-10T15:27:28.340248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:27:28.340248+0000","last_undegraded":"2024-09-10T15:27:28.340248+0000","last_fullsized":"2024-09-10T15:27:28.340248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697494+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:28.697494+0000","last_peered":"2024-09-10T15:27:28.697494+0000","last_clean":"2024-09-10T15:27:28.697494+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:28.697494+0000","last_undegraded":"2024-09-10T15:27:28.697494+0000","last_fullsized":"2024-09-10T15:27:28.697494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313217+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:27:28.313217+0000","last_peered":"2024-09-10T15:27:28.313217+0000","last_clean":"2024-09-10T15:27:28.313217+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:27:28.313217+0000","last_undegraded":"2024-09-10T15:27:28.313217+0000","last_fullsized":"2024-09-10T15:27:28.313217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"76'13","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414966+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:27:28.414966+0000","last_peered":"2024-09-10T15:27:28.414966+0000","last_clean":"2024-09-10T15:27:28.414966+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:27:28.414966+0000","last_undegraded":"2024-09-10T15:27:28.414966+0000","last_fullsized":"2024-09-10T15:27:28.414966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314980+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:28.314980+0000","last_peered":"2024-09-10T15:27:28.314980+0000","last_clean":"2024-09-10T15:27:28.314980+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:28.314980+0000","last_undegraded":"2024-09-10T15:27:28.314980+0000","last_fullsized":"2024-09-10T15:27:28.314980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315593+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:28.315593+0000","last_peered":"2024-09-10T15:27:28.315593+0000","last_clean":"2024-09-10T15:27:28.315593+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:28.315593+0000","last_undegraded":"2024-09-10T15:27:28.315593+0000","last_fullsized":"2024-09-10T15:27:28.315593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315999+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:27:28.315999+0000","last_peered":"2024-09-10T15:27:28.315999+0000","last_clean":"2024-09-10T15:27:28.315999+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:27:28.315999+0000","last_undegraded":"2024-09-10T15:27:28.315999+0000","last_fullsized":"2024-09-10T15:27:28.315999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340407+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:27:28.340407+0000","last_peered":"2024-09-10T15:27:28.340407+0000","last_clean":"2024-09-10T15:27:28.340407+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:27:28.340407+0000","last_undegraded":"2024-09-10T15:27:28.340407+0000","last_fullsized":"2024-09-10T15:27:28.340407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492828+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:27:28.492828+0000","last_peered":"2024-09-10T15:27:28.492828+0000","last_clean":"2024-09-10T15:27:28.492828+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:27:28.492828+0000","last_undegraded":"2024-09-10T15:27:28.492828+0000","last_fullsized":"2024-09-10T15:27:28.492828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"63'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489564+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:27:28.489564+0000","last_peered":"2024-09-10T15:27:28.489564+0000","last_clean":"2024-09-10T15:27:28.489564+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:27:28.489564+0000","last_undegraded":"2024-09-10T15:27:28.489564+0000","last_fullsized":"2024-09-10T15:27:28.489564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416056+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416056+0000","last_peered":"2024-09-10T15:27:28.416056+0000","last_clean":"2024-09-10T15:27:28.416056+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416056+0000","last_undegraded":"2024-09-10T15:27:28.416056+0000","last_fullsized":"2024-09-10T15:27:28.416056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415413+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:28.415413+0000","last_peered":"2024-09-10T15:27:28.415413+0000","last_clean":"2024-09-10T15:27:28.415413+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:28.415413+0000","last_undegraded":"2024-09-10T15:27:28.415413+0000","last_fullsized":"2024-09-10T15:27:28.415413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696973+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:27:28.696973+0000","last_peered":"2024-09-10T15:27:28.696973+0000","last_clean":"2024-09-10T15:27:28.696973+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:27:28.696973+0000","last_undegraded":"2024-09-10T15:27:28.696973+0000","last_fullsized":"2024-09-10T15:27:28.696973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696532+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:28.696532+0000","last_peered":"2024-09-10T15:27:28.696532+0000","last_clean":"2024-09-10T15:27:28.696532+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:28.696532+0000","last_undegraded":"2024-09-10T15:27:28.696532+0000","last_fullsized":"2024-09-10T15:27:28.696532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":51212,"num_write":35,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695873+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:27:28.695873+0000","last_peered":"2024-09-10T15:27:28.695873+0000","last_clean":"2024-09-10T15:27:28.695873+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:27:28.695873+0000","last_undegraded":"2024-09-10T15:27:28.695873+0000","last_fullsized":"2024-09-10T15:27:28.695873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331251+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:27:28.331251+0000","last_peered":"2024-09-10T15:27:28.331251+0000","last_clean":"2024-09-10T15:27:28.331251+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:27:28.331251+0000","last_undegraded":"2024-09-10T15:27:28.331251+0000","last_fullsized":"2024-09-10T15:27:28.331251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314167+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:27:28.314167+0000","last_peered":"2024-09-10T15:27:28.314167+0000","last_clean":"2024-09-10T15:27:28.314167+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:27:28.314167+0000","last_undegraded":"2024-09-10T15:27:28.314167+0000","last_fullsized":"2024-09-10T15:27:28.314167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334348+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:27:28.334348+0000","last_peered":"2024-09-10T15:27:28.334348+0000","last_clean":"2024-09-10T15:27:28.334348+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:27:28.334348+0000","last_undegraded":"2024-09-10T15:27:28.334348+0000","last_fullsized":"2024-09-10T15:27:28.334348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332571+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:27:28.332571+0000","last_peered":"2024-09-10T15:27:28.332571+0000","last_clean":"2024-09-10T15:27:28.332571+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:27:28.332571+0000","last_undegraded":"2024-09-10T15:27:28.332571+0000","last_fullsized":"2024-09-10T15:27:28.332571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341835+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:27:28.341835+0000","last_peered":"2024-09-10T15:27:28.341835+0000","last_clean":"2024-09-10T15:27:28.341835+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:27:28.341835+0000","last_undegraded":"2024-09-10T15:27:28.341835+0000","last_fullsized":"2024-09-10T15:27:28.341835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947641+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:27:28.947641+0000","last_peered":"2024-09-10T15:27:28.947641+0000","last_clean":"2024-09-10T15:27:28.947641+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:27:28.947641+0000","last_undegraded":"2024-09-10T15:27:28.947641+0000","last_fullsized":"2024-09-10T15:27:28.947641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697192+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:27:28.697192+0000","last_peered":"2024-09-10T15:27:28.697192+0000","last_clean":"2024-09-10T15:27:28.697192+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:27:28.697192+0000","last_undegraded":"2024-09-10T15:27:28.697192+0000","last_fullsized":"2024-09-10T15:27:28.697192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28684,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493197+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:28.493197+0000","last_peered":"2024-09-10T15:27:28.493197+0000","last_clean":"2024-09-10T15:27:28.493197+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:28.493197+0000","last_undegraded":"2024-09-10T15:27:28.493197+0000","last_fullsized":"2024-09-10T15:27:28.493197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"76'9","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415276+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:27:28.415276+0000","last_peered":"2024-09-10T15:27:28.415276+0000","last_clean":"2024-09-10T15:27:28.415276+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:27:28.415276+0000","last_undegraded":"2024-09-10T15:27:28.415276+0000","last_fullsized":"2024-09-10T15:27:28.415276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315776+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:27:28.315776+0000","last_peered":"2024-09-10T15:27:28.315776+0000","last_clean":"2024-09-10T15:27:28.315776+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:27:28.315776+0000","last_undegraded":"2024-09-10T15:27:28.315776+0000","last_fullsized":"2024-09-10T15:27:28.315776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"69'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694776+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:28.694776+0000","last_peered":"2024-09-10T15:27:28.694776+0000","last_clean":"2024-09-10T15:27:28.694776+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:28.694776+0000","last_undegraded":"2024-09-10T15:27:28.694776+0000","last_fullsized":"2024-09-10T15:27:28.694776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696443+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:27:28.696443+0000","last_peered":"2024-09-10T15:27:28.696443+0000","last_clean":"2024-09-10T15:27:28.696443+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:27:28.696443+0000","last_undegraded":"2024-09-10T15:27:28.696443+0000","last_fullsized":"2024-09-10T15:27:28.696443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"76'7","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947713+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:27:28.947713+0000","last_peered":"2024-09-10T15:27:28.947713+0000","last_clean":"2024-09-10T15:27:28.947713+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:27:28.947713+0000","last_undegraded":"2024-09-10T15:27:28.947713+0000","last_fullsized":"2024-09-10T15:27:28.947713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18438,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947692+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.947692+0000","last_peered":"2024-09-10T15:27:28.947692+0000","last_clean":"2024-09-10T15:27:28.947692+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:27:28.947692+0000","last_undegraded":"2024-09-10T15:27:28.947692+0000","last_fullsized":"2024-09-10T15:27:28.947692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315424+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:28.315424+0000","last_peered":"2024-09-10T15:27:28.315424+0000","last_clean":"2024-09-10T15:27:28.315424+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:28.315424+0000","last_undegraded":"2024-09-10T15:27:28.315424+0000","last_fullsized":"2024-09-10T15:27:28.315424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":20,"num_read_kb":53254,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947595+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:27:28.947595+0000","last_peered":"2024-09-10T15:27:28.947595+0000","last_clean":"2024-09-10T15:27:28.947595+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:27:28.947595+0000","last_undegraded":"2024-09-10T15:27:28.947595+0000","last_fullsized":"2024-09-10T15:27:28.947595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315275+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:27:28.315275+0000","last_peered":"2024-09-10T15:27:28.315275+0000","last_clean":"2024-09-10T15:27:28.315275+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:27:28.315275+0000","last_undegraded":"2024-09-10T15:27:28.315275+0000","last_fullsized":"2024-09-10T15:27:28.315275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490207+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490207+0000","last_peered":"2024-09-10T15:27:28.490207+0000","last_clean":"2024-09-10T15:27:28.490207+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490207+0000","last_undegraded":"2024-09-10T15:27:28.490207+0000","last_fullsized":"2024-09-10T15:27:28.490207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414460+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:28.414460+0000","last_peered":"2024-09-10T15:27:28.414460+0000","last_clean":"2024-09-10T15:27:28.414460+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:28.414460+0000","last_undegraded":"2024-09-10T15:27:28.414460+0000","last_fullsized":"2024-09-10T15:27:28.414460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":18,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313708+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:27:28.313708+0000","last_peered":"2024-09-10T15:27:28.313708+0000","last_clean":"2024-09-10T15:27:28.313708+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:27:28.313708+0000","last_undegraded":"2024-09-10T15:27:28.313708+0000","last_fullsized":"2024-09-10T15:27:28.313708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"70'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493135+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:27:28.493135+0000","last_peered":"2024-09-10T15:27:28.493135+0000","last_clean":"2024-09-10T15:27:28.493135+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:27:28.493135+0000","last_undegraded":"2024-09-10T15:27:28.493135+0000","last_fullsized":"2024-09-10T15:27:28.493135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947471+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:27:28.947471+0000","last_peered":"2024-09-10T15:27:28.947471+0000","last_clean":"2024-09-10T15:27:28.947471+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:27:28.947471+0000","last_undegraded":"2024-09-10T15:27:28.947471+0000","last_fullsized":"2024-09-10T15:27:28.947471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'15","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414535+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:28.414535+0000","last_peered":"2024-09-10T15:27:28.414535+0000","last_clean":"2024-09-10T15:27:28.414535+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:28.414535+0000","last_undegraded":"2024-09-10T15:27:28.414535+0000","last_fullsized":"2024-09-10T15:27:28.414535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"70'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415329+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:28.415329+0000","last_peered":"2024-09-10T15:27:28.415329+0000","last_clean":"2024-09-10T15:27:28.415329+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:28.415329+0000","last_undegraded":"2024-09-10T15:27:28.415329+0000","last_fullsized":"2024-09-10T15:27:28.415329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315903+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:27:28.315903+0000","last_peered":"2024-09-10T15:27:28.315903+0000","last_clean":"2024-09-10T15:27:28.315903+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:27:28.315903+0000","last_undegraded":"2024-09-10T15:27:28.315903+0000","last_fullsized":"2024-09-10T15:27:28.315903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"71'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693432+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:28.693432+0000","last_peered":"2024-09-10T15:27:28.693432+0000","last_clean":"2024-09-10T15:27:28.693432+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:28.693432+0000","last_undegraded":"2024-09-10T15:27:28.693432+0000","last_fullsized":"2024-09-10T15:27:28.693432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948407+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:27:28.948407+0000","last_peered":"2024-09-10T15:27:28.948407+0000","last_clean":"2024-09-10T15:27:28.948407+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:27:28.948407+0000","last_undegraded":"2024-09-10T15:27:28.948407+0000","last_fullsized":"2024-09-10T15:27:28.948407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238917,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":923,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":271500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":278016000,"data_stored":277481932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405092,"kb_used_data":373904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93966748,"statfs":{"total":96636764160,"available":96221949952,"internally_reserved":0,"allocated":382877696,"data_stored":382332157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434344,"kb_used_data":403160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93937496,"statfs":{"total":96636764160,"available":96191995904,"internally_reserved":0,"allocated":412835840,"data_stored":412291291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370288,"kb_used_data":339104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94001552,"statfs":{"total":96636764160,"available":96257589248,"internally_reserved":0,"allocated":347242496,"data_stored":346695811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":509528,"kb_used_data":478340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93862312,"statfs":{"total":96636764160,"available":96115007488,"internally_reserved":0,"allocated":489820160,"data_stored":489288012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501308,"kb_used_data":470120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93870532,"statfs":{"total":96636764160,"available":96123424768,"internally_reserved":0,"allocated":481402880,"data_stored":480896228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356560,"kb_used_data":325376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94015280,"statfs":{"total":96636764160,"available":96271646720,"internally_reserved":0,"allocated":333185024,"data_stored":332610464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575112,"kb_used_data":543928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93796728,"statfs":{"total":96636764160,"available":96047849472,"internally_reserved":0,"allocated":556982272,"data_stored":556408695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":555745280,"data_stored":555745280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":346030080,"data_stored":346030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":35596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":30035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":28726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:27:59.816 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:28:00.198 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:28:00.204 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:28:00.216 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-10T15:27:58.981539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609477,"num_objects":639,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":639,"num_whiteouts":0,"num_read":3875,"num_read_kb":2050994,"num_write":3330,"num_write_kb":2051084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1991,"ondisk_log_size":1991,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3454916,"kb_used_data":3205432,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751519804,"statfs":{"total":773094113280,"available":769556279296,"internally_reserved":0,"allocated":3282362368,"data_stored":3278004590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006099"},"pg_stats":[{"pgid":"3.3f","version":"76'7","reported_seq":110,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492571+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:28.492571+0000","last_peered":"2024-09-10T15:27:28.492571+0000","last_clean":"2024-09-10T15:27:28.492571+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:28.492571+0000","last_undegraded":"2024-09-10T15:27:28.492571+0000","last_fullsized":"2024-09-10T15:27:28.492571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:35.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947463+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:28.947463+0000","last_peered":"2024-09-10T15:27:28.947463+0000","last_clean":"2024-09-10T15:27:28.947463+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:28.947463+0000","last_undegraded":"2024-09-10T15:27:28.947463+0000","last_fullsized":"2024-09-10T15:27:28.947463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696971+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:27:28.696971+0000","last_peered":"2024-09-10T15:27:28.696971+0000","last_clean":"2024-09-10T15:27:28.696971+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:27:28.696971+0000","last_undegraded":"2024-09-10T15:27:28.696971+0000","last_fullsized":"2024-09-10T15:27:28.696971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415253+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:28.415253+0000","last_peered":"2024-09-10T15:27:28.415253+0000","last_clean":"2024-09-10T15:27:28.415253+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:28.415253+0000","last_undegraded":"2024-09-10T15:27:28.415253+0000","last_fullsized":"2024-09-10T15:27:28.415253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"76'16","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693506+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:28.693506+0000","last_peered":"2024-09-10T15:27:28.693506+0000","last_clean":"2024-09-10T15:27:28.693506+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:28.693506+0000","last_undegraded":"2024-09-10T15:27:28.693506+0000","last_fullsized":"2024-09-10T15:27:28.693506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415252+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:27:28.415252+0000","last_peered":"2024-09-10T15:27:28.415252+0000","last_clean":"2024-09-10T15:27:28.415252+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:27:28.415252+0000","last_undegraded":"2024-09-10T15:27:28.415252+0000","last_fullsized":"2024-09-10T15:27:28.415252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"71'2","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315716+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:27:28.315716+0000","last_peered":"2024-09-10T15:27:28.315716+0000","last_clean":"2024-09-10T15:27:28.315716+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:27:28.315716+0000","last_undegraded":"2024-09-10T15:27:28.315716+0000","last_fullsized":"2024-09-10T15:27:28.315716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314620+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:27:28.314620+0000","last_peered":"2024-09-10T15:27:28.314620+0000","last_clean":"2024-09-10T15:27:28.314620+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:27:28.314620+0000","last_undegraded":"2024-09-10T15:27:28.314620+0000","last_fullsized":"2024-09-10T15:27:28.314620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":45074,"num_write":45,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314283+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:27:28.314283+0000","last_peered":"2024-09-10T15:27:28.314283+0000","last_clean":"2024-09-10T15:27:28.314283+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:27:28.314283+0000","last_undegraded":"2024-09-10T15:27:28.314283+0000","last_fullsized":"2024-09-10T15:27:28.314283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339888+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:27:28.339888+0000","last_peered":"2024-09-10T15:27:28.339888+0000","last_clean":"2024-09-10T15:27:28.339888+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:27:28.339888+0000","last_undegraded":"2024-09-10T15:27:28.339888+0000","last_fullsized":"2024-09-10T15:27:28.339888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315735+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:27:28.315735+0000","last_peered":"2024-09-10T15:27:28.315735+0000","last_clean":"2024-09-10T15:27:28.315735+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:27:28.315735+0000","last_undegraded":"2024-09-10T15:27:28.315735+0000","last_fullsized":"2024-09-10T15:27:28.315735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"76'8","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314811+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:27:28.314811+0000","last_peered":"2024-09-10T15:27:28.314811+0000","last_clean":"2024-09-10T15:27:28.314811+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:27:28.314811+0000","last_undegraded":"2024-09-10T15:27:28.314811+0000","last_fullsized":"2024-09-10T15:27:28.314811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341680+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:27:28.341680+0000","last_peered":"2024-09-10T15:27:28.341680+0000","last_clean":"2024-09-10T15:27:28.341680+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:27:28.341680+0000","last_undegraded":"2024-09-10T15:27:28.341680+0000","last_fullsized":"2024-09-10T15:27:28.341680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693325+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:28.693325+0000","last_peered":"2024-09-10T15:27:28.693325+0000","last_clean":"2024-09-10T15:27:28.693325+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:28.693325+0000","last_undegraded":"2024-09-10T15:27:28.693325+0000","last_fullsized":"2024-09-10T15:27:28.693325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697665+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:27:28.697665+0000","last_peered":"2024-09-10T15:27:28.697665+0000","last_clean":"2024-09-10T15:27:28.697665+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:27:28.697665+0000","last_undegraded":"2024-09-10T15:27:28.697665+0000","last_fullsized":"2024-09-10T15:27:28.697665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415085+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:28.415085+0000","last_peered":"2024-09-10T15:27:28.415085+0000","last_clean":"2024-09-10T15:27:28.415085+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:28.415085+0000","last_undegraded":"2024-09-10T15:27:28.415085+0000","last_fullsized":"2024-09-10T15:27:28.415085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'10","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948605+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:27:28.948605+0000","last_peered":"2024-09-10T15:27:28.948605+0000","last_clean":"2024-09-10T15:27:28.948605+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:27:28.948605+0000","last_undegraded":"2024-09-10T15:27:28.948605+0000","last_fullsized":"2024-09-10T15:27:28.948605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314573+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:27:28.314573+0000","last_peered":"2024-09-10T15:27:28.314573+0000","last_clean":"2024-09-10T15:27:28.314573+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:27:28.314573+0000","last_undegraded":"2024-09-10T15:27:28.314573+0000","last_fullsized":"2024-09-10T15:27:28.314573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"76'11","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315801+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:27:28.315801+0000","last_peered":"2024-09-10T15:27:28.315801+0000","last_clean":"2024-09-10T15:27:28.315801+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:27:28.315801+0000","last_undegraded":"2024-09-10T15:27:28.315801+0000","last_fullsized":"2024-09-10T15:27:28.315801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948029+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:27:28.948029+0000","last_peered":"2024-09-10T15:27:28.948029+0000","last_clean":"2024-09-10T15:27:28.948029+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:27:28.948029+0000","last_undegraded":"2024-09-10T15:27:28.948029+0000","last_fullsized":"2024-09-10T15:27:28.948029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"70'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316211+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:27:28.316211+0000","last_peered":"2024-09-10T15:27:28.316211+0000","last_clean":"2024-09-10T15:27:28.316211+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:27:28.316211+0000","last_undegraded":"2024-09-10T15:27:28.316211+0000","last_fullsized":"2024-09-10T15:27:28.316211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":34816,"num_write":10,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333429+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:27:28.333429+0000","last_peered":"2024-09-10T15:27:28.333429+0000","last_clean":"2024-09-10T15:27:28.333429+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:27:28.333429+0000","last_undegraded":"2024-09-10T15:27:28.333429+0000","last_fullsized":"2024-09-10T15:27:28.333429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315085+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:27:28.315085+0000","last_peered":"2024-09-10T15:27:28.315085+0000","last_clean":"2024-09-10T15:27:28.315085+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:27:28.315085+0000","last_undegraded":"2024-09-10T15:27:28.315085+0000","last_fullsized":"2024-09-10T15:27:28.315085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695686+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:27:28.695686+0000","last_peered":"2024-09-10T15:27:28.695686+0000","last_clean":"2024-09-10T15:27:28.695686+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:27:28.695686+0000","last_undegraded":"2024-09-10T15:27:28.695686+0000","last_fullsized":"2024-09-10T15:27:28.695686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331520+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:27:28.331520+0000","last_peered":"2024-09-10T15:27:28.331520+0000","last_clean":"2024-09-10T15:27:28.331520+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:27:28.331520+0000","last_undegraded":"2024-09-10T15:27:28.331520+0000","last_fullsized":"2024-09-10T15:27:28.331520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948065+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:28.948065+0000","last_peered":"2024-09-10T15:27:28.948065+0000","last_clean":"2024-09-10T15:27:28.948065+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:28.948065+0000","last_undegraded":"2024-09-10T15:27:28.948065+0000","last_fullsized":"2024-09-10T15:27:28.948065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"76'12","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313280+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:27:28.313280+0000","last_peered":"2024-09-10T15:27:28.313280+0000","last_clean":"2024-09-10T15:27:28.313280+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:27:28.313280+0000","last_undegraded":"2024-09-10T15:27:28.313280+0000","last_fullsized":"2024-09-10T15:27:28.313280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:57.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313061+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:28.313061+0000","last_peered":"2024-09-10T15:27:28.313061+0000","last_clean":"2024-09-10T15:27:28.313061+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:28.313061+0000","last_undegraded":"2024-09-10T15:27:28.313061+0000","last_fullsized":"2024-09-10T15:27:28.313061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333852+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:27:28.333852+0000","last_peered":"2024-09-10T15:27:28.333852+0000","last_clean":"2024-09-10T15:27:28.333852+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:27:28.333852+0000","last_undegraded":"2024-09-10T15:27:28.333852+0000","last_fullsized":"2024-09-10T15:27:28.333852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"76'12","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414504+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:28.414504+0000","last_peered":"2024-09-10T15:27:28.414504+0000","last_clean":"2024-09-10T15:27:28.414504+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:28.414504+0000","last_undegraded":"2024-09-10T15:27:28.414504+0000","last_fullsized":"2024-09-10T15:27:28.414504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416694+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:27:28.416694+0000","last_peered":"2024-09-10T15:27:28.416694+0000","last_clean":"2024-09-10T15:27:28.416694+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:27:28.416694+0000","last_undegraded":"2024-09-10T15:27:28.416694+0000","last_fullsized":"2024-09-10T15:27:28.416694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"76'19","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315429+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:27:28.315429+0000","last_peered":"2024-09-10T15:27:28.315429+0000","last_clean":"2024-09-10T15:27:28.315429+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:27:28.315429+0000","last_undegraded":"2024-09-10T15:27:28.315429+0000","last_fullsized":"2024-09-10T15:27:28.315429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":48,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948332+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:28.948332+0000","last_peered":"2024-09-10T15:27:28.948332+0000","last_clean":"2024-09-10T15:27:28.948332+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:28.948332+0000","last_undegraded":"2024-09-10T15:27:28.948332+0000","last_fullsized":"2024-09-10T15:27:28.948332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947162+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:28.947162+0000","last_peered":"2024-09-10T15:27:28.947162+0000","last_clean":"2024-09-10T15:27:28.947162+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:28.947162+0000","last_undegraded":"2024-09-10T15:27:28.947162+0000","last_fullsized":"2024-09-10T15:27:28.947162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416344+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:28.416344+0000","last_peered":"2024-09-10T15:27:28.416344+0000","last_clean":"2024-09-10T15:27:28.416344+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:28.416344+0000","last_undegraded":"2024-09-10T15:27:28.416344+0000","last_fullsized":"2024-09-10T15:27:28.416344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"71'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333128+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:27:28.333128+0000","last_peered":"2024-09-10T15:27:28.333128+0000","last_clean":"2024-09-10T15:27:28.333128+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:27:28.333128+0000","last_undegraded":"2024-09-10T15:27:28.333128+0000","last_fullsized":"2024-09-10T15:27:28.333128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314735+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:27:28.314735+0000","last_peered":"2024-09-10T15:27:28.314735+0000","last_clean":"2024-09-10T15:27:28.314735+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:27:28.314735+0000","last_undegraded":"2024-09-10T15:27:28.314735+0000","last_fullsized":"2024-09-10T15:27:28.314735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948359+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:27:28.948359+0000","last_peered":"2024-09-10T15:27:28.948359+0000","last_clean":"2024-09-10T15:27:28.948359+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:27:28.948359+0000","last_undegraded":"2024-09-10T15:27:28.948359+0000","last_fullsized":"2024-09-10T15:27:28.948359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948242+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:28.948242+0000","last_peered":"2024-09-10T15:27:28.948242+0000","last_clean":"2024-09-10T15:27:28.948242+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:28.948242+0000","last_undegraded":"2024-09-10T15:27:28.948242+0000","last_fullsized":"2024-09-10T15:27:28.948242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331754+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:28.331754+0000","last_peered":"2024-09-10T15:27:28.331754+0000","last_clean":"2024-09-10T15:27:28.331754+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:28.331754+0000","last_undegraded":"2024-09-10T15:27:28.331754+0000","last_fullsized":"2024-09-10T15:27:28.331754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696836+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:27:28.696836+0000","last_peered":"2024-09-10T15:27:28.696836+0000","last_clean":"2024-09-10T15:27:28.696836+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:27:28.696836+0000","last_undegraded":"2024-09-10T15:27:28.696836+0000","last_fullsized":"2024-09-10T15:27:28.696836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415399+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:28.415399+0000","last_peered":"2024-09-10T15:27:28.415399+0000","last_clean":"2024-09-10T15:27:28.415399+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:28.415399+0000","last_undegraded":"2024-09-10T15:27:28.415399+0000","last_fullsized":"2024-09-10T15:27:28.415399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315726+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:28.315726+0000","last_peered":"2024-09-10T15:27:28.315726+0000","last_clean":"2024-09-10T15:27:28.315726+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:28.315726+0000","last_undegraded":"2024-09-10T15:27:28.315726+0000","last_fullsized":"2024-09-10T15:27:28.315726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314442+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:28.314442+0000","last_peered":"2024-09-10T15:27:28.314442+0000","last_clean":"2024-09-10T15:27:28.314442+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:28.314442+0000","last_undegraded":"2024-09-10T15:27:28.314442+0000","last_fullsized":"2024-09-10T15:27:28.314442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'15","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.073313+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:27:34.073313+0000","last_peered":"2024-09-10T15:27:34.073313+0000","last_clean":"2024-09-10T15:27:34.073313+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:27:34.073313+0000","last_undegraded":"2024-09-10T15:27:34.073313+0000","last_fullsized":"2024-09-10T15:27:34.073313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340622+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:28.340622+0000","last_peered":"2024-09-10T15:27:28.340622+0000","last_clean":"2024-09-10T15:27:28.340622+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:28.340622+0000","last_undegraded":"2024-09-10T15:27:28.340622+0000","last_fullsized":"2024-09-10T15:27:28.340622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696983+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:27:28.696983+0000","last_peered":"2024-09-10T15:27:28.696983+0000","last_clean":"2024-09-10T15:27:28.696983+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:27:28.696983+0000","last_undegraded":"2024-09-10T15:27:28.696983+0000","last_fullsized":"2024-09-10T15:27:28.696983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"76'8","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947752+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:28.947752+0000","last_peered":"2024-09-10T15:27:28.947752+0000","last_clean":"2024-09-10T15:27:28.947752+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:28.947752+0000","last_undegraded":"2024-09-10T15:27:28.947752+0000","last_fullsized":"2024-09-10T15:27:28.947752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20492,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416291+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:27:28.416291+0000","last_peered":"2024-09-10T15:27:28.416291+0000","last_clean":"2024-09-10T15:27:28.416291+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:27:28.416291+0000","last_undegraded":"2024-09-10T15:27:28.416291+0000","last_fullsized":"2024-09-10T15:27:28.416291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"76'18","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341435+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:27:28.341435+0000","last_peered":"2024-09-10T15:27:28.341435+0000","last_clean":"2024-09-10T15:27:28.341435+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:27:28.341435+0000","last_undegraded":"2024-09-10T15:27:28.341435+0000","last_fullsized":"2024-09-10T15:27:28.341435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":43,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.084063+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:27:34.084063+0000","last_peered":"2024-09-10T15:27:34.084063+0000","last_clean":"2024-09-10T15:27:34.084063+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:27:34.084063+0000","last_undegraded":"2024-09-10T15:27:34.084063+0000","last_fullsized":"2024-09-10T15:27:34.084063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415061+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415061+0000","last_peered":"2024-09-10T15:27:28.415061+0000","last_clean":"2024-09-10T15:27:28.415061+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415061+0000","last_undegraded":"2024-09-10T15:27:28.415061+0000","last_fullsized":"2024-09-10T15:27:28.415061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"76'7","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316110+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:27:28.316110+0000","last_peered":"2024-09-10T15:27:28.316110+0000","last_clean":"2024-09-10T15:27:28.316110+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:27:28.316110+0000","last_undegraded":"2024-09-10T15:27:28.316110+0000","last_fullsized":"2024-09-10T15:27:28.316110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":27,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947301+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:27:28.947301+0000","last_peered":"2024-09-10T15:27:28.947301+0000","last_clean":"2024-09-10T15:27:28.947301+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:27:28.947301+0000","last_undegraded":"2024-09-10T15:27:28.947301+0000","last_fullsized":"2024-09-10T15:27:28.947301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313995+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:28.313995+0000","last_peered":"2024-09-10T15:27:28.313995+0000","last_clean":"2024-09-10T15:27:28.313995+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:28.313995+0000","last_undegraded":"2024-09-10T15:27:28.313995+0000","last_fullsized":"2024-09-10T15:27:28.313995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332970+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:28.332970+0000","last_peered":"2024-09-10T15:27:28.332970+0000","last_clean":"2024-09-10T15:27:28.332970+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:28.332970+0000","last_undegraded":"2024-09-10T15:27:28.332970+0000","last_fullsized":"2024-09-10T15:27:28.332970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341427+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341427+0000","last_peered":"2024-09-10T15:27:28.341427+0000","last_clean":"2024-09-10T15:27:28.341427+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341427+0000","last_undegraded":"2024-09-10T15:27:28.341427+0000","last_fullsized":"2024-09-10T15:27:28.341427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947386+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:27:28.947386+0000","last_peered":"2024-09-10T15:27:28.947386+0000","last_clean":"2024-09-10T15:27:28.947386+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:27:28.947386+0000","last_undegraded":"2024-09-10T15:27:28.947386+0000","last_fullsized":"2024-09-10T15:27:28.947386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339988+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:27:28.339988+0000","last_peered":"2024-09-10T15:27:28.339988+0000","last_clean":"2024-09-10T15:27:28.339988+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:27:28.339988+0000","last_undegraded":"2024-09-10T15:27:28.339988+0000","last_fullsized":"2024-09-10T15:27:28.339988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":32786,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331759+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:27:28.331759+0000","last_peered":"2024-09-10T15:27:28.331759+0000","last_clean":"2024-09-10T15:27:28.331759+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:27:28.331759+0000","last_undegraded":"2024-09-10T15:27:28.331759+0000","last_fullsized":"2024-09-10T15:27:28.331759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314343+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:27:28.314343+0000","last_peered":"2024-09-10T15:27:28.314343+0000","last_clean":"2024-09-10T15:27:28.314343+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:27:28.314343+0000","last_undegraded":"2024-09-10T15:27:28.314343+0000","last_fullsized":"2024-09-10T15:27:28.314343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313553+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:28.313553+0000","last_peered":"2024-09-10T15:27:28.313553+0000","last_clean":"2024-09-10T15:27:28.313553+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:28.313553+0000","last_undegraded":"2024-09-10T15:27:28.313553+0000","last_fullsized":"2024-09-10T15:27:28.313553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947771+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947771+0000","last_peered":"2024-09-10T15:27:28.947771+0000","last_clean":"2024-09-10T15:27:28.947771+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947771+0000","last_undegraded":"2024-09-10T15:27:28.947771+0000","last_fullsized":"2024-09-10T15:27:28.947771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340664+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:27:28.340664+0000","last_peered":"2024-09-10T15:27:28.340664+0000","last_clean":"2024-09-10T15:27:28.340664+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:27:28.340664+0000","last_undegraded":"2024-09-10T15:27:28.340664+0000","last_fullsized":"2024-09-10T15:27:28.340664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"69'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416098+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:28.416098+0000","last_peered":"2024-09-10T15:27:28.416098+0000","last_clean":"2024-09-10T15:27:28.416098+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:28.416098+0000","last_undegraded":"2024-09-10T15:27:28.416098+0000","last_fullsized":"2024-09-10T15:27:28.416098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695255+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:28.695255+0000","last_peered":"2024-09-10T15:27:28.695255+0000","last_clean":"2024-09-10T15:27:28.695255+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:28.695255+0000","last_undegraded":"2024-09-10T15:27:28.695255+0000","last_fullsized":"2024-09-10T15:27:28.695255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414864+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:27:28.414864+0000","last_peered":"2024-09-10T15:27:28.414864+0000","last_clean":"2024-09-10T15:27:28.414864+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:27:28.414864+0000","last_undegraded":"2024-09-10T15:27:28.414864+0000","last_fullsized":"2024-09-10T15:27:28.414864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'15","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.195021+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:27:33.195021+0000","last_peered":"2024-09-10T15:27:33.195021+0000","last_clean":"2024-09-10T15:27:33.195021+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:27:33.195021+0000","last_undegraded":"2024-09-10T15:27:33.195021+0000","last_fullsized":"2024-09-10T15:27:33.195021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334472+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:28.334472+0000","last_peered":"2024-09-10T15:27:28.334472+0000","last_clean":"2024-09-10T15:27:28.334472+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:28.334472+0000","last_undegraded":"2024-09-10T15:27:28.334472+0000","last_fullsized":"2024-09-10T15:27:28.334472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696128+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:27:28.696128+0000","last_peered":"2024-09-10T15:27:28.696128+0000","last_clean":"2024-09-10T15:27:28.696128+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:27:28.696128+0000","last_undegraded":"2024-09-10T15:27:28.696128+0000","last_fullsized":"2024-09-10T15:27:28.696128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'12","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315573+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:27:28.315573+0000","last_peered":"2024-09-10T15:27:28.315573+0000","last_clean":"2024-09-10T15:27:28.315573+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:27:28.315573+0000","last_undegraded":"2024-09-10T15:27:28.315573+0000","last_fullsized":"2024-09-10T15:27:28.315573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332058+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:27:28.332058+0000","last_peered":"2024-09-10T15:27:28.332058+0000","last_clean":"2024-09-10T15:27:28.332058+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:27:28.332058+0000","last_undegraded":"2024-09-10T15:27:28.332058+0000","last_fullsized":"2024-09-10T15:27:28.332058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'25","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312917+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:27:28.312917+0000","last_peered":"2024-09-10T15:27:28.312917+0000","last_clean":"2024-09-10T15:27:28.312917+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:27:28.312917+0000","last_undegraded":"2024-09-10T15:27:28.312917+0000","last_fullsized":"2024-09-10T15:27:28.312917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":32,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694615+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:27:28.694615+0000","last_peered":"2024-09-10T15:27:28.694615+0000","last_clean":"2024-09-10T15:27:28.694615+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:27:28.694615+0000","last_undegraded":"2024-09-10T15:27:28.694615+0000","last_fullsized":"2024-09-10T15:27:28.694615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492786+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:28.492786+0000","last_peered":"2024-09-10T15:27:28.492786+0000","last_clean":"2024-09-10T15:27:28.492786+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:28.492786+0000","last_undegraded":"2024-09-10T15:27:28.492786+0000","last_fullsized":"2024-09-10T15:27:28.492786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315251+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.315251+0000","last_peered":"2024-09-10T15:27:28.315251+0000","last_clean":"2024-09-10T15:27:28.315251+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:27:28.315251+0000","last_undegraded":"2024-09-10T15:27:28.315251+0000","last_fullsized":"2024-09-10T15:27:28.315251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490986+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:27:28.490986+0000","last_peered":"2024-09-10T15:27:28.490986+0000","last_clean":"2024-09-10T15:27:28.490986+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:27:28.490986+0000","last_undegraded":"2024-09-10T15:27:28.490986+0000","last_fullsized":"2024-09-10T15:27:28.490986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491267+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:27:28.491267+0000","last_peered":"2024-09-10T15:27:28.491267+0000","last_clean":"2024-09-10T15:27:28.491267+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:27:28.491267+0000","last_undegraded":"2024-09-10T15:27:28.491267+0000","last_fullsized":"2024-09-10T15:27:28.491267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"76'18","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948281+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:27:28.948281+0000","last_peered":"2024-09-10T15:27:28.948281+0000","last_clean":"2024-09-10T15:27:28.948281+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:27:28.948281+0000","last_undegraded":"2024-09-10T15:27:28.948281+0000","last_fullsized":"2024-09-10T15:27:28.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":27,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489636+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:28.489636+0000","last_peered":"2024-09-10T15:27:28.489636+0000","last_clean":"2024-09-10T15:27:28.489636+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:28.489636+0000","last_undegraded":"2024-09-10T15:27:28.489636+0000","last_fullsized":"2024-09-10T15:27:28.489636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693570+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693570+0000","last_peered":"2024-09-10T15:27:28.693570+0000","last_clean":"2024-09-10T15:27:28.693570+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693570+0000","last_undegraded":"2024-09-10T15:27:28.693570+0000","last_fullsized":"2024-09-10T15:27:28.693570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416540+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416540+0000","last_peered":"2024-09-10T15:27:28.416540+0000","last_clean":"2024-09-10T15:27:28.416540+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416540+0000","last_undegraded":"2024-09-10T15:27:28.416540+0000","last_fullsized":"2024-09-10T15:27:28.416540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"76'6","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415506+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:28.415506+0000","last_peered":"2024-09-10T15:27:28.415506+0000","last_clean":"2024-09-10T15:27:28.415506+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:28.415506+0000","last_undegraded":"2024-09-10T15:27:28.415506+0000","last_fullsized":"2024-09-10T15:27:28.415506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696187+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:28.696187+0000","last_peered":"2024-09-10T15:27:28.696187+0000","last_clean":"2024-09-10T15:27:28.696187+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:28.696187+0000","last_undegraded":"2024-09-10T15:27:28.696187+0000","last_fullsized":"2024-09-10T15:27:28.696187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"76'19","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696345+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:28.696345+0000","last_peered":"2024-09-10T15:27:28.696345+0000","last_clean":"2024-09-10T15:27:28.696345+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:28.696345+0000","last_undegraded":"2024-09-10T15:27:28.696345+0000","last_fullsized":"2024-09-10T15:27:28.696345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.075687+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:27:34.075687+0000","last_peered":"2024-09-10T15:27:34.075687+0000","last_clean":"2024-09-10T15:27:34.075687+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:27:34.075687+0000","last_undegraded":"2024-09-10T15:27:34.075687+0000","last_fullsized":"2024-09-10T15:27:34.075687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331612+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331612+0000","last_peered":"2024-09-10T15:27:28.331612+0000","last_clean":"2024-09-10T15:27:28.331612+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331612+0000","last_undegraded":"2024-09-10T15:27:28.331612+0000","last_fullsized":"2024-09-10T15:27:28.331612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341512+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341512+0000","last_peered":"2024-09-10T15:27:28.341512+0000","last_clean":"2024-09-10T15:27:28.341512+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341512+0000","last_undegraded":"2024-09-10T15:27:28.341512+0000","last_fullsized":"2024-09-10T15:27:28.341512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"71'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414253+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:28.414253+0000","last_peered":"2024-09-10T15:27:28.414253+0000","last_clean":"2024-09-10T15:27:28.414253+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:28.414253+0000","last_undegraded":"2024-09-10T15:27:28.414253+0000","last_fullsized":"2024-09-10T15:27:28.414253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948481+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:27:28.948481+0000","last_peered":"2024-09-10T15:27:28.948481+0000","last_clean":"2024-09-10T15:27:28.948481+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:27:28.948481+0000","last_undegraded":"2024-09-10T15:27:28.948481+0000","last_fullsized":"2024-09-10T15:27:28.948481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333326+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:28.333326+0000","last_peered":"2024-09-10T15:27:28.333326+0000","last_clean":"2024-09-10T15:27:28.333326+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:28.333326+0000","last_undegraded":"2024-09-10T15:27:28.333326+0000","last_fullsized":"2024-09-10T15:27:28.333326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'15","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.078767+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:27:34.078767+0000","last_peered":"2024-09-10T15:27:34.078767+0000","last_clean":"2024-09-10T15:27:34.078767+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:27:34.078767+0000","last_undegraded":"2024-09-10T15:27:34.078767+0000","last_fullsized":"2024-09-10T15:27:34.078767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340473+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340473+0000","last_peered":"2024-09-10T15:27:28.340473+0000","last_clean":"2024-09-10T15:27:28.340473+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340473+0000","last_undegraded":"2024-09-10T15:27:28.340473+0000","last_fullsized":"2024-09-10T15:27:28.340473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493307+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:27:28.493307+0000","last_peered":"2024-09-10T15:27:28.493307+0000","last_clean":"2024-09-10T15:27:28.493307+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:27:28.493307+0000","last_undegraded":"2024-09-10T15:27:28.493307+0000","last_fullsized":"2024-09-10T15:27:28.493307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"76'11","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313936+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:28.313936+0000","last_peered":"2024-09-10T15:27:28.313936+0000","last_clean":"2024-09-10T15:27:28.313936+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:28.313936+0000","last_undegraded":"2024-09-10T15:27:28.313936+0000","last_fullsized":"2024-09-10T15:27:28.313936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416759+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:27:28.416759+0000","last_peered":"2024-09-10T15:27:28.416759+0000","last_clean":"2024-09-10T15:27:28.416759+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:27:28.416759+0000","last_undegraded":"2024-09-10T15:27:28.416759+0000","last_fullsized":"2024-09-10T15:27:28.416759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"76'21","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947901+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:27:28.947901+0000","last_peered":"2024-09-10T15:27:28.947901+0000","last_clean":"2024-09-10T15:27:28.947901+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:27:28.947901+0000","last_undegraded":"2024-09-10T15:27:28.947901+0000","last_fullsized":"2024-09-10T15:27:28.947901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341994+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:28.341994+0000","last_peered":"2024-09-10T15:27:28.341994+0000","last_clean":"2024-09-10T15:27:28.341994+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:28.341994+0000","last_undegraded":"2024-09-10T15:27:28.341994+0000","last_fullsized":"2024-09-10T15:27:28.341994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489952+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.489952+0000","last_peered":"2024-09-10T15:27:28.489952+0000","last_clean":"2024-09-10T15:27:28.489952+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.489952+0000","last_undegraded":"2024-09-10T15:27:28.489952+0000","last_fullsized":"2024-09-10T15:27:28.489952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416212+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416212+0000","last_peered":"2024-09-10T15:27:28.416212+0000","last_clean":"2024-09-10T15:27:28.416212+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416212+0000","last_undegraded":"2024-09-10T15:27:28.416212+0000","last_fullsized":"2024-09-10T15:27:28.416212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":315,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947773+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:27:28.947773+0000","last_peered":"2024-09-10T15:27:28.947773+0000","last_clean":"2024-09-10T15:27:28.947773+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:27:28.947773+0000","last_undegraded":"2024-09-10T15:27:28.947773+0000","last_fullsized":"2024-09-10T15:27:28.947773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415740+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415740+0000","last_peered":"2024-09-10T15:27:28.415740+0000","last_clean":"2024-09-10T15:27:28.415740+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415740+0000","last_undegraded":"2024-09-10T15:27:28.415740+0000","last_fullsized":"2024-09-10T15:27:28.415740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314357+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:28.314357+0000","last_peered":"2024-09-10T15:27:28.314357+0000","last_clean":"2024-09-10T15:27:28.314357+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:28.314357+0000","last_undegraded":"2024-09-10T15:27:28.314357+0000","last_fullsized":"2024-09-10T15:27:28.314357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":49176,"num_write":56,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314018+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:27:28.314018+0000","last_peered":"2024-09-10T15:27:28.314018+0000","last_clean":"2024-09-10T15:27:28.314018+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:27:28.314018+0000","last_undegraded":"2024-09-10T15:27:28.314018+0000","last_fullsized":"2024-09-10T15:27:28.314018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'30","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416630+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:27:28.416630+0000","last_peered":"2024-09-10T15:27:28.416630+0000","last_clean":"2024-09-10T15:27:28.416630+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:27:28.416630+0000","last_undegraded":"2024-09-10T15:27:28.416630+0000","last_fullsized":"2024-09-10T15:27:28.416630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28500,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693638+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:27:28.693638+0000","last_peered":"2024-09-10T15:27:28.693638+0000","last_clean":"2024-09-10T15:27:28.693638+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:27:28.693638+0000","last_undegraded":"2024-09-10T15:27:28.693638+0000","last_fullsized":"2024-09-10T15:27:28.693638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314349+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:28.314349+0000","last_peered":"2024-09-10T15:27:28.314349+0000","last_clean":"2024-09-10T15:27:28.314349+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:28.314349+0000","last_undegraded":"2024-09-10T15:27:28.314349+0000","last_fullsized":"2024-09-10T15:27:28.314349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696870+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:27:28.696870+0000","last_peered":"2024-09-10T15:27:28.696870+0000","last_clean":"2024-09-10T15:27:28.696870+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:27:28.696870+0000","last_undegraded":"2024-09-10T15:27:28.696870+0000","last_fullsized":"2024-09-10T15:27:28.696870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415458+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415458+0000","last_peered":"2024-09-10T15:27:28.415458+0000","last_clean":"2024-09-10T15:27:28.415458+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415458+0000","last_undegraded":"2024-09-10T15:27:28.415458+0000","last_fullsized":"2024-09-10T15:27:28.415458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"76'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332661+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:27:28.332661+0000","last_peered":"2024-09-10T15:27:28.332661+0000","last_clean":"2024-09-10T15:27:28.332661+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:27:28.332661+0000","last_undegraded":"2024-09-10T15:27:28.332661+0000","last_fullsized":"2024-09-10T15:27:28.332661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":24,"num_read_kb":49164,"num_write":36,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416394+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:27:28.416394+0000","last_peered":"2024-09-10T15:27:28.416394+0000","last_clean":"2024-09-10T15:27:28.416394+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:27:28.416394+0000","last_undegraded":"2024-09-10T15:27:28.416394+0000","last_fullsized":"2024-09-10T15:27:28.416394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'49","reported_seq":232,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035688+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:27:31.035688+0000","last_peered":"2024-09-10T15:27:31.035688+0000","last_clean":"2024-09-10T15:27:31.035688+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:27:31.035688+0000","last_undegraded":"2024-09-10T15:27:31.035688+0000","last_fullsized":"2024-09-10T15:27:31.035688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":85,"num_write":48,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416482+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:27:28.416482+0000","last_peered":"2024-09-10T15:27:28.416482+0000","last_clean":"2024-09-10T15:27:28.416482+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:27:28.416482+0000","last_undegraded":"2024-09-10T15:27:28.416482+0000","last_fullsized":"2024-09-10T15:27:28.416482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694935+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:28.694935+0000","last_peered":"2024-09-10T15:27:28.694935+0000","last_clean":"2024-09-10T15:27:28.694935+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:28.694935+0000","last_undegraded":"2024-09-10T15:27:28.694935+0000","last_fullsized":"2024-09-10T15:27:28.694935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334556+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:27:28.334556+0000","last_peered":"2024-09-10T15:27:28.334556+0000","last_clean":"2024-09-10T15:27:28.334556+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:27:28.334556+0000","last_undegraded":"2024-09-10T15:27:28.334556+0000","last_fullsized":"2024-09-10T15:27:28.334556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490049+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:27:28.490049+0000","last_peered":"2024-09-10T15:27:28.490049+0000","last_clean":"2024-09-10T15:27:28.490049+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:27:28.490049+0000","last_undegraded":"2024-09-10T15:27:28.490049+0000","last_fullsized":"2024-09-10T15:27:28.490049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694409+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:28.694409+0000","last_peered":"2024-09-10T15:27:28.694409+0000","last_clean":"2024-09-10T15:27:28.694409+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:28.694409+0000","last_undegraded":"2024-09-10T15:27:28.694409+0000","last_fullsized":"2024-09-10T15:27:28.694409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24588,"num_write":29,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492515+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:27:28.492515+0000","last_peered":"2024-09-10T15:27:28.492515+0000","last_clean":"2024-09-10T15:27:28.492515+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:27:28.492515+0000","last_undegraded":"2024-09-10T15:27:28.492515+0000","last_fullsized":"2024-09-10T15:27:28.492515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035733+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:27:31.035733+0000","last_peered":"2024-09-10T15:27:31.035733+0000","last_clean":"2024-09-10T15:27:31.035733+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:27:31.035733+0000","last_undegraded":"2024-09-10T15:27:31.035733+0000","last_fullsized":"2024-09-10T15:27:31.035733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314725+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.314725+0000","last_peered":"2024-09-10T15:27:28.314725+0000","last_clean":"2024-09-10T15:27:28.314725+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.314725+0000","last_undegraded":"2024-09-10T15:27:28.314725+0000","last_fullsized":"2024-09-10T15:27:28.314725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314109+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:28.314109+0000","last_peered":"2024-09-10T15:27:28.314109+0000","last_clean":"2024-09-10T15:27:28.314109+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:28.314109+0000","last_undegraded":"2024-09-10T15:27:28.314109+0000","last_fullsized":"2024-09-10T15:27:28.314109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333823+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333823+0000","last_peered":"2024-09-10T15:27:28.333823+0000","last_clean":"2024-09-10T15:27:28.333823+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333823+0000","last_undegraded":"2024-09-10T15:27:28.333823+0000","last_fullsized":"2024-09-10T15:27:28.333823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415593+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415593+0000","last_peered":"2024-09-10T15:27:28.415593+0000","last_clean":"2024-09-10T15:27:28.415593+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415593+0000","last_undegraded":"2024-09-10T15:27:28.415593+0000","last_fullsized":"2024-09-10T15:27:28.415593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"76'9","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489894+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:28.489894+0000","last_peered":"2024-09-10T15:27:28.489894+0000","last_clean":"2024-09-10T15:27:28.489894+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:28.489894+0000","last_undegraded":"2024-09-10T15:27:28.489894+0000","last_fullsized":"2024-09-10T15:27:28.489894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:22.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491363+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:27:28.491363+0000","last_peered":"2024-09-10T15:27:28.491363+0000","last_clean":"2024-09-10T15:27:28.491363+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:27:28.491363+0000","last_undegraded":"2024-09-10T15:27:28.491363+0000","last_fullsized":"2024-09-10T15:27:28.491363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696503+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:27:28.696503+0000","last_peered":"2024-09-10T15:27:28.696503+0000","last_clean":"2024-09-10T15:27:28.696503+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:27:28.696503+0000","last_undegraded":"2024-09-10T15:27:28.696503+0000","last_fullsized":"2024-09-10T15:27:28.696503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416993+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:28.416993+0000","last_peered":"2024-09-10T15:27:28.416993+0000","last_clean":"2024-09-10T15:27:28.416993+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:28.416993+0000","last_undegraded":"2024-09-10T15:27:28.416993+0000","last_fullsized":"2024-09-10T15:27:28.416993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947060+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:28.947060+0000","last_peered":"2024-09-10T15:27:28.947060+0000","last_clean":"2024-09-10T15:27:28.947060+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:28.947060+0000","last_undegraded":"2024-09-10T15:27:28.947060+0000","last_fullsized":"2024-09-10T15:27:28.947060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332108+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332108+0000","last_peered":"2024-09-10T15:27:28.332108+0000","last_clean":"2024-09-10T15:27:28.332108+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332108+0000","last_undegraded":"2024-09-10T15:27:28.332108+0000","last_fullsized":"2024-09-10T15:27:28.332108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341413+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:27:28.341413+0000","last_peered":"2024-09-10T15:27:28.341413+0000","last_clean":"2024-09-10T15:27:28.341413+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:27:28.341413+0000","last_undegraded":"2024-09-10T15:27:28.341413+0000","last_fullsized":"2024-09-10T15:27:28.341413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697320+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697320+0000","last_peered":"2024-09-10T15:27:28.697320+0000","last_clean":"2024-09-10T15:27:28.697320+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697320+0000","last_undegraded":"2024-09-10T15:27:28.697320+0000","last_fullsized":"2024-09-10T15:27:28.697320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314579+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:27:28.314579+0000","last_peered":"2024-09-10T15:27:28.314579+0000","last_clean":"2024-09-10T15:27:28.314579+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:27:28.314579+0000","last_undegraded":"2024-09-10T15:27:28.314579+0000","last_fullsized":"2024-09-10T15:27:28.314579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"76'28","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490320+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:27:28.490320+0000","last_peered":"2024-09-10T15:27:28.490320+0000","last_clean":"2024-09-10T15:27:28.490320+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:27:28.490320+0000","last_undegraded":"2024-09-10T15:27:28.490320+0000","last_fullsized":"2024-09-10T15:27:28.490320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16571,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340394+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340394+0000","last_peered":"2024-09-10T15:27:28.340394+0000","last_clean":"2024-09-10T15:27:28.340394+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340394+0000","last_undegraded":"2024-09-10T15:27:28.340394+0000","last_fullsized":"2024-09-10T15:27:28.340394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696197+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:28.696197+0000","last_peered":"2024-09-10T15:27:28.696197+0000","last_clean":"2024-09-10T15:27:28.696197+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:28.696197+0000","last_undegraded":"2024-09-10T15:27:28.696197+0000","last_fullsized":"2024-09-10T15:27:28.696197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333620+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:27:28.333620+0000","last_peered":"2024-09-10T15:27:28.333620+0000","last_clean":"2024-09-10T15:27:28.333620+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:27:28.333620+0000","last_undegraded":"2024-09-10T15:27:28.333620+0000","last_fullsized":"2024-09-10T15:27:28.333620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334268+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:27:28.334268+0000","last_peered":"2024-09-10T15:27:28.334268+0000","last_clean":"2024-09-10T15:27:28.334268+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:27:28.334268+0000","last_undegraded":"2024-09-10T15:27:28.334268+0000","last_fullsized":"2024-09-10T15:27:28.334268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414797+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414797+0000","last_peered":"2024-09-10T15:27:28.414797+0000","last_clean":"2024-09-10T15:27:28.414797+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414797+0000","last_undegraded":"2024-09-10T15:27:28.414797+0000","last_fullsized":"2024-09-10T15:27:28.414797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313704+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:27:28.313704+0000","last_peered":"2024-09-10T15:27:28.313704+0000","last_clean":"2024-09-10T15:27:28.313704+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:27:28.313704+0000","last_undegraded":"2024-09-10T15:27:28.313704+0000","last_fullsized":"2024-09-10T15:27:28.313704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331980+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.331980+0000","last_peered":"2024-09-10T15:27:28.331980+0000","last_clean":"2024-09-10T15:27:28.331980+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.331980+0000","last_undegraded":"2024-09-10T15:27:28.331980+0000","last_fullsized":"2024-09-10T15:27:28.331980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035702+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:31.035702+0000","last_peered":"2024-09-10T15:27:31.035702+0000","last_clean":"2024-09-10T15:27:31.035702+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:31.035702+0000","last_undegraded":"2024-09-10T15:27:31.035702+0000","last_fullsized":"2024-09-10T15:27:31.035702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492360+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:28.492360+0000","last_peered":"2024-09-10T15:27:28.492360+0000","last_clean":"2024-09-10T15:27:28.492360+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:28.492360+0000","last_undegraded":"2024-09-10T15:27:28.492360+0000","last_fullsized":"2024-09-10T15:27:28.492360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313734+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:27:28.313734+0000","last_peered":"2024-09-10T15:27:28.313734+0000","last_clean":"2024-09-10T15:27:28.313734+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:27:28.313734+0000","last_undegraded":"2024-09-10T15:27:28.313734+0000","last_fullsized":"2024-09-10T15:27:28.313734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"76'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316031+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:28.316031+0000","last_peered":"2024-09-10T15:27:28.316031+0000","last_clean":"2024-09-10T15:27:28.316031+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:28.316031+0000","last_undegraded":"2024-09-10T15:27:28.316031+0000","last_fullsized":"2024-09-10T15:27:28.316031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316149+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316149+0000","last_peered":"2024-09-10T15:27:28.316149+0000","last_clean":"2024-09-10T15:27:28.316149+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316149+0000","last_undegraded":"2024-09-10T15:27:28.316149+0000","last_fullsized":"2024-09-10T15:27:28.316149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414992+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:27:28.414992+0000","last_peered":"2024-09-10T15:27:28.414992+0000","last_clean":"2024-09-10T15:27:28.414992+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:27:28.414992+0000","last_undegraded":"2024-09-10T15:27:28.414992+0000","last_fullsized":"2024-09-10T15:27:28.414992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415219+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:27:28.415219+0000","last_peered":"2024-09-10T15:27:28.415219+0000","last_clean":"2024-09-10T15:27:28.415219+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:27:28.415219+0000","last_undegraded":"2024-09-10T15:27:28.415219+0000","last_fullsized":"2024-09-10T15:27:28.415219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'15","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035813+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:27:31.035813+0000","last_peered":"2024-09-10T15:27:31.035813+0000","last_clean":"2024-09-10T15:27:31.035813+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:27:31.035813+0000","last_undegraded":"2024-09-10T15:27:31.035813+0000","last_fullsized":"2024-09-10T15:27:31.035813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695333+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:28.695333+0000","last_peered":"2024-09-10T15:27:28.695333+0000","last_clean":"2024-09-10T15:27:28.695333+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:28.695333+0000","last_undegraded":"2024-09-10T15:27:28.695333+0000","last_fullsized":"2024-09-10T15:27:28.695333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340766+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:27:28.340766+0000","last_peered":"2024-09-10T15:27:28.340766+0000","last_clean":"2024-09-10T15:27:28.340766+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:27:28.340766+0000","last_undegraded":"2024-09-10T15:27:28.340766+0000","last_fullsized":"2024-09-10T15:27:28.340766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'8","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315897+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:28.315897+0000","last_peered":"2024-09-10T15:27:28.315897+0000","last_clean":"2024-09-10T15:27:28.315897+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:28.315897+0000","last_undegraded":"2024-09-10T15:27:28.315897+0000","last_fullsized":"2024-09-10T15:27:28.315897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414338+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414338+0000","last_peered":"2024-09-10T15:27:28.414338+0000","last_clean":"2024-09-10T15:27:28.414338+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414338+0000","last_undegraded":"2024-09-10T15:27:28.414338+0000","last_fullsized":"2024-09-10T15:27:28.414338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313222+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:27:28.313222+0000","last_peered":"2024-09-10T15:27:28.313222+0000","last_clean":"2024-09-10T15:27:28.313222+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:27:28.313222+0000","last_undegraded":"2024-09-10T15:27:28.313222+0000","last_fullsized":"2024-09-10T15:27:28.313222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"76'30","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313533+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:28.313533+0000","last_peered":"2024-09-10T15:27:28.313533+0000","last_clean":"2024-09-10T15:27:28.313533+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:28.313533+0000","last_undegraded":"2024-09-10T15:27:28.313533+0000","last_fullsized":"2024-09-10T15:27:28.313533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16131,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314089+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314089+0000","last_peered":"2024-09-10T15:27:28.314089+0000","last_clean":"2024-09-10T15:27:28.314089+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314089+0000","last_undegraded":"2024-09-10T15:27:28.314089+0000","last_fullsized":"2024-09-10T15:27:28.314089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341327+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:28.341327+0000","last_peered":"2024-09-10T15:27:28.341327+0000","last_clean":"2024-09-10T15:27:28.341327+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:28.341327+0000","last_undegraded":"2024-09-10T15:27:28.341327+0000","last_fullsized":"2024-09-10T15:27:28.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314871+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314871+0000","last_peered":"2024-09-10T15:27:28.314871+0000","last_clean":"2024-09-10T15:27:28.314871+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314871+0000","last_undegraded":"2024-09-10T15:27:28.314871+0000","last_fullsized":"2024-09-10T15:27:28.314871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341154+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:27:28.341154+0000","last_peered":"2024-09-10T15:27:28.341154+0000","last_clean":"2024-09-10T15:27:28.341154+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:27:28.341154+0000","last_undegraded":"2024-09-10T15:27:28.341154+0000","last_fullsized":"2024-09-10T15:27:28.341154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416215+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:27:28.416215+0000","last_peered":"2024-09-10T15:27:28.416215+0000","last_clean":"2024-09-10T15:27:28.416215+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:27:28.416215+0000","last_undegraded":"2024-09-10T15:27:28.416215+0000","last_fullsized":"2024-09-10T15:27:28.416215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":45068,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332605+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:27:28.332605+0000","last_peered":"2024-09-10T15:27:28.332605+0000","last_clean":"2024-09-10T15:27:28.332605+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:27:28.332605+0000","last_undegraded":"2024-09-10T15:27:28.332605+0000","last_fullsized":"2024-09-10T15:27:28.332605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"76'18","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332079+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:27:28.332079+0000","last_peered":"2024-09-10T15:27:28.332079+0000","last_clean":"2024-09-10T15:27:28.332079+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:27:28.332079+0000","last_undegraded":"2024-09-10T15:27:28.332079+0000","last_fullsized":"2024-09-10T15:27:28.332079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489143+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:27:28.489143+0000","last_peered":"2024-09-10T15:27:28.489143+0000","last_clean":"2024-09-10T15:27:28.489143+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:27:28.489143+0000","last_undegraded":"2024-09-10T15:27:28.489143+0000","last_fullsized":"2024-09-10T15:27:28.489143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492067+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492067+0000","last_peered":"2024-09-10T15:27:28.492067+0000","last_clean":"2024-09-10T15:27:28.492067+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492067+0000","last_undegraded":"2024-09-10T15:27:28.492067+0000","last_fullsized":"2024-09-10T15:27:28.492067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314013+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:28.314013+0000","last_peered":"2024-09-10T15:27:28.314013+0000","last_clean":"2024-09-10T15:27:28.314013+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:28.314013+0000","last_undegraded":"2024-09-10T15:27:28.314013+0000","last_fullsized":"2024-09-10T15:27:28.314013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"76'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316348+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:27:28.316348+0000","last_peered":"2024-09-10T15:27:28.316348+0000","last_clean":"2024-09-10T15:27:28.316348+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:27:28.316348+0000","last_undegraded":"2024-09-10T15:27:28.316348+0000","last_fullsized":"2024-09-10T15:27:28.316348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314352+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:27:28.314352+0000","last_peered":"2024-09-10T15:27:28.314352+0000","last_clean":"2024-09-10T15:27:28.314352+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:27:28.314352+0000","last_undegraded":"2024-09-10T15:27:28.314352+0000","last_fullsized":"2024-09-10T15:27:28.314352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313070+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:27:28.313070+0000","last_peered":"2024-09-10T15:27:28.313070+0000","last_clean":"2024-09-10T15:27:28.313070+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:27:28.313070+0000","last_undegraded":"2024-09-10T15:27:28.313070+0000","last_fullsized":"2024-09-10T15:27:28.313070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333594+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:28.333594+0000","last_peered":"2024-09-10T15:27:28.333594+0000","last_clean":"2024-09-10T15:27:28.333594+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:28.333594+0000","last_undegraded":"2024-09-10T15:27:28.333594+0000","last_fullsized":"2024-09-10T15:27:28.333594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313586+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:27:28.313586+0000","last_peered":"2024-09-10T15:27:28.313586+0000","last_clean":"2024-09-10T15:27:28.313586+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:27:28.313586+0000","last_undegraded":"2024-09-10T15:27:28.313586+0000","last_fullsized":"2024-09-10T15:27:28.313586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"76'6","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341923+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:27:28.341923+0000","last_peered":"2024-09-10T15:27:28.341923+0000","last_clean":"2024-09-10T15:27:28.341923+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:27:28.341923+0000","last_undegraded":"2024-09-10T15:27:28.341923+0000","last_fullsized":"2024-09-10T15:27:28.341923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340106+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:27:28.340106+0000","last_peered":"2024-09-10T15:27:28.340106+0000","last_clean":"2024-09-10T15:27:28.340106+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:27:28.340106+0000","last_undegraded":"2024-09-10T15:27:28.340106+0000","last_fullsized":"2024-09-10T15:27:28.340106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"76'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490985+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:27:28.490985+0000","last_peered":"2024-09-10T15:27:28.490985+0000","last_clean":"2024-09-10T15:27:28.490985+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:27:28.490985+0000","last_undegraded":"2024-09-10T15:27:28.490985+0000","last_fullsized":"2024-09-10T15:27:28.490985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947458+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:28.947458+0000","last_peered":"2024-09-10T15:27:28.947458+0000","last_clean":"2024-09-10T15:27:28.947458+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:28.947458+0000","last_undegraded":"2024-09-10T15:27:28.947458+0000","last_fullsized":"2024-09-10T15:27:28.947458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415920+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:28.415920+0000","last_peered":"2024-09-10T15:27:28.415920+0000","last_clean":"2024-09-10T15:27:28.415920+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:28.415920+0000","last_undegraded":"2024-09-10T15:27:28.415920+0000","last_fullsized":"2024-09-10T15:27:28.415920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490524+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:27:28.490524+0000","last_peered":"2024-09-10T15:27:28.490524+0000","last_clean":"2024-09-10T15:27:28.490524+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:27:28.490524+0000","last_undegraded":"2024-09-10T15:27:28.490524+0000","last_fullsized":"2024-09-10T15:27:28.490524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697982+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:28.697982+0000","last_peered":"2024-09-10T15:27:28.697982+0000","last_clean":"2024-09-10T15:27:28.697982+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:28.697982+0000","last_undegraded":"2024-09-10T15:27:28.697982+0000","last_fullsized":"2024-09-10T15:27:28.697982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415092+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:27:28.415092+0000","last_peered":"2024-09-10T15:27:28.415092+0000","last_clean":"2024-09-10T15:27:28.415092+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:27:28.415092+0000","last_undegraded":"2024-09-10T15:27:28.415092+0000","last_fullsized":"2024-09-10T15:27:28.415092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"76'16","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313810+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:27:28.313810+0000","last_peered":"2024-09-10T15:27:28.313810+0000","last_clean":"2024-09-10T15:27:28.313810+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:27:28.313810+0000","last_undegraded":"2024-09-10T15:27:28.313810+0000","last_fullsized":"2024-09-10T15:27:28.313810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490332+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:27:28.490332+0000","last_peered":"2024-09-10T15:27:28.490332+0000","last_clean":"2024-09-10T15:27:28.490332+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:27:28.490332+0000","last_undegraded":"2024-09-10T15:27:28.490332+0000","last_fullsized":"2024-09-10T15:27:28.490332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416768+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:27:28.416768+0000","last_peered":"2024-09-10T15:27:28.416768+0000","last_clean":"2024-09-10T15:27:28.416768+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:27:28.416768+0000","last_undegraded":"2024-09-10T15:27:28.416768+0000","last_fullsized":"2024-09-10T15:27:28.416768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695012+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:27:28.695012+0000","last_peered":"2024-09-10T15:27:28.695012+0000","last_clean":"2024-09-10T15:27:28.695012+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:27:28.695012+0000","last_undegraded":"2024-09-10T15:27:28.695012+0000","last_fullsized":"2024-09-10T15:27:28.695012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334748+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:27:28.334748+0000","last_peered":"2024-09-10T15:27:28.334748+0000","last_clean":"2024-09-10T15:27:28.334748+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:27:28.334748+0000","last_undegraded":"2024-09-10T15:27:28.334748+0000","last_fullsized":"2024-09-10T15:27:28.334748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"76'22","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333589+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:28.333589+0000","last_peered":"2024-09-10T15:27:28.333589+0000","last_clean":"2024-09-10T15:27:28.333589+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:28.333589+0000","last_undegraded":"2024-09-10T15:27:28.333589+0000","last_fullsized":"2024-09-10T15:27:28.333589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339933+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:28.339933+0000","last_peered":"2024-09-10T15:27:28.339933+0000","last_clean":"2024-09-10T15:27:28.339933+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:28.339933+0000","last_undegraded":"2024-09-10T15:27:28.339933+0000","last_fullsized":"2024-09-10T15:27:28.339933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695048+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:28.695048+0000","last_peered":"2024-09-10T15:27:28.695048+0000","last_clean":"2024-09-10T15:27:28.695048+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:28.695048+0000","last_undegraded":"2024-09-10T15:27:28.695048+0000","last_fullsized":"2024-09-10T15:27:28.695048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315808+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:27:28.315808+0000","last_peered":"2024-09-10T15:27:28.315808+0000","last_clean":"2024-09-10T15:27:28.315808+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:27:28.315808+0000","last_undegraded":"2024-09-10T15:27:28.315808+0000","last_fullsized":"2024-09-10T15:27:28.315808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"76'13","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314064+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:28.314064+0000","last_peered":"2024-09-10T15:27:28.314064+0000","last_clean":"2024-09-10T15:27:28.314064+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:28.314064+0000","last_undegraded":"2024-09-10T15:27:28.314064+0000","last_fullsized":"2024-09-10T15:27:28.314064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341227+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:27:28.341227+0000","last_peered":"2024-09-10T15:27:28.341227+0000","last_clean":"2024-09-10T15:27:28.341227+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:27:28.341227+0000","last_undegraded":"2024-09-10T15:27:28.341227+0000","last_fullsized":"2024-09-10T15:27:28.341227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"76'20","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416187+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:27:28.416187+0000","last_peered":"2024-09-10T15:27:28.416187+0000","last_clean":"2024-09-10T15:27:28.416187+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:27:28.416187+0000","last_undegraded":"2024-09-10T15:27:28.416187+0000","last_fullsized":"2024-09-10T15:27:28.416187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695668+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:28.695668+0000","last_peered":"2024-09-10T15:27:28.695668+0000","last_clean":"2024-09-10T15:27:28.695668+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:28.695668+0000","last_undegraded":"2024-09-10T15:27:28.695668+0000","last_fullsized":"2024-09-10T15:27:28.695668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415602+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:28.415602+0000","last_peered":"2024-09-10T15:27:28.415602+0000","last_clean":"2024-09-10T15:27:28.415602+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:28.415602+0000","last_undegraded":"2024-09-10T15:27:28.415602+0000","last_fullsized":"2024-09-10T15:27:28.415602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491600+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:27:28.491600+0000","last_peered":"2024-09-10T15:27:28.491600+0000","last_clean":"2024-09-10T15:27:28.491600+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:27:28.491600+0000","last_undegraded":"2024-09-10T15:27:28.491600+0000","last_fullsized":"2024-09-10T15:27:28.491600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"71'6","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947965+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:27:28.947965+0000","last_peered":"2024-09-10T15:27:28.947965+0000","last_clean":"2024-09-10T15:27:28.947965+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:27:28.947965+0000","last_undegraded":"2024-09-10T15:27:28.947965+0000","last_fullsized":"2024-09-10T15:27:28.947965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341641+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:27:28.341641+0000","last_peered":"2024-09-10T15:27:28.341641+0000","last_clean":"2024-09-10T15:27:28.341641+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:27:28.341641+0000","last_undegraded":"2024-09-10T15:27:28.341641+0000","last_fullsized":"2024-09-10T15:27:28.341641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"76'14","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333989+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:27:28.333989+0000","last_peered":"2024-09-10T15:27:28.333989+0000","last_clean":"2024-09-10T15:27:28.333989+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:27:28.333989+0000","last_undegraded":"2024-09-10T15:27:28.333989+0000","last_fullsized":"2024-09-10T15:27:28.333989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489208+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489208+0000","last_peered":"2024-09-10T15:27:28.489208+0000","last_clean":"2024-09-10T15:27:28.489208+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489208+0000","last_undegraded":"2024-09-10T15:27:28.489208+0000","last_fullsized":"2024-09-10T15:27:28.489208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414558+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:28.414558+0000","last_peered":"2024-09-10T15:27:28.414558+0000","last_clean":"2024-09-10T15:27:28.414558+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:28.414558+0000","last_undegraded":"2024-09-10T15:27:28.414558+0000","last_fullsized":"2024-09-10T15:27:28.414558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315425+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:27:28.315425+0000","last_peered":"2024-09-10T15:27:28.315425+0000","last_clean":"2024-09-10T15:27:28.315425+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:27:28.315425+0000","last_undegraded":"2024-09-10T15:27:28.315425+0000","last_fullsized":"2024-09-10T15:27:28.315425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315796+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:28.315796+0000","last_peered":"2024-09-10T15:27:28.315796+0000","last_clean":"2024-09-10T15:27:28.315796+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:28.315796+0000","last_undegraded":"2024-09-10T15:27:28.315796+0000","last_fullsized":"2024-09-10T15:27:28.315796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47122,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314946+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:27:28.314946+0000","last_peered":"2024-09-10T15:27:28.314946+0000","last_clean":"2024-09-10T15:27:28.314946+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:27:28.314946+0000","last_undegraded":"2024-09-10T15:27:28.314946+0000","last_fullsized":"2024-09-10T15:27:28.314946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"88'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416555+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:27:28.416555+0000","last_peered":"2024-09-10T15:27:28.416555+0000","last_clean":"2024-09-10T15:27:28.416555+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:27:28.416555+0000","last_undegraded":"2024-09-10T15:27:28.416555+0000","last_fullsized":"2024-09-10T15:27:28.416555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'15","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035948+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:31.035948+0000","last_peered":"2024-09-10T15:27:31.035948+0000","last_clean":"2024-09-10T15:27:31.035948+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:31.035948+0000","last_undegraded":"2024-09-10T15:27:31.035948+0000","last_fullsized":"2024-09-10T15:27:31.035948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414710+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:28.414710+0000","last_peered":"2024-09-10T15:27:28.414710+0000","last_clean":"2024-09-10T15:27:28.414710+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:28.414710+0000","last_undegraded":"2024-09-10T15:27:28.414710+0000","last_fullsized":"2024-09-10T15:27:28.414710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341111+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:27:28.341111+0000","last_peered":"2024-09-10T15:27:28.341111+0000","last_clean":"2024-09-10T15:27:28.341111+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:27:28.341111+0000","last_undegraded":"2024-09-10T15:27:28.341111+0000","last_fullsized":"2024-09-10T15:27:28.341111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"76'10","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947928+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:27:28.947928+0000","last_peered":"2024-09-10T15:27:28.947928+0000","last_clean":"2024-09-10T15:27:28.947928+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:27:28.947928+0000","last_undegraded":"2024-09-10T15:27:28.947928+0000","last_fullsized":"2024-09-10T15:27:28.947928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947579+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:27:28.947579+0000","last_peered":"2024-09-10T15:27:28.947579+0000","last_clean":"2024-09-10T15:27:28.947579+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:27:28.947579+0000","last_undegraded":"2024-09-10T15:27:28.947579+0000","last_fullsized":"2024-09-10T15:27:28.947579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"76'20","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314207+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:27:28.314207+0000","last_peered":"2024-09-10T15:27:28.314207+0000","last_clean":"2024-09-10T15:27:28.314207+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:27:28.314207+0000","last_undegraded":"2024-09-10T15:27:28.314207+0000","last_fullsized":"2024-09-10T15:27:28.314207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313219+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:28.313219+0000","last_peered":"2024-09-10T15:27:28.313219+0000","last_clean":"2024-09-10T15:27:28.313219+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:28.313219+0000","last_undegraded":"2024-09-10T15:27:28.313219+0000","last_fullsized":"2024-09-10T15:27:28.313219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948271+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:28.948271+0000","last_peered":"2024-09-10T15:27:28.948271+0000","last_clean":"2024-09-10T15:27:28.948271+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:28.948271+0000","last_undegraded":"2024-09-10T15:27:28.948271+0000","last_fullsized":"2024-09-10T15:27:28.948271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340645+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:27:28.340645+0000","last_peered":"2024-09-10T15:27:28.340645+0000","last_clean":"2024-09-10T15:27:28.340645+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:27:28.340645+0000","last_undegraded":"2024-09-10T15:27:28.340645+0000","last_fullsized":"2024-09-10T15:27:28.340645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414699+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:28.414699+0000","last_peered":"2024-09-10T15:27:28.414699+0000","last_clean":"2024-09-10T15:27:28.414699+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:28.414699+0000","last_undegraded":"2024-09-10T15:27:28.414699+0000","last_fullsized":"2024-09-10T15:27:28.414699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24594,"num_write":40,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340914+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:27:28.340914+0000","last_peered":"2024-09-10T15:27:28.340914+0000","last_clean":"2024-09-10T15:27:28.340914+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:27:28.340914+0000","last_undegraded":"2024-09-10T15:27:28.340914+0000","last_fullsized":"2024-09-10T15:27:28.340914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313782+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:27:28.313782+0000","last_peered":"2024-09-10T15:27:28.313782+0000","last_clean":"2024-09-10T15:27:28.313782+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:27:28.313782+0000","last_undegraded":"2024-09-10T15:27:28.313782+0000","last_fullsized":"2024-09-10T15:27:28.313782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414873+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:28.414873+0000","last_peered":"2024-09-10T15:27:28.414873+0000","last_clean":"2024-09-10T15:27:28.414873+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:28.414873+0000","last_undegraded":"2024-09-10T15:27:28.414873+0000","last_fullsized":"2024-09-10T15:27:28.414873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696568+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:28.696568+0000","last_peered":"2024-09-10T15:27:28.696568+0000","last_clean":"2024-09-10T15:27:28.696568+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:28.696568+0000","last_undegraded":"2024-09-10T15:27:28.696568+0000","last_fullsized":"2024-09-10T15:27:28.696568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490260+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:27:28.490260+0000","last_peered":"2024-09-10T15:27:28.490260+0000","last_clean":"2024-09-10T15:27:28.490260+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:27:28.490260+0000","last_undegraded":"2024-09-10T15:27:28.490260+0000","last_fullsized":"2024-09-10T15:27:28.490260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697170+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:28.697170+0000","last_peered":"2024-09-10T15:27:28.697170+0000","last_clean":"2024-09-10T15:27:28.697170+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:28.697170+0000","last_undegraded":"2024-09-10T15:27:28.697170+0000","last_fullsized":"2024-09-10T15:27:28.697170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947192+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:27:28.947192+0000","last_peered":"2024-09-10T15:27:28.947192+0000","last_clean":"2024-09-10T15:27:28.947192+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:27:28.947192+0000","last_undegraded":"2024-09-10T15:27:28.947192+0000","last_fullsized":"2024-09-10T15:27:28.947192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"76'13","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333357+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:27:28.333357+0000","last_peered":"2024-09-10T15:27:28.333357+0000","last_clean":"2024-09-10T15:27:28.333357+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:27:28.333357+0000","last_undegraded":"2024-09-10T15:27:28.333357+0000","last_fullsized":"2024-09-10T15:27:28.333357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":34,"num_write":18,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414746+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:27:28.414746+0000","last_peered":"2024-09-10T15:27:28.414746+0000","last_clean":"2024-09-10T15:27:28.414746+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:27:28.414746+0000","last_undegraded":"2024-09-10T15:27:28.414746+0000","last_fullsized":"2024-09-10T15:27:28.414746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415981+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:28.415981+0000","last_peered":"2024-09-10T15:27:28.415981+0000","last_clean":"2024-09-10T15:27:28.415981+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:28.415981+0000","last_undegraded":"2024-09-10T15:27:28.415981+0000","last_fullsized":"2024-09-10T15:27:28.415981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:27:28.340248+0000","last_peered":"2024-09-10T15:27:28.340248+0000","last_clean":"2024-09-10T15:27:28.340248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:27:28.340248+0000","last_undegraded":"2024-09-10T15:27:28.340248+0000","last_fullsized":"2024-09-10T15:27:28.340248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697494+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:28.697494+0000","last_peered":"2024-09-10T15:27:28.697494+0000","last_clean":"2024-09-10T15:27:28.697494+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:28.697494+0000","last_undegraded":"2024-09-10T15:27:28.697494+0000","last_fullsized":"2024-09-10T15:27:28.697494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313217+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:27:28.313217+0000","last_peered":"2024-09-10T15:27:28.313217+0000","last_clean":"2024-09-10T15:27:28.313217+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:27:28.313217+0000","last_undegraded":"2024-09-10T15:27:28.313217+0000","last_fullsized":"2024-09-10T15:27:28.313217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"76'13","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414966+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:27:28.414966+0000","last_peered":"2024-09-10T15:27:28.414966+0000","last_clean":"2024-09-10T15:27:28.414966+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:27:28.414966+0000","last_undegraded":"2024-09-10T15:27:28.414966+0000","last_fullsized":"2024-09-10T15:27:28.414966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314980+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:28.314980+0000","last_peered":"2024-09-10T15:27:28.314980+0000","last_clean":"2024-09-10T15:27:28.314980+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:28.314980+0000","last_undegraded":"2024-09-10T15:27:28.314980+0000","last_fullsized":"2024-09-10T15:27:28.314980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315593+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:28.315593+0000","last_peered":"2024-09-10T15:27:28.315593+0000","last_clean":"2024-09-10T15:27:28.315593+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:28.315593+0000","last_undegraded":"2024-09-10T15:27:28.315593+0000","last_fullsized":"2024-09-10T15:27:28.315593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315999+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:27:28.315999+0000","last_peered":"2024-09-10T15:27:28.315999+0000","last_clean":"2024-09-10T15:27:28.315999+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:27:28.315999+0000","last_undegraded":"2024-09-10T15:27:28.315999+0000","last_fullsized":"2024-09-10T15:27:28.315999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340407+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:27:28.340407+0000","last_peered":"2024-09-10T15:27:28.340407+0000","last_clean":"2024-09-10T15:27:28.340407+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:27:28.340407+0000","last_undegraded":"2024-09-10T15:27:28.340407+0000","last_fullsized":"2024-09-10T15:27:28.340407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492828+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:27:28.492828+0000","last_peered":"2024-09-10T15:27:28.492828+0000","last_clean":"2024-09-10T15:27:28.492828+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:27:28.492828+0000","last_undegraded":"2024-09-10T15:27:28.492828+0000","last_fullsized":"2024-09-10T15:27:28.492828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"63'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489564+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:27:28.489564+0000","last_peered":"2024-09-10T15:27:28.489564+0000","last_clean":"2024-09-10T15:27:28.489564+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:27:28.489564+0000","last_undegraded":"2024-09-10T15:27:28.489564+0000","last_fullsized":"2024-09-10T15:27:28.489564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416056+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416056+0000","last_peered":"2024-09-10T15:27:28.416056+0000","last_clean":"2024-09-10T15:27:28.416056+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416056+0000","last_undegraded":"2024-09-10T15:27:28.416056+0000","last_fullsized":"2024-09-10T15:27:28.416056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415413+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:28.415413+0000","last_peered":"2024-09-10T15:27:28.415413+0000","last_clean":"2024-09-10T15:27:28.415413+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:28.415413+0000","last_undegraded":"2024-09-10T15:27:28.415413+0000","last_fullsized":"2024-09-10T15:27:28.415413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696973+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:27:28.696973+0000","last_peered":"2024-09-10T15:27:28.696973+0000","last_clean":"2024-09-10T15:27:28.696973+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:27:28.696973+0000","last_undegraded":"2024-09-10T15:27:28.696973+0000","last_fullsized":"2024-09-10T15:27:28.696973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696532+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:28.696532+0000","last_peered":"2024-09-10T15:27:28.696532+0000","last_clean":"2024-09-10T15:27:28.696532+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:28.696532+0000","last_undegraded":"2024-09-10T15:27:28.696532+0000","last_fullsized":"2024-09-10T15:27:28.696532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":51212,"num_write":35,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695873+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:27:28.695873+0000","last_peered":"2024-09-10T15:27:28.695873+0000","last_clean":"2024-09-10T15:27:28.695873+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:27:28.695873+0000","last_undegraded":"2024-09-10T15:27:28.695873+0000","last_fullsized":"2024-09-10T15:27:28.695873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331251+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:27:28.331251+0000","last_peered":"2024-09-10T15:27:28.331251+0000","last_clean":"2024-09-10T15:27:28.331251+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:27:28.331251+0000","last_undegraded":"2024-09-10T15:27:28.331251+0000","last_fullsized":"2024-09-10T15:27:28.331251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314167+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:27:28.314167+0000","last_peered":"2024-09-10T15:27:28.314167+0000","last_clean":"2024-09-10T15:27:28.314167+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:27:28.314167+0000","last_undegraded":"2024-09-10T15:27:28.314167+0000","last_fullsized":"2024-09-10T15:27:28.314167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334348+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:27:28.334348+0000","last_peered":"2024-09-10T15:27:28.334348+0000","last_clean":"2024-09-10T15:27:28.334348+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:27:28.334348+0000","last_undegraded":"2024-09-10T15:27:28.334348+0000","last_fullsized":"2024-09-10T15:27:28.334348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332571+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:27:28.332571+0000","last_peered":"2024-09-10T15:27:28.332571+0000","last_clean":"2024-09-10T15:27:28.332571+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:27:28.332571+0000","last_undegraded":"2024-09-10T15:27:28.332571+0000","last_fullsized":"2024-09-10T15:27:28.332571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341835+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:27:28.341835+0000","last_peered":"2024-09-10T15:27:28.341835+0000","last_clean":"2024-09-10T15:27:28.341835+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:27:28.341835+0000","last_undegraded":"2024-09-10T15:27:28.341835+0000","last_fullsized":"2024-09-10T15:27:28.341835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947641+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:27:28.947641+0000","last_peered":"2024-09-10T15:27:28.947641+0000","last_clean":"2024-09-10T15:27:28.947641+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:27:28.947641+0000","last_undegraded":"2024-09-10T15:27:28.947641+0000","last_fullsized":"2024-09-10T15:27:28.947641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697192+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:27:28.697192+0000","last_peered":"2024-09-10T15:27:28.697192+0000","last_clean":"2024-09-10T15:27:28.697192+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:27:28.697192+0000","last_undegraded":"2024-09-10T15:27:28.697192+0000","last_fullsized":"2024-09-10T15:27:28.697192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28684,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493197+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:28.493197+0000","last_peered":"2024-09-10T15:27:28.493197+0000","last_clean":"2024-09-10T15:27:28.493197+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:28.493197+0000","last_undegraded":"2024-09-10T15:27:28.493197+0000","last_fullsized":"2024-09-10T15:27:28.493197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"76'9","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415276+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:27:28.415276+0000","last_peered":"2024-09-10T15:27:28.415276+0000","last_clean":"2024-09-10T15:27:28.415276+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:27:28.415276+0000","last_undegraded":"2024-09-10T15:27:28.415276+0000","last_fullsized":"2024-09-10T15:27:28.415276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315776+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:27:28.315776+0000","last_peered":"2024-09-10T15:27:28.315776+0000","last_clean":"2024-09-10T15:27:28.315776+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:27:28.315776+0000","last_undegraded":"2024-09-10T15:27:28.315776+0000","last_fullsized":"2024-09-10T15:27:28.315776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"69'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694776+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:28.694776+0000","last_peered":"2024-09-10T15:27:28.694776+0000","last_clean":"2024-09-10T15:27:28.694776+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:28.694776+0000","last_undegraded":"2024-09-10T15:27:28.694776+0000","last_fullsized":"2024-09-10T15:27:28.694776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696443+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:27:28.696443+0000","last_peered":"2024-09-10T15:27:28.696443+0000","last_clean":"2024-09-10T15:27:28.696443+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:27:28.696443+0000","last_undegraded":"2024-09-10T15:27:28.696443+0000","last_fullsized":"2024-09-10T15:27:28.696443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"76'7","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947713+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:27:28.947713+0000","last_peered":"2024-09-10T15:27:28.947713+0000","last_clean":"2024-09-10T15:27:28.947713+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:27:28.947713+0000","last_undegraded":"2024-09-10T15:27:28.947713+0000","last_fullsized":"2024-09-10T15:27:28.947713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18438,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947692+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.947692+0000","last_peered":"2024-09-10T15:27:28.947692+0000","last_clean":"2024-09-10T15:27:28.947692+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:27:28.947692+0000","last_undegraded":"2024-09-10T15:27:28.947692+0000","last_fullsized":"2024-09-10T15:27:28.947692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315424+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:28.315424+0000","last_peered":"2024-09-10T15:27:28.315424+0000","last_clean":"2024-09-10T15:27:28.315424+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:28.315424+0000","last_undegraded":"2024-09-10T15:27:28.315424+0000","last_fullsized":"2024-09-10T15:27:28.315424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":20,"num_read_kb":53254,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947595+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:27:28.947595+0000","last_peered":"2024-09-10T15:27:28.947595+0000","last_clean":"2024-09-10T15:27:28.947595+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:27:28.947595+0000","last_undegraded":"2024-09-10T15:27:28.947595+0000","last_fullsized":"2024-09-10T15:27:28.947595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315275+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:27:28.315275+0000","last_peered":"2024-09-10T15:27:28.315275+0000","last_clean":"2024-09-10T15:27:28.315275+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:27:28.315275+0000","last_undegraded":"2024-09-10T15:27:28.315275+0000","last_fullsized":"2024-09-10T15:27:28.315275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490207+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490207+0000","last_peered":"2024-09-10T15:27:28.490207+0000","last_clean":"2024-09-10T15:27:28.490207+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490207+0000","last_undegraded":"2024-09-10T15:27:28.490207+0000","last_fullsized":"2024-09-10T15:27:28.490207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414460+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:28.414460+0000","last_peered":"2024-09-10T15:27:28.414460+0000","last_clean":"2024-09-10T15:27:28.414460+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:28.414460+0000","last_undegraded":"2024-09-10T15:27:28.414460+0000","last_fullsized":"2024-09-10T15:27:28.414460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":18,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313708+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:27:28.313708+0000","last_peered":"2024-09-10T15:27:28.313708+0000","last_clean":"2024-09-10T15:27:28.313708+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:27:28.313708+0000","last_undegraded":"2024-09-10T15:27:28.313708+0000","last_fullsized":"2024-09-10T15:27:28.313708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"70'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493135+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:27:28.493135+0000","last_peered":"2024-09-10T15:27:28.493135+0000","last_clean":"2024-09-10T15:27:28.493135+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:27:28.493135+0000","last_undegraded":"2024-09-10T15:27:28.493135+0000","last_fullsized":"2024-09-10T15:27:28.493135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947471+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:27:28.947471+0000","last_peered":"2024-09-10T15:27:28.947471+0000","last_clean":"2024-09-10T15:27:28.947471+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:27:28.947471+0000","last_undegraded":"2024-09-10T15:27:28.947471+0000","last_fullsized":"2024-09-10T15:27:28.947471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'15","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414535+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:28.414535+0000","last_peered":"2024-09-10T15:27:28.414535+0000","last_clean":"2024-09-10T15:27:28.414535+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:28.414535+0000","last_undegraded":"2024-09-10T15:27:28.414535+0000","last_fullsized":"2024-09-10T15:27:28.414535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"70'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415329+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:28.415329+0000","last_peered":"2024-09-10T15:27:28.415329+0000","last_clean":"2024-09-10T15:27:28.415329+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:28.415329+0000","last_undegraded":"2024-09-10T15:27:28.415329+0000","last_fullsized":"2024-09-10T15:27:28.415329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315903+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:27:28.315903+0000","last_peered":"2024-09-10T15:27:28.315903+0000","last_clean":"2024-09-10T15:27:28.315903+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:27:28.315903+0000","last_undegraded":"2024-09-10T15:27:28.315903+0000","last_fullsized":"2024-09-10T15:27:28.315903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"71'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693432+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:28.693432+0000","last_peered":"2024-09-10T15:27:28.693432+0000","last_clean":"2024-09-10T15:27:28.693432+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:28.693432+0000","last_undegraded":"2024-09-10T15:27:28.693432+0000","last_fullsized":"2024-09-10T15:27:28.693432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948407+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:27:28.948407+0000","last_peered":"2024-09-10T15:27:28.948407+0000","last_clean":"2024-09-10T15:27:28.948407+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:27:28.948407+0000","last_undegraded":"2024-09-10T15:27:28.948407+0000","last_fullsized":"2024-09-10T15:27:28.948407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238917,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":923,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":271500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":278016000,"data_stored":277481932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405092,"kb_used_data":373904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93966748,"statfs":{"total":96636764160,"available":96221949952,"internally_reserved":0,"allocated":382877696,"data_stored":382332157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434344,"kb_used_data":403160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93937496,"statfs":{"total":96636764160,"available":96191995904,"internally_reserved":0,"allocated":412835840,"data_stored":412291291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370288,"kb_used_data":339104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94001552,"statfs":{"total":96636764160,"available":96257589248,"internally_reserved":0,"allocated":347242496,"data_stored":346695811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":509528,"kb_used_data":478340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93862312,"statfs":{"total":96636764160,"available":96115007488,"internally_reserved":0,"allocated":489820160,"data_stored":489288012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501308,"kb_used_data":470120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93870532,"statfs":{"total":96636764160,"available":96123424768,"internally_reserved":0,"allocated":481402880,"data_stored":480896228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356560,"kb_used_data":325376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94015280,"statfs":{"total":96636764160,"available":96271646720,"internally_reserved":0,"allocated":333185024,"data_stored":332610464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575112,"kb_used_data":543928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93796728,"statfs":{"total":96636764160,"available":96047849472,"internally_reserved":0,"allocated":556982272,"data_stored":556408695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":555745280,"data_stored":555745280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":346030080,"data_stored":346030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":35596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":30035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":28726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:28:00.276 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T15:28:00.276 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:28:00.620 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:28:00.626 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:28:00.643 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-10T15:27:58.981539+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609477,"num_objects":639,"num_object_clones":0,"num_object_copies":1278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":639,"num_whiteouts":0,"num_read":3875,"num_read_kb":2050994,"num_write":3330,"num_write_kb":2051084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1991,"ondisk_log_size":1991,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3454916,"kb_used_data":3205432,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":751519804,"statfs":{"total":773094113280,"available":769556279296,"internally_reserved":0,"allocated":3282362368,"data_stored":3278004590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006099"},"pg_stats":[{"pgid":"3.3f","version":"76'7","reported_seq":110,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492571+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:28.492571+0000","last_peered":"2024-09-10T15:27:28.492571+0000","last_clean":"2024-09-10T15:27:28.492571+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:28.492571+0000","last_undegraded":"2024-09-10T15:27:28.492571+0000","last_fullsized":"2024-09-10T15:27:28.492571+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:35.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":22534,"num_write":17,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947463+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:28.947463+0000","last_peered":"2024-09-10T15:27:28.947463+0000","last_clean":"2024-09-10T15:27:28.947463+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:28.947463+0000","last_undegraded":"2024-09-10T15:27:28.947463+0000","last_fullsized":"2024-09-10T15:27:28.947463+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696971+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:27:28.696971+0000","last_peered":"2024-09-10T15:27:28.696971+0000","last_clean":"2024-09-10T15:27:28.696971+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:27:28.696971+0000","last_undegraded":"2024-09-10T15:27:28.696971+0000","last_fullsized":"2024-09-10T15:27:28.696971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415253+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:28.415253+0000","last_peered":"2024-09-10T15:27:28.415253+0000","last_clean":"2024-09-10T15:27:28.415253+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:28.415253+0000","last_undegraded":"2024-09-10T15:27:28.415253+0000","last_fullsized":"2024-09-10T15:27:28.415253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"76'16","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693506+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:28.693506+0000","last_peered":"2024-09-10T15:27:28.693506+0000","last_clean":"2024-09-10T15:27:28.693506+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:28.693506+0000","last_undegraded":"2024-09-10T15:27:28.693506+0000","last_fullsized":"2024-09-10T15:27:28.693506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":45080,"num_write":56,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415252+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:27:28.415252+0000","last_peered":"2024-09-10T15:27:28.415252+0000","last_clean":"2024-09-10T15:27:28.415252+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:27:28.415252+0000","last_undegraded":"2024-09-10T15:27:28.415252+0000","last_fullsized":"2024-09-10T15:27:28.415252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"71'2","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315716+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:27:28.315716+0000","last_peered":"2024-09-10T15:27:28.315716+0000","last_clean":"2024-09-10T15:27:28.315716+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:27:28.315716+0000","last_undegraded":"2024-09-10T15:27:28.315716+0000","last_fullsized":"2024-09-10T15:27:28.315716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"76'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314620+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:27:28.314620+0000","last_peered":"2024-09-10T15:27:28.314620+0000","last_clean":"2024-09-10T15:27:28.314620+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:27:28.314620+0000","last_undegraded":"2024-09-10T15:27:28.314620+0000","last_fullsized":"2024-09-10T15:27:28.314620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":45074,"num_write":45,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314283+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:27:28.314283+0000","last_peered":"2024-09-10T15:27:28.314283+0000","last_clean":"2024-09-10T15:27:28.314283+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:27:28.314283+0000","last_undegraded":"2024-09-10T15:27:28.314283+0000","last_fullsized":"2024-09-10T15:27:28.314283+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339888+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:27:28.339888+0000","last_peered":"2024-09-10T15:27:28.339888+0000","last_clean":"2024-09-10T15:27:28.339888+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:27:28.339888+0000","last_undegraded":"2024-09-10T15:27:28.339888+0000","last_fullsized":"2024-09-10T15:27:28.339888+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315735+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:27:28.315735+0000","last_peered":"2024-09-10T15:27:28.315735+0000","last_clean":"2024-09-10T15:27:28.315735+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:27:28.315735+0000","last_undegraded":"2024-09-10T15:27:28.315735+0000","last_fullsized":"2024-09-10T15:27:28.315735+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"76'8","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314811+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:27:28.314811+0000","last_peered":"2024-09-10T15:27:28.314811+0000","last_clean":"2024-09-10T15:27:28.314811+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:27:28.314811+0000","last_undegraded":"2024-09-10T15:27:28.314811+0000","last_fullsized":"2024-09-10T15:27:28.314811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24588,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341680+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:27:28.341680+0000","last_peered":"2024-09-10T15:27:28.341680+0000","last_clean":"2024-09-10T15:27:28.341680+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:27:28.341680+0000","last_undegraded":"2024-09-10T15:27:28.341680+0000","last_fullsized":"2024-09-10T15:27:28.341680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"76'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693325+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:28.693325+0000","last_peered":"2024-09-10T15:27:28.693325+0000","last_clean":"2024-09-10T15:27:28.693325+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:28.693325+0000","last_undegraded":"2024-09-10T15:27:28.693325+0000","last_fullsized":"2024-09-10T15:27:28.693325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32786,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697665+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:27:28.697665+0000","last_peered":"2024-09-10T15:27:28.697665+0000","last_clean":"2024-09-10T15:27:28.697665+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:27:28.697665+0000","last_undegraded":"2024-09-10T15:27:28.697665+0000","last_fullsized":"2024-09-10T15:27:28.697665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415085+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:28.415085+0000","last_peered":"2024-09-10T15:27:28.415085+0000","last_clean":"2024-09-10T15:27:28.415085+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:28.415085+0000","last_undegraded":"2024-09-10T15:27:28.415085+0000","last_fullsized":"2024-09-10T15:27:28.415085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"76'10","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948605+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:27:28.948605+0000","last_peered":"2024-09-10T15:27:28.948605+0000","last_clean":"2024-09-10T15:27:28.948605+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:27:28.948605+0000","last_undegraded":"2024-09-10T15:27:28.948605+0000","last_fullsized":"2024-09-10T15:27:28.948605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314573+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:27:28.314573+0000","last_peered":"2024-09-10T15:27:28.314573+0000","last_clean":"2024-09-10T15:27:28.314573+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:27:28.314573+0000","last_undegraded":"2024-09-10T15:27:28.314573+0000","last_fullsized":"2024-09-10T15:27:28.314573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"76'11","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315801+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:27:28.315801+0000","last_peered":"2024-09-10T15:27:28.315801+0000","last_clean":"2024-09-10T15:27:28.315801+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:27:28.315801+0000","last_undegraded":"2024-09-10T15:27:28.315801+0000","last_fullsized":"2024-09-10T15:27:28.315801+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":32786,"num_write":41,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948029+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:27:28.948029+0000","last_peered":"2024-09-10T15:27:28.948029+0000","last_clean":"2024-09-10T15:27:28.948029+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:27:28.948029+0000","last_undegraded":"2024-09-10T15:27:28.948029+0000","last_fullsized":"2024-09-10T15:27:28.948029+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"70'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316211+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:27:28.316211+0000","last_peered":"2024-09-10T15:27:28.316211+0000","last_clean":"2024-09-10T15:27:28.316211+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:27:28.316211+0000","last_undegraded":"2024-09-10T15:27:28.316211+0000","last_fullsized":"2024-09-10T15:27:28.316211+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":34816,"num_write":10,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333429+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:27:28.333429+0000","last_peered":"2024-09-10T15:27:28.333429+0000","last_clean":"2024-09-10T15:27:28.333429+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:27:28.333429+0000","last_undegraded":"2024-09-10T15:27:28.333429+0000","last_fullsized":"2024-09-10T15:27:28.333429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315085+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:27:28.315085+0000","last_peered":"2024-09-10T15:27:28.315085+0000","last_clean":"2024-09-10T15:27:28.315085+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:27:28.315085+0000","last_undegraded":"2024-09-10T15:27:28.315085+0000","last_fullsized":"2024-09-10T15:27:28.315085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40972,"num_write":33,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695686+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:27:28.695686+0000","last_peered":"2024-09-10T15:27:28.695686+0000","last_clean":"2024-09-10T15:27:28.695686+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:27:28.695686+0000","last_undegraded":"2024-09-10T15:27:28.695686+0000","last_fullsized":"2024-09-10T15:27:28.695686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331520+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:27:28.331520+0000","last_peered":"2024-09-10T15:27:28.331520+0000","last_clean":"2024-09-10T15:27:28.331520+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:27:28.331520+0000","last_undegraded":"2024-09-10T15:27:28.331520+0000","last_fullsized":"2024-09-10T15:27:28.331520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948065+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:28.948065+0000","last_peered":"2024-09-10T15:27:28.948065+0000","last_clean":"2024-09-10T15:27:28.948065+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:28.948065+0000","last_undegraded":"2024-09-10T15:27:28.948065+0000","last_fullsized":"2024-09-10T15:27:28.948065+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"76'12","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313280+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:27:28.313280+0000","last_peered":"2024-09-10T15:27:28.313280+0000","last_clean":"2024-09-10T15:27:28.313280+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:27:28.313280+0000","last_undegraded":"2024-09-10T15:27:28.313280+0000","last_fullsized":"2024-09-10T15:27:28.313280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:32:57.270022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313061+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:28.313061+0000","last_peered":"2024-09-10T15:27:28.313061+0000","last_clean":"2024-09-10T15:27:28.313061+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:28.313061+0000","last_undegraded":"2024-09-10T15:27:28.313061+0000","last_fullsized":"2024-09-10T15:27:28.313061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333852+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:27:28.333852+0000","last_peered":"2024-09-10T15:27:28.333852+0000","last_clean":"2024-09-10T15:27:28.333852+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:27:28.333852+0000","last_undegraded":"2024-09-10T15:27:28.333852+0000","last_fullsized":"2024-09-10T15:27:28.333852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"76'12","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414504+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:28.414504+0000","last_peered":"2024-09-10T15:27:28.414504+0000","last_clean":"2024-09-10T15:27:28.414504+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:28.414504+0000","last_undegraded":"2024-09-10T15:27:28.414504+0000","last_fullsized":"2024-09-10T15:27:28.414504+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":16,"num_read_kb":40966,"num_write":22,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416694+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:27:28.416694+0000","last_peered":"2024-09-10T15:27:28.416694+0000","last_clean":"2024-09-10T15:27:28.416694+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:27:28.416694+0000","last_undegraded":"2024-09-10T15:27:28.416694+0000","last_fullsized":"2024-09-10T15:27:28.416694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"76'19","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315429+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:27:28.315429+0000","last_peered":"2024-09-10T15:27:28.315429+0000","last_clean":"2024-09-10T15:27:28.315429+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:27:28.315429+0000","last_undegraded":"2024-09-10T15:27:28.315429+0000","last_fullsized":"2024-09-10T15:27:28.315429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8547,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":33,"num_read_kb":48,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948332+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:28.948332+0000","last_peered":"2024-09-10T15:27:28.948332+0000","last_clean":"2024-09-10T15:27:28.948332+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:28.948332+0000","last_undegraded":"2024-09-10T15:27:28.948332+0000","last_fullsized":"2024-09-10T15:27:28.948332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:38.527211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947162+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:28.947162+0000","last_peered":"2024-09-10T15:27:28.947162+0000","last_clean":"2024-09-10T15:27:28.947162+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:28.947162+0000","last_undegraded":"2024-09-10T15:27:28.947162+0000","last_fullsized":"2024-09-10T15:27:28.947162+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:06.458475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416344+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:28.416344+0000","last_peered":"2024-09-10T15:27:28.416344+0000","last_clean":"2024-09-10T15:27:28.416344+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:28.416344+0000","last_undegraded":"2024-09-10T15:27:28.416344+0000","last_fullsized":"2024-09-10T15:27:28.416344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"71'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333128+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:27:28.333128+0000","last_peered":"2024-09-10T15:27:28.333128+0000","last_clean":"2024-09-10T15:27:28.333128+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:27:28.333128+0000","last_undegraded":"2024-09-10T15:27:28.333128+0000","last_fullsized":"2024-09-10T15:27:28.333128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314735+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:27:28.314735+0000","last_peered":"2024-09-10T15:27:28.314735+0000","last_clean":"2024-09-10T15:27:28.314735+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:27:28.314735+0000","last_undegraded":"2024-09-10T15:27:28.314735+0000","last_fullsized":"2024-09-10T15:27:28.314735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948359+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:27:28.948359+0000","last_peered":"2024-09-10T15:27:28.948359+0000","last_clean":"2024-09-10T15:27:28.948359+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:27:28.948359+0000","last_undegraded":"2024-09-10T15:27:28.948359+0000","last_fullsized":"2024-09-10T15:27:28.948359+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948242+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:28.948242+0000","last_peered":"2024-09-10T15:27:28.948242+0000","last_clean":"2024-09-10T15:27:28.948242+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:28.948242+0000","last_undegraded":"2024-09-10T15:27:28.948242+0000","last_fullsized":"2024-09-10T15:27:28.948242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:45:04.442630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331754+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:28.331754+0000","last_peered":"2024-09-10T15:27:28.331754+0000","last_clean":"2024-09-10T15:27:28.331754+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:28.331754+0000","last_undegraded":"2024-09-10T15:27:28.331754+0000","last_fullsized":"2024-09-10T15:27:28.331754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696836+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:27:28.696836+0000","last_peered":"2024-09-10T15:27:28.696836+0000","last_clean":"2024-09-10T15:27:28.696836+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:27:28.696836+0000","last_undegraded":"2024-09-10T15:27:28.696836+0000","last_fullsized":"2024-09-10T15:27:28.696836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415399+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:28.415399+0000","last_peered":"2024-09-10T15:27:28.415399+0000","last_clean":"2024-09-10T15:27:28.415399+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:28.415399+0000","last_undegraded":"2024-09-10T15:27:28.415399+0000","last_fullsized":"2024-09-10T15:27:28.415399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315726+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:28.315726+0000","last_peered":"2024-09-10T15:27:28.315726+0000","last_clean":"2024-09-10T15:27:28.315726+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:28.315726+0000","last_undegraded":"2024-09-10T15:27:28.315726+0000","last_fullsized":"2024-09-10T15:27:28.315726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314442+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:28.314442+0000","last_peered":"2024-09-10T15:27:28.314442+0000","last_clean":"2024-09-10T15:27:28.314442+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:28.314442+0000","last_undegraded":"2024-09-10T15:27:28.314442+0000","last_fullsized":"2024-09-10T15:27:28.314442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'15","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.073313+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:27:34.073313+0000","last_peered":"2024-09-10T15:27:34.073313+0000","last_clean":"2024-09-10T15:27:34.073313+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:27:34.073313+0000","last_undegraded":"2024-09-10T15:27:34.073313+0000","last_fullsized":"2024-09-10T15:27:34.073313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340622+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:28.340622+0000","last_peered":"2024-09-10T15:27:28.340622+0000","last_clean":"2024-09-10T15:27:28.340622+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:28.340622+0000","last_undegraded":"2024-09-10T15:27:28.340622+0000","last_fullsized":"2024-09-10T15:27:28.340622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696983+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:27:28.696983+0000","last_peered":"2024-09-10T15:27:28.696983+0000","last_clean":"2024-09-10T15:27:28.696983+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:27:28.696983+0000","last_undegraded":"2024-09-10T15:27:28.696983+0000","last_fullsized":"2024-09-10T15:27:28.696983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"76'8","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947752+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:28.947752+0000","last_peered":"2024-09-10T15:27:28.947752+0000","last_clean":"2024-09-10T15:27:28.947752+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:28.947752+0000","last_undegraded":"2024-09-10T15:27:28.947752+0000","last_fullsized":"2024-09-10T15:27:28.947752+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20492,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416291+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:27:28.416291+0000","last_peered":"2024-09-10T15:27:28.416291+0000","last_clean":"2024-09-10T15:27:28.416291+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:27:28.416291+0000","last_undegraded":"2024-09-10T15:27:28.416291+0000","last_fullsized":"2024-09-10T15:27:28.416291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"76'18","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341435+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:27:28.341435+0000","last_peered":"2024-09-10T15:27:28.341435+0000","last_clean":"2024-09-10T15:27:28.341435+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:27:28.341435+0000","last_undegraded":"2024-09-10T15:27:28.341435+0000","last_fullsized":"2024-09-10T15:27:28.341435+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13037,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":31,"num_read_kb":43,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.084063+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:27:34.084063+0000","last_peered":"2024-09-10T15:27:34.084063+0000","last_clean":"2024-09-10T15:27:34.084063+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:27:34.084063+0000","last_undegraded":"2024-09-10T15:27:34.084063+0000","last_fullsized":"2024-09-10T15:27:34.084063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415061+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415061+0000","last_peered":"2024-09-10T15:27:28.415061+0000","last_clean":"2024-09-10T15:27:28.415061+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415061+0000","last_undegraded":"2024-09-10T15:27:28.415061+0000","last_fullsized":"2024-09-10T15:27:28.415061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"76'7","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316110+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:27:28.316110+0000","last_peered":"2024-09-10T15:27:28.316110+0000","last_clean":"2024-09-10T15:27:28.316110+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:27:28.316110+0000","last_undegraded":"2024-09-10T15:27:28.316110+0000","last_fullsized":"2024-09-10T15:27:28.316110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":16396,"num_write":27,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947301+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:27:28.947301+0000","last_peered":"2024-09-10T15:27:28.947301+0000","last_clean":"2024-09-10T15:27:28.947301+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:27:28.947301+0000","last_undegraded":"2024-09-10T15:27:28.947301+0000","last_fullsized":"2024-09-10T15:27:28.947301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"76'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313995+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:28.313995+0000","last_peered":"2024-09-10T15:27:28.313995+0000","last_clean":"2024-09-10T15:27:28.313995+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:28.313995+0000","last_undegraded":"2024-09-10T15:27:28.313995+0000","last_fullsized":"2024-09-10T15:27:28.313995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":36,"num_read_kb":28,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332970+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:28.332970+0000","last_peered":"2024-09-10T15:27:28.332970+0000","last_clean":"2024-09-10T15:27:28.332970+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:28.332970+0000","last_undegraded":"2024-09-10T15:27:28.332970+0000","last_fullsized":"2024-09-10T15:27:28.332970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341427+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341427+0000","last_peered":"2024-09-10T15:27:28.341427+0000","last_clean":"2024-09-10T15:27:28.341427+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341427+0000","last_undegraded":"2024-09-10T15:27:28.341427+0000","last_fullsized":"2024-09-10T15:27:28.341427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947386+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:27:28.947386+0000","last_peered":"2024-09-10T15:27:28.947386+0000","last_clean":"2024-09-10T15:27:28.947386+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:27:28.947386+0000","last_undegraded":"2024-09-10T15:27:28.947386+0000","last_fullsized":"2024-09-10T15:27:28.947386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339988+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:27:28.339988+0000","last_peered":"2024-09-10T15:27:28.339988+0000","last_clean":"2024-09-10T15:27:28.339988+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:27:28.339988+0000","last_undegraded":"2024-09-10T15:27:28.339988+0000","last_fullsized":"2024-09-10T15:27:28.339988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":32786,"num_write":43,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331759+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:27:28.331759+0000","last_peered":"2024-09-10T15:27:28.331759+0000","last_clean":"2024-09-10T15:27:28.331759+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:27:28.331759+0000","last_undegraded":"2024-09-10T15:27:28.331759+0000","last_fullsized":"2024-09-10T15:27:28.331759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314343+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:27:28.314343+0000","last_peered":"2024-09-10T15:27:28.314343+0000","last_clean":"2024-09-10T15:27:28.314343+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:27:28.314343+0000","last_undegraded":"2024-09-10T15:27:28.314343+0000","last_fullsized":"2024-09-10T15:27:28.314343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11367,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313553+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:28.313553+0000","last_peered":"2024-09-10T15:27:28.313553+0000","last_clean":"2024-09-10T15:27:28.313553+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:28.313553+0000","last_undegraded":"2024-09-10T15:27:28.313553+0000","last_fullsized":"2024-09-10T15:27:28.313553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947771+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947771+0000","last_peered":"2024-09-10T15:27:28.947771+0000","last_clean":"2024-09-10T15:27:28.947771+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947771+0000","last_undegraded":"2024-09-10T15:27:28.947771+0000","last_fullsized":"2024-09-10T15:27:28.947771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:45.062692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340664+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:27:28.340664+0000","last_peered":"2024-09-10T15:27:28.340664+0000","last_clean":"2024-09-10T15:27:28.340664+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:27:28.340664+0000","last_undegraded":"2024-09-10T15:27:28.340664+0000","last_fullsized":"2024-09-10T15:27:28.340664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"69'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416098+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:28.416098+0000","last_peered":"2024-09-10T15:27:28.416098+0000","last_clean":"2024-09-10T15:27:28.416098+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:28.416098+0000","last_undegraded":"2024-09-10T15:27:28.416098+0000","last_fullsized":"2024-09-10T15:27:28.416098+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":7,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695255+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:28.695255+0000","last_peered":"2024-09-10T15:27:28.695255+0000","last_clean":"2024-09-10T15:27:28.695255+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:28.695255+0000","last_undegraded":"2024-09-10T15:27:28.695255+0000","last_fullsized":"2024-09-10T15:27:28.695255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"76'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414864+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:27:28.414864+0000","last_peered":"2024-09-10T15:27:28.414864+0000","last_clean":"2024-09-10T15:27:28.414864+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:27:28.414864+0000","last_undegraded":"2024-09-10T15:27:28.414864+0000","last_fullsized":"2024-09-10T15:27:28.414864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":39,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'15","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.195021+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:27:33.195021+0000","last_peered":"2024-09-10T15:27:33.195021+0000","last_clean":"2024-09-10T15:27:33.195021+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:27:33.195021+0000","last_undegraded":"2024-09-10T15:27:33.195021+0000","last_fullsized":"2024-09-10T15:27:33.195021+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334472+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:28.334472+0000","last_peered":"2024-09-10T15:27:28.334472+0000","last_clean":"2024-09-10T15:27:28.334472+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:28.334472+0000","last_undegraded":"2024-09-10T15:27:28.334472+0000","last_fullsized":"2024-09-10T15:27:28.334472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696128+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:27:28.696128+0000","last_peered":"2024-09-10T15:27:28.696128+0000","last_clean":"2024-09-10T15:27:28.696128+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:27:28.696128+0000","last_undegraded":"2024-09-10T15:27:28.696128+0000","last_fullsized":"2024-09-10T15:27:28.696128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"75'12","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315573+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:27:28.315573+0000","last_peered":"2024-09-10T15:27:28.315573+0000","last_clean":"2024-09-10T15:27:28.315573+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:27:28.315573+0000","last_undegraded":"2024-09-10T15:27:28.315573+0000","last_fullsized":"2024-09-10T15:27:28.315573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332058+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:27:28.332058+0000","last_peered":"2024-09-10T15:27:28.332058+0000","last_clean":"2024-09-10T15:27:28.332058+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:27:28.332058+0000","last_undegraded":"2024-09-10T15:27:28.332058+0000","last_fullsized":"2024-09-10T15:27:28.332058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"76'25","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.312917+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:27:28.312917+0000","last_peered":"2024-09-10T15:27:28.312917+0000","last_clean":"2024-09-10T15:27:28.312917+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:27:28.312917+0000","last_undegraded":"2024-09-10T15:27:28.312917+0000","last_fullsized":"2024-09-10T15:27:28.312917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18247,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":43,"num_read_kb":55,"num_write":32,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694615+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:27:28.694615+0000","last_peered":"2024-09-10T15:27:28.694615+0000","last_clean":"2024-09-10T15:27:28.694615+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:27:28.694615+0000","last_undegraded":"2024-09-10T15:27:28.694615+0000","last_fullsized":"2024-09-10T15:27:28.694615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492786+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:28.492786+0000","last_peered":"2024-09-10T15:27:28.492786+0000","last_clean":"2024-09-10T15:27:28.492786+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:28.492786+0000","last_undegraded":"2024-09-10T15:27:28.492786+0000","last_fullsized":"2024-09-10T15:27:28.492786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315251+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.315251+0000","last_peered":"2024-09-10T15:27:28.315251+0000","last_clean":"2024-09-10T15:27:28.315251+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:27:28.315251+0000","last_undegraded":"2024-09-10T15:27:28.315251+0000","last_fullsized":"2024-09-10T15:27:28.315251+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"76'14","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490986+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:27:28.490986+0000","last_peered":"2024-09-10T15:27:28.490986+0000","last_clean":"2024-09-10T15:27:28.490986+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:27:28.490986+0000","last_undegraded":"2024-09-10T15:27:28.490986+0000","last_fullsized":"2024-09-10T15:27:28.490986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":43026,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491267+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:27:28.491267+0000","last_peered":"2024-09-10T15:27:28.491267+0000","last_clean":"2024-09-10T15:27:28.491267+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:27:28.491267+0000","last_undegraded":"2024-09-10T15:27:28.491267+0000","last_fullsized":"2024-09-10T15:27:28.491267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"76'18","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948281+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:27:28.948281+0000","last_peered":"2024-09-10T15:27:28.948281+0000","last_clean":"2024-09-10T15:27:28.948281+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:27:28.948281+0000","last_undegraded":"2024-09-10T15:27:28.948281+0000","last_fullsized":"2024-09-10T15:27:28.948281+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":27,"num_write":22,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489636+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:28.489636+0000","last_peered":"2024-09-10T15:27:28.489636+0000","last_clean":"2024-09-10T15:27:28.489636+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:28.489636+0000","last_undegraded":"2024-09-10T15:27:28.489636+0000","last_fullsized":"2024-09-10T15:27:28.489636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693570+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693570+0000","last_peered":"2024-09-10T15:27:28.693570+0000","last_clean":"2024-09-10T15:27:28.693570+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693570+0000","last_undegraded":"2024-09-10T15:27:28.693570+0000","last_fullsized":"2024-09-10T15:27:28.693570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416540+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416540+0000","last_peered":"2024-09-10T15:27:28.416540+0000","last_clean":"2024-09-10T15:27:28.416540+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416540+0000","last_undegraded":"2024-09-10T15:27:28.416540+0000","last_fullsized":"2024-09-10T15:27:28.416540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"76'6","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415506+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:28.415506+0000","last_peered":"2024-09-10T15:27:28.415506+0000","last_clean":"2024-09-10T15:27:28.415506+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:28.415506+0000","last_undegraded":"2024-09-10T15:27:28.415506+0000","last_fullsized":"2024-09-10T15:27:28.415506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18438,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696187+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:28.696187+0000","last_peered":"2024-09-10T15:27:28.696187+0000","last_clean":"2024-09-10T15:27:28.696187+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:28.696187+0000","last_undegraded":"2024-09-10T15:27:28.696187+0000","last_fullsized":"2024-09-10T15:27:28.696187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"76'19","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696345+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:28.696345+0000","last_peered":"2024-09-10T15:27:28.696345+0000","last_clean":"2024-09-10T15:27:28.696345+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:28.696345+0000","last_undegraded":"2024-09-10T15:27:28.696345+0000","last_fullsized":"2024-09-10T15:27:28.696345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'15","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.075687+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:27:34.075687+0000","last_peered":"2024-09-10T15:27:34.075687+0000","last_clean":"2024-09-10T15:27:34.075687+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:27:34.075687+0000","last_undegraded":"2024-09-10T15:27:34.075687+0000","last_fullsized":"2024-09-10T15:27:34.075687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331612+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331612+0000","last_peered":"2024-09-10T15:27:28.331612+0000","last_clean":"2024-09-10T15:27:28.331612+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331612+0000","last_undegraded":"2024-09-10T15:27:28.331612+0000","last_fullsized":"2024-09-10T15:27:28.331612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341512+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341512+0000","last_peered":"2024-09-10T15:27:28.341512+0000","last_clean":"2024-09-10T15:27:28.341512+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341512+0000","last_undegraded":"2024-09-10T15:27:28.341512+0000","last_fullsized":"2024-09-10T15:27:28.341512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"71'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414253+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:28.414253+0000","last_peered":"2024-09-10T15:27:28.414253+0000","last_clean":"2024-09-10T15:27:28.414253+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:28.414253+0000","last_undegraded":"2024-09-10T15:27:28.414253+0000","last_fullsized":"2024-09-10T15:27:28.414253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948481+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:27:28.948481+0000","last_peered":"2024-09-10T15:27:28.948481+0000","last_clean":"2024-09-10T15:27:28.948481+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:27:28.948481+0000","last_undegraded":"2024-09-10T15:27:28.948481+0000","last_fullsized":"2024-09-10T15:27:28.948481+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333326+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:28.333326+0000","last_peered":"2024-09-10T15:27:28.333326+0000","last_clean":"2024-09-10T15:27:28.333326+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:28.333326+0000","last_undegraded":"2024-09-10T15:27:28.333326+0000","last_fullsized":"2024-09-10T15:27:28.333326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'15","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.078767+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:27:34.078767+0000","last_peered":"2024-09-10T15:27:34.078767+0000","last_clean":"2024-09-10T15:27:34.078767+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:27:34.078767+0000","last_undegraded":"2024-09-10T15:27:34.078767+0000","last_fullsized":"2024-09-10T15:27:34.078767+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:49.017143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340473+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340473+0000","last_peered":"2024-09-10T15:27:28.340473+0000","last_clean":"2024-09-10T15:27:28.340473+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340473+0000","last_undegraded":"2024-09-10T15:27:28.340473+0000","last_fullsized":"2024-09-10T15:27:28.340473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493307+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:27:28.493307+0000","last_peered":"2024-09-10T15:27:28.493307+0000","last_clean":"2024-09-10T15:27:28.493307+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:27:28.493307+0000","last_undegraded":"2024-09-10T15:27:28.493307+0000","last_fullsized":"2024-09-10T15:27:28.493307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"76'11","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313936+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:28.313936+0000","last_peered":"2024-09-10T15:27:28.313936+0000","last_clean":"2024-09-10T15:27:28.313936+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:28.313936+0000","last_undegraded":"2024-09-10T15:27:28.313936+0000","last_fullsized":"2024-09-10T15:27:28.313936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416759+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:27:28.416759+0000","last_peered":"2024-09-10T15:27:28.416759+0000","last_clean":"2024-09-10T15:27:28.416759+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:27:28.416759+0000","last_undegraded":"2024-09-10T15:27:28.416759+0000","last_fullsized":"2024-09-10T15:27:28.416759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"76'21","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947901+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:27:28.947901+0000","last_peered":"2024-09-10T15:27:28.947901+0000","last_clean":"2024-09-10T15:27:28.947901+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:27:28.947901+0000","last_undegraded":"2024-09-10T15:27:28.947901+0000","last_fullsized":"2024-09-10T15:27:28.947901+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:20.475834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341994+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:28.341994+0000","last_peered":"2024-09-10T15:27:28.341994+0000","last_clean":"2024-09-10T15:27:28.341994+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:28.341994+0000","last_undegraded":"2024-09-10T15:27:28.341994+0000","last_fullsized":"2024-09-10T15:27:28.341994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489952+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.489952+0000","last_peered":"2024-09-10T15:27:28.489952+0000","last_clean":"2024-09-10T15:27:28.489952+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.489952+0000","last_undegraded":"2024-09-10T15:27:28.489952+0000","last_fullsized":"2024-09-10T15:27:28.489952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416212+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416212+0000","last_peered":"2024-09-10T15:27:28.416212+0000","last_clean":"2024-09-10T15:27:28.416212+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416212+0000","last_undegraded":"2024-09-10T15:27:28.416212+0000","last_fullsized":"2024-09-10T15:27:28.416212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":315,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947773+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:27:28.947773+0000","last_peered":"2024-09-10T15:27:28.947773+0000","last_clean":"2024-09-10T15:27:28.947773+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:27:28.947773+0000","last_undegraded":"2024-09-10T15:27:28.947773+0000","last_fullsized":"2024-09-10T15:27:28.947773+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:54:08.351070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415740+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415740+0000","last_peered":"2024-09-10T15:27:28.415740+0000","last_clean":"2024-09-10T15:27:28.415740+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415740+0000","last_undegraded":"2024-09-10T15:27:28.415740+0000","last_fullsized":"2024-09-10T15:27:28.415740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314357+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:28.314357+0000","last_peered":"2024-09-10T15:27:28.314357+0000","last_clean":"2024-09-10T15:27:28.314357+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:28.314357+0000","last_undegraded":"2024-09-10T15:27:28.314357+0000","last_fullsized":"2024-09-10T15:27:28.314357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":49176,"num_write":56,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314018+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:27:28.314018+0000","last_peered":"2024-09-10T15:27:28.314018+0000","last_clean":"2024-09-10T15:27:28.314018+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:27:28.314018+0000","last_undegraded":"2024-09-10T15:27:28.314018+0000","last_fullsized":"2024-09-10T15:27:28.314018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"76'30","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416630+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:27:28.416630+0000","last_peered":"2024-09-10T15:27:28.416630+0000","last_clean":"2024-09-10T15:27:28.416630+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:27:28.416630+0000","last_undegraded":"2024-09-10T15:27:28.416630+0000","last_fullsized":"2024-09-10T15:27:28.416630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28500,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693638+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:27:28.693638+0000","last_peered":"2024-09-10T15:27:28.693638+0000","last_clean":"2024-09-10T15:27:28.693638+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:27:28.693638+0000","last_undegraded":"2024-09-10T15:27:28.693638+0000","last_fullsized":"2024-09-10T15:27:28.693638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314349+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:28.314349+0000","last_peered":"2024-09-10T15:27:28.314349+0000","last_clean":"2024-09-10T15:27:28.314349+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:28.314349+0000","last_undegraded":"2024-09-10T15:27:28.314349+0000","last_fullsized":"2024-09-10T15:27:28.314349+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696870+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:27:28.696870+0000","last_peered":"2024-09-10T15:27:28.696870+0000","last_clean":"2024-09-10T15:27:28.696870+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:27:28.696870+0000","last_undegraded":"2024-09-10T15:27:28.696870+0000","last_fullsized":"2024-09-10T15:27:28.696870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415458+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415458+0000","last_peered":"2024-09-10T15:27:28.415458+0000","last_clean":"2024-09-10T15:27:28.415458+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415458+0000","last_undegraded":"2024-09-10T15:27:28.415458+0000","last_fullsized":"2024-09-10T15:27:28.415458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"76'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332661+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:27:28.332661+0000","last_peered":"2024-09-10T15:27:28.332661+0000","last_clean":"2024-09-10T15:27:28.332661+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:27:28.332661+0000","last_undegraded":"2024-09-10T15:27:28.332661+0000","last_fullsized":"2024-09-10T15:27:28.332661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":24,"num_read_kb":49164,"num_write":36,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416394+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:27:28.416394+0000","last_peered":"2024-09-10T15:27:28.416394+0000","last_clean":"2024-09-10T15:27:28.416394+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:27:28.416394+0000","last_undegraded":"2024-09-10T15:27:28.416394+0000","last_fullsized":"2024-09-10T15:27:28.416394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'49","reported_seq":232,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035688+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:27:31.035688+0000","last_peered":"2024-09-10T15:27:31.035688+0000","last_clean":"2024-09-10T15:27:31.035688+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:27:31.035688+0000","last_undegraded":"2024-09-10T15:27:31.035688+0000","last_fullsized":"2024-09-10T15:27:31.035688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23480,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":76,"num_read_kb":85,"num_write":48,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416482+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:27:28.416482+0000","last_peered":"2024-09-10T15:27:28.416482+0000","last_clean":"2024-09-10T15:27:28.416482+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:27:28.416482+0000","last_undegraded":"2024-09-10T15:27:28.416482+0000","last_fullsized":"2024-09-10T15:27:28.416482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694935+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:28.694935+0000","last_peered":"2024-09-10T15:27:28.694935+0000","last_clean":"2024-09-10T15:27:28.694935+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:28.694935+0000","last_undegraded":"2024-09-10T15:27:28.694935+0000","last_fullsized":"2024-09-10T15:27:28.694935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334556+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:27:28.334556+0000","last_peered":"2024-09-10T15:27:28.334556+0000","last_clean":"2024-09-10T15:27:28.334556+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:27:28.334556+0000","last_undegraded":"2024-09-10T15:27:28.334556+0000","last_fullsized":"2024-09-10T15:27:28.334556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490049+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:27:28.490049+0000","last_peered":"2024-09-10T15:27:28.490049+0000","last_clean":"2024-09-10T15:27:28.490049+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:27:28.490049+0000","last_undegraded":"2024-09-10T15:27:28.490049+0000","last_fullsized":"2024-09-10T15:27:28.490049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694409+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:28.694409+0000","last_peered":"2024-09-10T15:27:28.694409+0000","last_clean":"2024-09-10T15:27:28.694409+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:28.694409+0000","last_undegraded":"2024-09-10T15:27:28.694409+0000","last_fullsized":"2024-09-10T15:27:28.694409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24588,"num_write":29,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492515+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:27:28.492515+0000","last_peered":"2024-09-10T15:27:28.492515+0000","last_clean":"2024-09-10T15:27:28.492515+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:27:28.492515+0000","last_undegraded":"2024-09-10T15:27:28.492515+0000","last_fullsized":"2024-09-10T15:27:28.492515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035733+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:27:31.035733+0000","last_peered":"2024-09-10T15:27:31.035733+0000","last_clean":"2024-09-10T15:27:31.035733+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:27:31.035733+0000","last_undegraded":"2024-09-10T15:27:31.035733+0000","last_fullsized":"2024-09-10T15:27:31.035733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314725+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.314725+0000","last_peered":"2024-09-10T15:27:28.314725+0000","last_clean":"2024-09-10T15:27:28.314725+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.314725+0000","last_undegraded":"2024-09-10T15:27:28.314725+0000","last_fullsized":"2024-09-10T15:27:28.314725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314109+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:28.314109+0000","last_peered":"2024-09-10T15:27:28.314109+0000","last_clean":"2024-09-10T15:27:28.314109+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:28.314109+0000","last_undegraded":"2024-09-10T15:27:28.314109+0000","last_fullsized":"2024-09-10T15:27:28.314109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333823+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333823+0000","last_peered":"2024-09-10T15:27:28.333823+0000","last_clean":"2024-09-10T15:27:28.333823+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333823+0000","last_undegraded":"2024-09-10T15:27:28.333823+0000","last_fullsized":"2024-09-10T15:27:28.333823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415593+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415593+0000","last_peered":"2024-09-10T15:27:28.415593+0000","last_clean":"2024-09-10T15:27:28.415593+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415593+0000","last_undegraded":"2024-09-10T15:27:28.415593+0000","last_fullsized":"2024-09-10T15:27:28.415593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"76'9","reported_seq":113,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489894+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:28.489894+0000","last_peered":"2024-09-10T15:27:28.489894+0000","last_clean":"2024-09-10T15:27:28.489894+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:28.489894+0000","last_undegraded":"2024-09-10T15:27:28.489894+0000","last_fullsized":"2024-09-10T15:27:28.489894+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:22.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":28684,"num_write":29,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491363+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:27:28.491363+0000","last_peered":"2024-09-10T15:27:28.491363+0000","last_clean":"2024-09-10T15:27:28.491363+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:27:28.491363+0000","last_undegraded":"2024-09-10T15:27:28.491363+0000","last_fullsized":"2024-09-10T15:27:28.491363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696503+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:27:28.696503+0000","last_peered":"2024-09-10T15:27:28.696503+0000","last_clean":"2024-09-10T15:27:28.696503+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:27:28.696503+0000","last_undegraded":"2024-09-10T15:27:28.696503+0000","last_fullsized":"2024-09-10T15:27:28.696503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416993+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:28.416993+0000","last_peered":"2024-09-10T15:27:28.416993+0000","last_clean":"2024-09-10T15:27:28.416993+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:28.416993+0000","last_undegraded":"2024-09-10T15:27:28.416993+0000","last_fullsized":"2024-09-10T15:27:28.416993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947060+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:28.947060+0000","last_peered":"2024-09-10T15:27:28.947060+0000","last_clean":"2024-09-10T15:27:28.947060+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:28.947060+0000","last_undegraded":"2024-09-10T15:27:28.947060+0000","last_fullsized":"2024-09-10T15:27:28.947060+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332108+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332108+0000","last_peered":"2024-09-10T15:27:28.332108+0000","last_clean":"2024-09-10T15:27:28.332108+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332108+0000","last_undegraded":"2024-09-10T15:27:28.332108+0000","last_fullsized":"2024-09-10T15:27:28.332108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341413+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:27:28.341413+0000","last_peered":"2024-09-10T15:27:28.341413+0000","last_clean":"2024-09-10T15:27:28.341413+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:27:28.341413+0000","last_undegraded":"2024-09-10T15:27:28.341413+0000","last_fullsized":"2024-09-10T15:27:28.341413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32780,"num_write":31,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697320+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697320+0000","last_peered":"2024-09-10T15:27:28.697320+0000","last_clean":"2024-09-10T15:27:28.697320+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697320+0000","last_undegraded":"2024-09-10T15:27:28.697320+0000","last_fullsized":"2024-09-10T15:27:28.697320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314579+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:27:28.314579+0000","last_peered":"2024-09-10T15:27:28.314579+0000","last_clean":"2024-09-10T15:27:28.314579+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:27:28.314579+0000","last_undegraded":"2024-09-10T15:27:28.314579+0000","last_fullsized":"2024-09-10T15:27:28.314579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"76'28","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490320+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:27:28.490320+0000","last_peered":"2024-09-10T15:27:28.490320+0000","last_clean":"2024-09-10T15:27:28.490320+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:27:28.490320+0000","last_undegraded":"2024-09-10T15:27:28.490320+0000","last_fullsized":"2024-09-10T15:27:28.490320+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16571,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340394+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340394+0000","last_peered":"2024-09-10T15:27:28.340394+0000","last_clean":"2024-09-10T15:27:28.340394+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340394+0000","last_undegraded":"2024-09-10T15:27:28.340394+0000","last_fullsized":"2024-09-10T15:27:28.340394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696197+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:28.696197+0000","last_peered":"2024-09-10T15:27:28.696197+0000","last_clean":"2024-09-10T15:27:28.696197+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:28.696197+0000","last_undegraded":"2024-09-10T15:27:28.696197+0000","last_fullsized":"2024-09-10T15:27:28.696197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333620+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:27:28.333620+0000","last_peered":"2024-09-10T15:27:28.333620+0000","last_clean":"2024-09-10T15:27:28.333620+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:27:28.333620+0000","last_undegraded":"2024-09-10T15:27:28.333620+0000","last_fullsized":"2024-09-10T15:27:28.333620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"76'11","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334268+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:27:28.334268+0000","last_peered":"2024-09-10T15:27:28.334268+0000","last_clean":"2024-09-10T15:27:28.334268+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:27:28.334268+0000","last_undegraded":"2024-09-10T15:27:28.334268+0000","last_fullsized":"2024-09-10T15:27:28.334268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34828,"num_write":31,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414797+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414797+0000","last_peered":"2024-09-10T15:27:28.414797+0000","last_clean":"2024-09-10T15:27:28.414797+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414797+0000","last_undegraded":"2024-09-10T15:27:28.414797+0000","last_fullsized":"2024-09-10T15:27:28.414797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313704+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:27:28.313704+0000","last_peered":"2024-09-10T15:27:28.313704+0000","last_clean":"2024-09-10T15:27:28.313704+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:27:28.313704+0000","last_undegraded":"2024-09-10T15:27:28.313704+0000","last_fullsized":"2024-09-10T15:27:28.313704+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331980+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.331980+0000","last_peered":"2024-09-10T15:27:28.331980+0000","last_clean":"2024-09-10T15:27:28.331980+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.331980+0000","last_undegraded":"2024-09-10T15:27:28.331980+0000","last_fullsized":"2024-09-10T15:27:28.331980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035702+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:31.035702+0000","last_peered":"2024-09-10T15:27:31.035702+0000","last_clean":"2024-09-10T15:27:31.035702+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:31.035702+0000","last_undegraded":"2024-09-10T15:27:31.035702+0000","last_fullsized":"2024-09-10T15:27:31.035702+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:19.328632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492360+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:28.492360+0000","last_peered":"2024-09-10T15:27:28.492360+0000","last_clean":"2024-09-10T15:27:28.492360+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:28.492360+0000","last_undegraded":"2024-09-10T15:27:28.492360+0000","last_fullsized":"2024-09-10T15:27:28.492360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313734+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:27:28.313734+0000","last_peered":"2024-09-10T15:27:28.313734+0000","last_clean":"2024-09-10T15:27:28.313734+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:27:28.313734+0000","last_undegraded":"2024-09-10T15:27:28.313734+0000","last_fullsized":"2024-09-10T15:27:28.313734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"76'12","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316031+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:28.316031+0000","last_peered":"2024-09-10T15:27:28.316031+0000","last_clean":"2024-09-10T15:27:28.316031+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:28.316031+0000","last_undegraded":"2024-09-10T15:27:28.316031+0000","last_fullsized":"2024-09-10T15:27:28.316031+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":36876,"num_write":32,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316149+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316149+0000","last_peered":"2024-09-10T15:27:28.316149+0000","last_clean":"2024-09-10T15:27:28.316149+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316149+0000","last_undegraded":"2024-09-10T15:27:28.316149+0000","last_fullsized":"2024-09-10T15:27:28.316149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414992+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:27:28.414992+0000","last_peered":"2024-09-10T15:27:28.414992+0000","last_clean":"2024-09-10T15:27:28.414992+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:27:28.414992+0000","last_undegraded":"2024-09-10T15:27:28.414992+0000","last_fullsized":"2024-09-10T15:27:28.414992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415219+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:27:28.415219+0000","last_peered":"2024-09-10T15:27:28.415219+0000","last_clean":"2024-09-10T15:27:28.415219+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:27:28.415219+0000","last_undegraded":"2024-09-10T15:27:28.415219+0000","last_fullsized":"2024-09-10T15:27:28.415219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'15","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035813+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:27:31.035813+0000","last_peered":"2024-09-10T15:27:31.035813+0000","last_clean":"2024-09-10T15:27:31.035813+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:27:31.035813+0000","last_undegraded":"2024-09-10T15:27:31.035813+0000","last_fullsized":"2024-09-10T15:27:31.035813+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695333+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:28.695333+0000","last_peered":"2024-09-10T15:27:28.695333+0000","last_clean":"2024-09-10T15:27:28.695333+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:28.695333+0000","last_undegraded":"2024-09-10T15:27:28.695333+0000","last_fullsized":"2024-09-10T15:27:28.695333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340766+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:27:28.340766+0000","last_peered":"2024-09-10T15:27:28.340766+0000","last_clean":"2024-09-10T15:27:28.340766+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:27:28.340766+0000","last_undegraded":"2024-09-10T15:27:28.340766+0000","last_fullsized":"2024-09-10T15:27:28.340766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'8","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315897+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:28.315897+0000","last_peered":"2024-09-10T15:27:28.315897+0000","last_clean":"2024-09-10T15:27:28.315897+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:28.315897+0000","last_undegraded":"2024-09-10T15:27:28.315897+0000","last_fullsized":"2024-09-10T15:27:28.315897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414338+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414338+0000","last_peered":"2024-09-10T15:27:28.414338+0000","last_clean":"2024-09-10T15:27:28.414338+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414338+0000","last_undegraded":"2024-09-10T15:27:28.414338+0000","last_fullsized":"2024-09-10T15:27:28.414338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313222+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:27:28.313222+0000","last_peered":"2024-09-10T15:27:28.313222+0000","last_clean":"2024-09-10T15:27:28.313222+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:27:28.313222+0000","last_undegraded":"2024-09-10T15:27:28.313222+0000","last_fullsized":"2024-09-10T15:27:28.313222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"76'30","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313533+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:28.313533+0000","last_peered":"2024-09-10T15:27:28.313533+0000","last_clean":"2024-09-10T15:27:28.313533+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:28.313533+0000","last_undegraded":"2024-09-10T15:27:28.313533+0000","last_fullsized":"2024-09-10T15:27:28.313533+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16131,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":49,"num_read_kb":44,"num_write":32,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314089+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314089+0000","last_peered":"2024-09-10T15:27:28.314089+0000","last_clean":"2024-09-10T15:27:28.314089+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314089+0000","last_undegraded":"2024-09-10T15:27:28.314089+0000","last_fullsized":"2024-09-10T15:27:28.314089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341327+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:28.341327+0000","last_peered":"2024-09-10T15:27:28.341327+0000","last_clean":"2024-09-10T15:27:28.341327+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:28.341327+0000","last_undegraded":"2024-09-10T15:27:28.341327+0000","last_fullsized":"2024-09-10T15:27:28.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314871+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314871+0000","last_peered":"2024-09-10T15:27:28.314871+0000","last_clean":"2024-09-10T15:27:28.314871+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314871+0000","last_undegraded":"2024-09-10T15:27:28.314871+0000","last_fullsized":"2024-09-10T15:27:28.314871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341154+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:27:28.341154+0000","last_peered":"2024-09-10T15:27:28.341154+0000","last_clean":"2024-09-10T15:27:28.341154+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:27:28.341154+0000","last_undegraded":"2024-09-10T15:27:28.341154+0000","last_fullsized":"2024-09-10T15:27:28.341154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416215+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:27:28.416215+0000","last_peered":"2024-09-10T15:27:28.416215+0000","last_clean":"2024-09-10T15:27:28.416215+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:27:28.416215+0000","last_undegraded":"2024-09-10T15:27:28.416215+0000","last_fullsized":"2024-09-10T15:27:28.416215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":45068,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332605+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:27:28.332605+0000","last_peered":"2024-09-10T15:27:28.332605+0000","last_clean":"2024-09-10T15:27:28.332605+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:27:28.332605+0000","last_undegraded":"2024-09-10T15:27:28.332605+0000","last_fullsized":"2024-09-10T15:27:28.332605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"76'18","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332079+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:27:28.332079+0000","last_peered":"2024-09-10T15:27:28.332079+0000","last_clean":"2024-09-10T15:27:28.332079+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:27:28.332079+0000","last_undegraded":"2024-09-10T15:27:28.332079+0000","last_fullsized":"2024-09-10T15:27:28.332079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6321,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":30,"num_write":20,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489143+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:27:28.489143+0000","last_peered":"2024-09-10T15:27:28.489143+0000","last_clean":"2024-09-10T15:27:28.489143+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:27:28.489143+0000","last_undegraded":"2024-09-10T15:27:28.489143+0000","last_fullsized":"2024-09-10T15:27:28.489143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492067+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492067+0000","last_peered":"2024-09-10T15:27:28.492067+0000","last_clean":"2024-09-10T15:27:28.492067+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492067+0000","last_undegraded":"2024-09-10T15:27:28.492067+0000","last_fullsized":"2024-09-10T15:27:28.492067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314013+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:28.314013+0000","last_peered":"2024-09-10T15:27:28.314013+0000","last_clean":"2024-09-10T15:27:28.314013+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:28.314013+0000","last_undegraded":"2024-09-10T15:27:28.314013+0000","last_fullsized":"2024-09-10T15:27:28.314013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"76'10","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316348+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:27:28.316348+0000","last_peered":"2024-09-10T15:27:28.316348+0000","last_clean":"2024-09-10T15:27:28.316348+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:27:28.316348+0000","last_undegraded":"2024-09-10T15:27:28.316348+0000","last_fullsized":"2024-09-10T15:27:28.316348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32774,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314352+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:27:28.314352+0000","last_peered":"2024-09-10T15:27:28.314352+0000","last_clean":"2024-09-10T15:27:28.314352+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:27:28.314352+0000","last_undegraded":"2024-09-10T15:27:28.314352+0000","last_fullsized":"2024-09-10T15:27:28.314352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313070+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:27:28.313070+0000","last_peered":"2024-09-10T15:27:28.313070+0000","last_clean":"2024-09-10T15:27:28.313070+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:27:28.313070+0000","last_undegraded":"2024-09-10T15:27:28.313070+0000","last_fullsized":"2024-09-10T15:27:28.313070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333594+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:28.333594+0000","last_peered":"2024-09-10T15:27:28.333594+0000","last_clean":"2024-09-10T15:27:28.333594+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:28.333594+0000","last_undegraded":"2024-09-10T15:27:28.333594+0000","last_fullsized":"2024-09-10T15:27:28.333594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313586+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:27:28.313586+0000","last_peered":"2024-09-10T15:27:28.313586+0000","last_clean":"2024-09-10T15:27:28.313586+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:27:28.313586+0000","last_undegraded":"2024-09-10T15:27:28.313586+0000","last_fullsized":"2024-09-10T15:27:28.313586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"76'6","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341923+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:27:28.341923+0000","last_peered":"2024-09-10T15:27:28.341923+0000","last_clean":"2024-09-10T15:27:28.341923+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:27:28.341923+0000","last_undegraded":"2024-09-10T15:27:28.341923+0000","last_fullsized":"2024-09-10T15:27:28.341923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20486,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340106+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:27:28.340106+0000","last_peered":"2024-09-10T15:27:28.340106+0000","last_clean":"2024-09-10T15:27:28.340106+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:27:28.340106+0000","last_undegraded":"2024-09-10T15:27:28.340106+0000","last_fullsized":"2024-09-10T15:27:28.340106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"76'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490985+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:27:28.490985+0000","last_peered":"2024-09-10T15:27:28.490985+0000","last_clean":"2024-09-10T15:27:28.490985+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:27:28.490985+0000","last_undegraded":"2024-09-10T15:27:28.490985+0000","last_fullsized":"2024-09-10T15:27:28.490985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947458+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:28.947458+0000","last_peered":"2024-09-10T15:27:28.947458+0000","last_clean":"2024-09-10T15:27:28.947458+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:28.947458+0000","last_undegraded":"2024-09-10T15:27:28.947458+0000","last_fullsized":"2024-09-10T15:27:28.947458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415920+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:28.415920+0000","last_peered":"2024-09-10T15:27:28.415920+0000","last_clean":"2024-09-10T15:27:28.415920+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:28.415920+0000","last_undegraded":"2024-09-10T15:27:28.415920+0000","last_fullsized":"2024-09-10T15:27:28.415920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490524+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:27:28.490524+0000","last_peered":"2024-09-10T15:27:28.490524+0000","last_clean":"2024-09-10T15:27:28.490524+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:27:28.490524+0000","last_undegraded":"2024-09-10T15:27:28.490524+0000","last_fullsized":"2024-09-10T15:27:28.490524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"76'11","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697982+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:28.697982+0000","last_peered":"2024-09-10T15:27:28.697982+0000","last_clean":"2024-09-10T15:27:28.697982+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:28.697982+0000","last_undegraded":"2024-09-10T15:27:28.697982+0000","last_fullsized":"2024-09-10T15:27:28.697982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":28696,"num_write":51,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415092+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:27:28.415092+0000","last_peered":"2024-09-10T15:27:28.415092+0000","last_clean":"2024-09-10T15:27:28.415092+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:27:28.415092+0000","last_undegraded":"2024-09-10T15:27:28.415092+0000","last_fullsized":"2024-09-10T15:27:28.415092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"76'16","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313810+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:27:28.313810+0000","last_peered":"2024-09-10T15:27:28.313810+0000","last_clean":"2024-09-10T15:27:28.313810+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:27:28.313810+0000","last_undegraded":"2024-09-10T15:27:28.313810+0000","last_fullsized":"2024-09-10T15:27:28.313810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490332+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:27:28.490332+0000","last_peered":"2024-09-10T15:27:28.490332+0000","last_clean":"2024-09-10T15:27:28.490332+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:27:28.490332+0000","last_undegraded":"2024-09-10T15:27:28.490332+0000","last_fullsized":"2024-09-10T15:27:28.490332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416768+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:27:28.416768+0000","last_peered":"2024-09-10T15:27:28.416768+0000","last_clean":"2024-09-10T15:27:28.416768+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:27:28.416768+0000","last_undegraded":"2024-09-10T15:27:28.416768+0000","last_fullsized":"2024-09-10T15:27:28.416768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"76'13","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695012+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:27:28.695012+0000","last_peered":"2024-09-10T15:27:28.695012+0000","last_clean":"2024-09-10T15:27:28.695012+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:27:28.695012+0000","last_undegraded":"2024-09-10T15:27:28.695012+0000","last_fullsized":"2024-09-10T15:27:28.695012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334748+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:27:28.334748+0000","last_peered":"2024-09-10T15:27:28.334748+0000","last_clean":"2024-09-10T15:27:28.334748+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:27:28.334748+0000","last_undegraded":"2024-09-10T15:27:28.334748+0000","last_fullsized":"2024-09-10T15:27:28.334748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"76'22","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333589+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:28.333589+0000","last_peered":"2024-09-10T15:27:28.333589+0000","last_clean":"2024-09-10T15:27:28.333589+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:28.333589+0000","last_undegraded":"2024-09-10T15:27:28.333589+0000","last_fullsized":"2024-09-10T15:27:28.333589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":40,"num_write":26,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339933+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:28.339933+0000","last_peered":"2024-09-10T15:27:28.339933+0000","last_clean":"2024-09-10T15:27:28.339933+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:28.339933+0000","last_undegraded":"2024-09-10T15:27:28.339933+0000","last_fullsized":"2024-09-10T15:27:28.339933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695048+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:28.695048+0000","last_peered":"2024-09-10T15:27:28.695048+0000","last_clean":"2024-09-10T15:27:28.695048+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:28.695048+0000","last_undegraded":"2024-09-10T15:27:28.695048+0000","last_fullsized":"2024-09-10T15:27:28.695048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315808+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:27:28.315808+0000","last_peered":"2024-09-10T15:27:28.315808+0000","last_clean":"2024-09-10T15:27:28.315808+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:27:28.315808+0000","last_undegraded":"2024-09-10T15:27:28.315808+0000","last_fullsized":"2024-09-10T15:27:28.315808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"76'13","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314064+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:28.314064+0000","last_peered":"2024-09-10T15:27:28.314064+0000","last_clean":"2024-09-10T15:27:28.314064+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:28.314064+0000","last_undegraded":"2024-09-10T15:27:28.314064+0000","last_fullsized":"2024-09-10T15:27:28.314064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38924,"num_write":33,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341227+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:27:28.341227+0000","last_peered":"2024-09-10T15:27:28.341227+0000","last_clean":"2024-09-10T15:27:28.341227+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:27:28.341227+0000","last_undegraded":"2024-09-10T15:27:28.341227+0000","last_fullsized":"2024-09-10T15:27:28.341227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"76'20","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416187+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:27:28.416187+0000","last_peered":"2024-09-10T15:27:28.416187+0000","last_clean":"2024-09-10T15:27:28.416187+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:27:28.416187+0000","last_undegraded":"2024-09-10T15:27:28.416187+0000","last_fullsized":"2024-09-10T15:27:28.416187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5766,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695668+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:28.695668+0000","last_peered":"2024-09-10T15:27:28.695668+0000","last_clean":"2024-09-10T15:27:28.695668+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:28.695668+0000","last_undegraded":"2024-09-10T15:27:28.695668+0000","last_fullsized":"2024-09-10T15:27:28.695668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415602+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:28.415602+0000","last_peered":"2024-09-10T15:27:28.415602+0000","last_clean":"2024-09-10T15:27:28.415602+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:28.415602+0000","last_undegraded":"2024-09-10T15:27:28.415602+0000","last_fullsized":"2024-09-10T15:27:28.415602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491600+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:27:28.491600+0000","last_peered":"2024-09-10T15:27:28.491600+0000","last_clean":"2024-09-10T15:27:28.491600+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:27:28.491600+0000","last_undegraded":"2024-09-10T15:27:28.491600+0000","last_fullsized":"2024-09-10T15:27:28.491600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"71'6","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947965+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:27:28.947965+0000","last_peered":"2024-09-10T15:27:28.947965+0000","last_clean":"2024-09-10T15:27:28.947965+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:27:28.947965+0000","last_undegraded":"2024-09-10T15:27:28.947965+0000","last_fullsized":"2024-09-10T15:27:28.947965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341641+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:27:28.341641+0000","last_peered":"2024-09-10T15:27:28.341641+0000","last_clean":"2024-09-10T15:27:28.341641+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:27:28.341641+0000","last_undegraded":"2024-09-10T15:27:28.341641+0000","last_fullsized":"2024-09-10T15:27:28.341641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"76'14","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333989+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:27:28.333989+0000","last_peered":"2024-09-10T15:27:28.333989+0000","last_clean":"2024-09-10T15:27:28.333989+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:27:28.333989+0000","last_undegraded":"2024-09-10T15:27:28.333989+0000","last_fullsized":"2024-09-10T15:27:28.333989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489208+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489208+0000","last_peered":"2024-09-10T15:27:28.489208+0000","last_clean":"2024-09-10T15:27:28.489208+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489208+0000","last_undegraded":"2024-09-10T15:27:28.489208+0000","last_fullsized":"2024-09-10T15:27:28.489208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414558+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:28.414558+0000","last_peered":"2024-09-10T15:27:28.414558+0000","last_clean":"2024-09-10T15:27:28.414558+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:28.414558+0000","last_undegraded":"2024-09-10T15:27:28.414558+0000","last_fullsized":"2024-09-10T15:27:28.414558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315425+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:27:28.315425+0000","last_peered":"2024-09-10T15:27:28.315425+0000","last_clean":"2024-09-10T15:27:28.315425+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:27:28.315425+0000","last_undegraded":"2024-09-10T15:27:28.315425+0000","last_fullsized":"2024-09-10T15:27:28.315425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315796+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:28.315796+0000","last_peered":"2024-09-10T15:27:28.315796+0000","last_clean":"2024-09-10T15:27:28.315796+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:28.315796+0000","last_undegraded":"2024-09-10T15:27:28.315796+0000","last_fullsized":"2024-09-10T15:27:28.315796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47122,"num_write":46,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314946+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:27:28.314946+0000","last_peered":"2024-09-10T15:27:28.314946+0000","last_clean":"2024-09-10T15:27:28.314946+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:27:28.314946+0000","last_undegraded":"2024-09-10T15:27:28.314946+0000","last_fullsized":"2024-09-10T15:27:28.314946+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"88'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416555+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:27:28.416555+0000","last_peered":"2024-09-10T15:27:28.416555+0000","last_clean":"2024-09-10T15:27:28.416555+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:27:28.416555+0000","last_undegraded":"2024-09-10T15:27:28.416555+0000","last_fullsized":"2024-09-10T15:27:28.416555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'15","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:31.035948+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:31.035948+0000","last_peered":"2024-09-10T15:27:31.035948+0000","last_clean":"2024-09-10T15:27:31.035948+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:31.035948+0000","last_undegraded":"2024-09-10T15:27:31.035948+0000","last_fullsized":"2024-09-10T15:27:31.035948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:31.287523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414710+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:28.414710+0000","last_peered":"2024-09-10T15:27:28.414710+0000","last_clean":"2024-09-10T15:27:28.414710+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:28.414710+0000","last_undegraded":"2024-09-10T15:27:28.414710+0000","last_fullsized":"2024-09-10T15:27:28.414710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341111+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:27:28.341111+0000","last_peered":"2024-09-10T15:27:28.341111+0000","last_clean":"2024-09-10T15:27:28.341111+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:27:28.341111+0000","last_undegraded":"2024-09-10T15:27:28.341111+0000","last_fullsized":"2024-09-10T15:27:28.341111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"76'10","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947928+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:27:28.947928+0000","last_peered":"2024-09-10T15:27:28.947928+0000","last_clean":"2024-09-10T15:27:28.947928+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:27:28.947928+0000","last_undegraded":"2024-09-10T15:27:28.947928+0000","last_fullsized":"2024-09-10T15:27:28.947928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947579+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:27:28.947579+0000","last_peered":"2024-09-10T15:27:28.947579+0000","last_clean":"2024-09-10T15:27:28.947579+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:27:28.947579+0000","last_undegraded":"2024-09-10T15:27:28.947579+0000","last_fullsized":"2024-09-10T15:27:28.947579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"76'20","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314207+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:27:28.314207+0000","last_peered":"2024-09-10T15:27:28.314207+0000","last_clean":"2024-09-10T15:27:28.314207+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:27:28.314207+0000","last_undegraded":"2024-09-10T15:27:28.314207+0000","last_fullsized":"2024-09-10T15:27:28.314207+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5764,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313219+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:28.313219+0000","last_peered":"2024-09-10T15:27:28.313219+0000","last_clean":"2024-09-10T15:27:28.313219+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:28.313219+0000","last_undegraded":"2024-09-10T15:27:28.313219+0000","last_fullsized":"2024-09-10T15:27:28.313219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948271+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:28.948271+0000","last_peered":"2024-09-10T15:27:28.948271+0000","last_clean":"2024-09-10T15:27:28.948271+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:28.948271+0000","last_undegraded":"2024-09-10T15:27:28.948271+0000","last_fullsized":"2024-09-10T15:27:28.948271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:32.812671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340645+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:27:28.340645+0000","last_peered":"2024-09-10T15:27:28.340645+0000","last_clean":"2024-09-10T15:27:28.340645+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:27:28.340645+0000","last_undegraded":"2024-09-10T15:27:28.340645+0000","last_fullsized":"2024-09-10T15:27:28.340645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414699+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:28.414699+0000","last_peered":"2024-09-10T15:27:28.414699+0000","last_clean":"2024-09-10T15:27:28.414699+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:28.414699+0000","last_undegraded":"2024-09-10T15:27:28.414699+0000","last_fullsized":"2024-09-10T15:27:28.414699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":24594,"num_write":40,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340914+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:27:28.340914+0000","last_peered":"2024-09-10T15:27:28.340914+0000","last_clean":"2024-09-10T15:27:28.340914+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:27:28.340914+0000","last_undegraded":"2024-09-10T15:27:28.340914+0000","last_fullsized":"2024-09-10T15:27:28.340914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"76'15","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313782+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:27:28.313782+0000","last_peered":"2024-09-10T15:27:28.313782+0000","last_clean":"2024-09-10T15:27:28.313782+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:27:28.313782+0000","last_undegraded":"2024-09-10T15:27:28.313782+0000","last_fullsized":"2024-09-10T15:27:28.313782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6320,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":25,"num_read_kb":28,"num_write":18,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414873+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:28.414873+0000","last_peered":"2024-09-10T15:27:28.414873+0000","last_clean":"2024-09-10T15:27:28.414873+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:28.414873+0000","last_undegraded":"2024-09-10T15:27:28.414873+0000","last_fullsized":"2024-09-10T15:27:28.414873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696568+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:28.696568+0000","last_peered":"2024-09-10T15:27:28.696568+0000","last_clean":"2024-09-10T15:27:28.696568+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:28.696568+0000","last_undegraded":"2024-09-10T15:27:28.696568+0000","last_fullsized":"2024-09-10T15:27:28.696568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490260+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:27:28.490260+0000","last_peered":"2024-09-10T15:27:28.490260+0000","last_clean":"2024-09-10T15:27:28.490260+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:27:28.490260+0000","last_undegraded":"2024-09-10T15:27:28.490260+0000","last_fullsized":"2024-09-10T15:27:28.490260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697170+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:28.697170+0000","last_peered":"2024-09-10T15:27:28.697170+0000","last_clean":"2024-09-10T15:27:28.697170+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:28.697170+0000","last_undegraded":"2024-09-10T15:27:28.697170+0000","last_fullsized":"2024-09-10T15:27:28.697170+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22540,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947192+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:27:28.947192+0000","last_peered":"2024-09-10T15:27:28.947192+0000","last_clean":"2024-09-10T15:27:28.947192+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:27:28.947192+0000","last_undegraded":"2024-09-10T15:27:28.947192+0000","last_fullsized":"2024-09-10T15:27:28.947192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"76'13","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333357+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:27:28.333357+0000","last_peered":"2024-09-10T15:27:28.333357+0000","last_clean":"2024-09-10T15:27:28.333357+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:27:28.333357+0000","last_undegraded":"2024-09-10T15:27:28.333357+0000","last_fullsized":"2024-09-10T15:27:28.333357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12479,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":34,"num_write":18,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414746+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:27:28.414746+0000","last_peered":"2024-09-10T15:27:28.414746+0000","last_clean":"2024-09-10T15:27:28.414746+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:27:28.414746+0000","last_undegraded":"2024-09-10T15:27:28.414746+0000","last_fullsized":"2024-09-10T15:27:28.414746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415981+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:28.415981+0000","last_peered":"2024-09-10T15:27:28.415981+0000","last_clean":"2024-09-10T15:27:28.415981+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:28.415981+0000","last_undegraded":"2024-09-10T15:27:28.415981+0000","last_fullsized":"2024-09-10T15:27:28.415981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:27:28.340248+0000","last_peered":"2024-09-10T15:27:28.340248+0000","last_clean":"2024-09-10T15:27:28.340248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:27:28.340248+0000","last_undegraded":"2024-09-10T15:27:28.340248+0000","last_fullsized":"2024-09-10T15:27:28.340248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"76'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697494+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:28.697494+0000","last_peered":"2024-09-10T15:27:28.697494+0000","last_clean":"2024-09-10T15:27:28.697494+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:28.697494+0000","last_undegraded":"2024-09-10T15:27:28.697494+0000","last_fullsized":"2024-09-10T15:27:28.697494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24582,"num_write":18,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313217+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:27:28.313217+0000","last_peered":"2024-09-10T15:27:28.313217+0000","last_clean":"2024-09-10T15:27:28.313217+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:27:28.313217+0000","last_undegraded":"2024-09-10T15:27:28.313217+0000","last_fullsized":"2024-09-10T15:27:28.313217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"76'13","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414966+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:27:28.414966+0000","last_peered":"2024-09-10T15:27:28.414966+0000","last_clean":"2024-09-10T15:27:28.414966+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:27:28.414966+0000","last_undegraded":"2024-09-10T15:27:28.414966+0000","last_fullsized":"2024-09-10T15:27:28.414966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314980+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:28.314980+0000","last_peered":"2024-09-10T15:27:28.314980+0000","last_clean":"2024-09-10T15:27:28.314980+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:28.314980+0000","last_undegraded":"2024-09-10T15:27:28.314980+0000","last_fullsized":"2024-09-10T15:27:28.314980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315593+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:28.315593+0000","last_peered":"2024-09-10T15:27:28.315593+0000","last_clean":"2024-09-10T15:27:28.315593+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:28.315593+0000","last_undegraded":"2024-09-10T15:27:28.315593+0000","last_fullsized":"2024-09-10T15:27:28.315593+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315999+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:27:28.315999+0000","last_peered":"2024-09-10T15:27:28.315999+0000","last_clean":"2024-09-10T15:27:28.315999+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:27:28.315999+0000","last_undegraded":"2024-09-10T15:27:28.315999+0000","last_fullsized":"2024-09-10T15:27:28.315999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"71'8","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340407+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:27:28.340407+0000","last_peered":"2024-09-10T15:27:28.340407+0000","last_clean":"2024-09-10T15:27:28.340407+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:27:28.340407+0000","last_undegraded":"2024-09-10T15:27:28.340407+0000","last_fullsized":"2024-09-10T15:27:28.340407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492828+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:27:28.492828+0000","last_peered":"2024-09-10T15:27:28.492828+0000","last_clean":"2024-09-10T15:27:28.492828+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:27:28.492828+0000","last_undegraded":"2024-09-10T15:27:28.492828+0000","last_fullsized":"2024-09-10T15:27:28.492828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"63'3","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489564+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:27:28.489564+0000","last_peered":"2024-09-10T15:27:28.489564+0000","last_clean":"2024-09-10T15:27:28.489564+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:27:28.489564+0000","last_undegraded":"2024-09-10T15:27:28.489564+0000","last_fullsized":"2024-09-10T15:27:28.489564+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416056+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416056+0000","last_peered":"2024-09-10T15:27:28.416056+0000","last_clean":"2024-09-10T15:27:28.416056+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416056+0000","last_undegraded":"2024-09-10T15:27:28.416056+0000","last_fullsized":"2024-09-10T15:27:28.416056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"76'13","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415413+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:28.415413+0000","last_peered":"2024-09-10T15:27:28.415413+0000","last_clean":"2024-09-10T15:27:28.415413+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:28.415413+0000","last_undegraded":"2024-09-10T15:27:28.415413+0000","last_fullsized":"2024-09-10T15:27:28.415413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":43020,"num_write":33,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696973+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:27:28.696973+0000","last_peered":"2024-09-10T15:27:28.696973+0000","last_clean":"2024-09-10T15:27:28.696973+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:27:28.696973+0000","last_undegraded":"2024-09-10T15:27:28.696973+0000","last_fullsized":"2024-09-10T15:27:28.696973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"76'15","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696532+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:28.696532+0000","last_peered":"2024-09-10T15:27:28.696532+0000","last_clean":"2024-09-10T15:27:28.696532+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:28.696532+0000","last_undegraded":"2024-09-10T15:27:28.696532+0000","last_fullsized":"2024-09-10T15:27:28.696532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":51212,"num_write":35,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695873+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:27:28.695873+0000","last_peered":"2024-09-10T15:27:28.695873+0000","last_clean":"2024-09-10T15:27:28.695873+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:27:28.695873+0000","last_undegraded":"2024-09-10T15:27:28.695873+0000","last_fullsized":"2024-09-10T15:27:28.695873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"76'14","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331251+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:27:28.331251+0000","last_peered":"2024-09-10T15:27:28.331251+0000","last_clean":"2024-09-10T15:27:28.331251+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:27:28.331251+0000","last_undegraded":"2024-09-10T15:27:28.331251+0000","last_fullsized":"2024-09-10T15:27:28.331251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":43020,"num_write":34,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314167+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:27:28.314167+0000","last_peered":"2024-09-10T15:27:28.314167+0000","last_clean":"2024-09-10T15:27:28.314167+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:27:28.314167+0000","last_undegraded":"2024-09-10T15:27:28.314167+0000","last_fullsized":"2024-09-10T15:27:28.314167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"76'10","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334348+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:27:28.334348+0000","last_peered":"2024-09-10T15:27:28.334348+0000","last_clean":"2024-09-10T15:27:28.334348+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:27:28.334348+0000","last_undegraded":"2024-09-10T15:27:28.334348+0000","last_fullsized":"2024-09-10T15:27:28.334348+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":30732,"num_write":30,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332571+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:27:28.332571+0000","last_peered":"2024-09-10T15:27:28.332571+0000","last_clean":"2024-09-10T15:27:28.332571+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:27:28.332571+0000","last_undegraded":"2024-09-10T15:27:28.332571+0000","last_fullsized":"2024-09-10T15:27:28.332571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"76'9","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341835+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:27:28.341835+0000","last_peered":"2024-09-10T15:27:28.341835+0000","last_clean":"2024-09-10T15:27:28.341835+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:27:28.341835+0000","last_undegraded":"2024-09-10T15:27:28.341835+0000","last_fullsized":"2024-09-10T15:27:28.341835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30726,"num_write":19,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947641+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:27:28.947641+0000","last_peered":"2024-09-10T15:27:28.947641+0000","last_clean":"2024-09-10T15:27:28.947641+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:27:28.947641+0000","last_undegraded":"2024-09-10T15:27:28.947641+0000","last_fullsized":"2024-09-10T15:27:28.947641+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"76'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697192+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:27:28.697192+0000","last_peered":"2024-09-10T15:27:28.697192+0000","last_clean":"2024-09-10T15:27:28.697192+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:27:28.697192+0000","last_undegraded":"2024-09-10T15:27:28.697192+0000","last_fullsized":"2024-09-10T15:27:28.697192+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28684,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493197+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:28.493197+0000","last_peered":"2024-09-10T15:27:28.493197+0000","last_clean":"2024-09-10T15:27:28.493197+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:28.493197+0000","last_undegraded":"2024-09-10T15:27:28.493197+0000","last_fullsized":"2024-09-10T15:27:28.493197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"76'9","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415276+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:27:28.415276+0000","last_peered":"2024-09-10T15:27:28.415276+0000","last_clean":"2024-09-10T15:27:28.415276+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:27:28.415276+0000","last_undegraded":"2024-09-10T15:27:28.415276+0000","last_fullsized":"2024-09-10T15:27:28.415276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26636,"num_write":29,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315776+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:27:28.315776+0000","last_peered":"2024-09-10T15:27:28.315776+0000","last_clean":"2024-09-10T15:27:28.315776+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:27:28.315776+0000","last_undegraded":"2024-09-10T15:27:28.315776+0000","last_fullsized":"2024-09-10T15:27:28.315776+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"69'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694776+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:28.694776+0000","last_peered":"2024-09-10T15:27:28.694776+0000","last_clean":"2024-09-10T15:27:28.694776+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:28.694776+0000","last_undegraded":"2024-09-10T15:27:28.694776+0000","last_fullsized":"2024-09-10T15:27:28.694776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696443+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:27:28.696443+0000","last_peered":"2024-09-10T15:27:28.696443+0000","last_clean":"2024-09-10T15:27:28.696443+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:27:28.696443+0000","last_undegraded":"2024-09-10T15:27:28.696443+0000","last_fullsized":"2024-09-10T15:27:28.696443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"76'7","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947713+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:27:28.947713+0000","last_peered":"2024-09-10T15:27:28.947713+0000","last_clean":"2024-09-10T15:27:28.947713+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:27:28.947713+0000","last_undegraded":"2024-09-10T15:27:28.947713+0000","last_fullsized":"2024-09-10T15:27:28.947713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18438,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947692+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.947692+0000","last_peered":"2024-09-10T15:27:28.947692+0000","last_clean":"2024-09-10T15:27:28.947692+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:27:28.947692+0000","last_undegraded":"2024-09-10T15:27:28.947692+0000","last_fullsized":"2024-09-10T15:27:28.947692+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"76'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315424+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:28.315424+0000","last_peered":"2024-09-10T15:27:28.315424+0000","last_clean":"2024-09-10T15:27:28.315424+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:28.315424+0000","last_undegraded":"2024-09-10T15:27:28.315424+0000","last_fullsized":"2024-09-10T15:27:28.315424+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":20,"num_read_kb":53254,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947595+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:27:28.947595+0000","last_peered":"2024-09-10T15:27:28.947595+0000","last_clean":"2024-09-10T15:27:28.947595+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:27:28.947595+0000","last_undegraded":"2024-09-10T15:27:28.947595+0000","last_fullsized":"2024-09-10T15:27:28.947595+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"76'13","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315275+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:27:28.315275+0000","last_peered":"2024-09-10T15:27:28.315275+0000","last_clean":"2024-09-10T15:27:28.315275+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:27:28.315275+0000","last_undegraded":"2024-09-10T15:27:28.315275+0000","last_fullsized":"2024-09-10T15:27:28.315275+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38930,"num_write":43,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490207+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490207+0000","last_peered":"2024-09-10T15:27:28.490207+0000","last_clean":"2024-09-10T15:27:28.490207+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490207+0000","last_undegraded":"2024-09-10T15:27:28.490207+0000","last_fullsized":"2024-09-10T15:27:28.490207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"76'8","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414460+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:28.414460+0000","last_peered":"2024-09-10T15:27:28.414460+0000","last_clean":"2024-09-10T15:27:28.414460+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:28.414460+0000","last_undegraded":"2024-09-10T15:27:28.414460+0000","last_fullsized":"2024-09-10T15:27:28.414460+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":22534,"num_write":18,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313708+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:27:28.313708+0000","last_peered":"2024-09-10T15:27:28.313708+0000","last_clean":"2024-09-10T15:27:28.313708+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:27:28.313708+0000","last_undegraded":"2024-09-10T15:27:28.313708+0000","last_fullsized":"2024-09-10T15:27:28.313708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"70'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493135+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:27:28.493135+0000","last_peered":"2024-09-10T15:27:28.493135+0000","last_clean":"2024-09-10T15:27:28.493135+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:27:28.493135+0000","last_undegraded":"2024-09-10T15:27:28.493135+0000","last_fullsized":"2024-09-10T15:27:28.493135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34822,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947471+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:27:28.947471+0000","last_peered":"2024-09-10T15:27:28.947471+0000","last_clean":"2024-09-10T15:27:28.947471+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:27:28.947471+0000","last_undegraded":"2024-09-10T15:27:28.947471+0000","last_fullsized":"2024-09-10T15:27:28.947471+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"76'15","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414535+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:28.414535+0000","last_peered":"2024-09-10T15:27:28.414535+0000","last_clean":"2024-09-10T15:27:28.414535+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:28.414535+0000","last_undegraded":"2024-09-10T15:27:28.414535+0000","last_fullsized":"2024-09-10T15:27:28.414535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":47122,"num_write":45,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"70'7","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415329+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:28.415329+0000","last_peered":"2024-09-10T15:27:28.415329+0000","last_clean":"2024-09-10T15:27:28.415329+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:28.415329+0000","last_undegraded":"2024-09-10T15:27:28.415329+0000","last_fullsized":"2024-09-10T15:27:28.415329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315903+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:27:28.315903+0000","last_peered":"2024-09-10T15:27:28.315903+0000","last_clean":"2024-09-10T15:27:28.315903+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:27:28.315903+0000","last_undegraded":"2024-09-10T15:27:28.315903+0000","last_fullsized":"2024-09-10T15:27:28.315903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"71'4","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693432+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:28.693432+0000","last_peered":"2024-09-10T15:27:28.693432+0000","last_clean":"2024-09-10T15:27:28.693432+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:28.693432+0000","last_undegraded":"2024-09-10T15:27:28.693432+0000","last_fullsized":"2024-09-10T15:27:28.693432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.948407+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:27:28.948407+0000","last_peered":"2024-09-10T15:27:28.948407+0000","last_clean":"2024-09-10T15:27:28.948407+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:27:28.948407+0000","last_undegraded":"2024-09-10T15:27:28.948407+0000","last_fullsized":"2024-09-10T15:27:28.948407+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238917,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":927,"num_read_kb":923,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":577,"ondisk_log_size":577,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1100,"num_read_kb":2048660,"num_write":1760,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302684,"kb_used_data":271500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94069156,"statfs":{"total":96636764160,"available":96326815744,"internally_reserved":0,"allocated":278016000,"data_stored":277481932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":405092,"kb_used_data":373904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93966748,"statfs":{"total":96636764160,"available":96221949952,"internally_reserved":0,"allocated":382877696,"data_stored":382332157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":434344,"kb_used_data":403160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93937496,"statfs":{"total":96636764160,"available":96191995904,"internally_reserved":0,"allocated":412835840,"data_stored":412291291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":370288,"kb_used_data":339104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94001552,"statfs":{"total":96636764160,"available":96257589248,"internally_reserved":0,"allocated":347242496,"data_stored":346695811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":509528,"kb_used_data":478340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93862312,"statfs":{"total":96636764160,"available":96115007488,"internally_reserved":0,"allocated":489820160,"data_stored":489288012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":501308,"kb_used_data":470120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93870532,"statfs":{"total":96636764160,"available":96123424768,"internally_reserved":0,"allocated":481402880,"data_stored":480896228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":356560,"kb_used_data":325376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94015280,"statfs":{"total":96636764160,"available":96271646720,"internally_reserved":0,"allocated":333185024,"data_stored":332610464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":575112,"kb_used_data":543928,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93796728,"statfs":{"total":96636764160,"available":96047849472,"internally_reserved":0,"allocated":556982272,"data_stored":556408695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":555745280,"data_stored":555745280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":488636416,"data_stored":488636416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":346030080,"data_stored":346030080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":411041792,"data_stored":411041792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":381681664,"data_stored":381681664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":276824064,"data_stored":276824064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":33745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":40456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":19324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":22435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":35596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":30035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":20385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":28726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:28:00.654 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T15:28:00.997 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:28:00.997 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":94,"fsid":"4e8f2598-e62a-4186-9762-b22671b00e14","created":"2024-09-10T15:24:44.086812+0000","modified":"2024-09-10T15:27:28.305464+0000","last_up_change":"2024-09-10T15:24:57.289996+0000","last_in_change":"2024-09-10T15:24:46.474296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T15:24:58.987011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T15:25:02.368798+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-10T15:25:10.252625+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-10T15:25:12.200720+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-10T15:25:14.120064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-10T15:25:15.995798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-10T15:25:17.927911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-10T15:25:20.055058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81adb850-6bce-4c6a-b91d-d1014dab2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6809","nonce":2528983694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6811","nonce":2528983694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6815","nonce":2528983694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2528983694},{"type":"v1","addr":"172.21.15.99:6813","nonce":2528983694}]},"public_addr":"172.21.15.99:6809/2528983694","cluster_addr":"172.21.15.99:6811/2528983694","heartbeat_back_addr":"172.21.15.99:6815/2528983694","heartbeat_front_addr":"172.21.15.99:6813/2528983694","state":["exists","up"]},{"osd":1,"uuid":"266bd277-c43f-45f2-b407-939f7fe60124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6801","nonce":3085897297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6803","nonce":3085897297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6807","nonce":3085897297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":3085897297},{"type":"v1","addr":"172.21.15.99:6805","nonce":3085897297}]},"public_addr":"172.21.15.99:6801/3085897297","cluster_addr":"172.21.15.99:6803/3085897297","heartbeat_back_addr":"172.21.15.99:6807/3085897297","heartbeat_front_addr":"172.21.15.99:6805/3085897297","state":["exists","up"]},{"osd":2,"uuid":"8e25e2db-5b96-49e8-84c8-f2c1aec51ca2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6817","nonce":4016938445}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6819","nonce":4016938445}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6823","nonce":4016938445}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":4016938445},{"type":"v1","addr":"172.21.15.99:6821","nonce":4016938445}]},"public_addr":"172.21.15.99:6817/4016938445","cluster_addr":"172.21.15.99:6819/4016938445","heartbeat_back_addr":"172.21.15.99:6823/4016938445","heartbeat_front_addr":"172.21.15.99:6821/4016938445","state":["exists","up"]},{"osd":3,"uuid":"007bc137-a3a2-40a8-8133-e899cdc6b3d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6825","nonce":1667351160}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6827","nonce":1667351160}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6831","nonce":1667351160}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":1667351160},{"type":"v1","addr":"172.21.15.99:6829","nonce":1667351160}]},"public_addr":"172.21.15.99:6825/1667351160","cluster_addr":"172.21.15.99:6827/1667351160","heartbeat_back_addr":"172.21.15.99:6831/1667351160","heartbeat_front_addr":"172.21.15.99:6829/1667351160","state":["exists","up"]},{"osd":4,"uuid":"7883a376-330f-4123-9d53-b2d16009b55f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6825","nonce":1728711275}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6827","nonce":1728711275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6831","nonce":1728711275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1728711275},{"type":"v1","addr":"172.21.15.159:6829","nonce":1728711275}]},"public_addr":"172.21.15.159:6825/1728711275","cluster_addr":"172.21.15.159:6827/1728711275","heartbeat_back_addr":"172.21.15.159:6831/1728711275","heartbeat_front_addr":"172.21.15.159:6829/1728711275","state":["exists","up"]},{"osd":5,"uuid":"f6fd5c0c-7a4b-47ef-a7e0-417b70da83b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6801","nonce":1301853491}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6803","nonce":1301853491}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6807","nonce":1301853491}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1301853491},{"type":"v1","addr":"172.21.15.159:6805","nonce":1301853491}]},"public_addr":"172.21.15.159:6801/1301853491","cluster_addr":"172.21.15.159:6803/1301853491","heartbeat_back_addr":"172.21.15.159:6807/1301853491","heartbeat_front_addr":"172.21.15.159:6805/1301853491","state":["exists","up"]},{"osd":6,"uuid":"54a77e0e-03c3-44d4-baed-702a89305ed8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6817","nonce":1076897158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6819","nonce":1076897158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6823","nonce":1076897158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1076897158},{"type":"v1","addr":"172.21.15.159:6821","nonce":1076897158}]},"public_addr":"172.21.15.159:6817/1076897158","cluster_addr":"172.21.15.159:6819/1076897158","heartbeat_back_addr":"172.21.15.159:6823/1076897158","heartbeat_front_addr":"172.21.15.159:6821/1076897158","state":["exists","up"]},{"osd":7,"uuid":"fd400894-7e05-4aab-8a22-5b2f345ee140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6809","nonce":989502281}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6811","nonce":989502281}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6815","nonce":989502281}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":989502281},{"type":"v1","addr":"172.21.15.159:6813","nonce":989502281}]},"public_addr":"172.21.15.159:6809/989502281","cluster_addr":"172.21.15.159:6811/989502281","heartbeat_back_addr":"172.21.15.159:6815/989502281","heartbeat_front_addr":"172.21.15.159:6813/989502281","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.432506+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.341537+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.717485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.180863+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.655023+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.691365+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:54.099394+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T15:24:53.913170+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.32","osds":[0,1]}],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":7}]},{"pgid":"3.3f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T15:28:01.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-10T15:28:02.017 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T15:28:02.018 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:02.179 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:02.179 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:02.179 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:02.194 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T15:28:02.470 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T15:28:02.489 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T15:28:02.489 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:02.632 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:02.632 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:02.632 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:02.648 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T15:28:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T15:28:02.963 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T15:28:02.963 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:03.111 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:03.111 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:03.111 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:03.127 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T15:28:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T15:28:03.426 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T15:28:03.426 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:03.566 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:03.566 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:03.566 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:03.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T15:28:03.878 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T15:28:03.896 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T15:28:03.896 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:04.046 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:04.046 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:04.046 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:04.062 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T15:28:04.341 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T15:28:04.359 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T15:28:04.359 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:04.506 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:04.506 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:04.506 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:04.522 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T15:28:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T15:28:04.814 INFO:tasks.ceph:Scrubbing osd.6 2024-09-10T15:28:04.814 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:04.952 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:04.952 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:04.952 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:04.967 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-10T15:28:05.246 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-09-10T15:28:05.264 INFO:tasks.ceph:Scrubbing osd.7 2024-09-10T15:28:05.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-10T15:28:05.410 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-09-10T15:28:05.411 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T15:28:05.411 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-09-10T15:28:05.426 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-10T15:28:05.721 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-09-10T15:28:05.740 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:28:06.067 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:28:06.073 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:28:06.085 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-10T15:28:04.984358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":4613,"num_read_kb":2051672,"num_write":3896,"num_write_kb":2051115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2584,"ondisk_log_size":2584,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260024,"kb_used_data":10192,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714696,"statfs":{"total":773094113280,"available":772827848704,"internally_reserved":0,"allocated":10436608,"data_stored":6224172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1635890209,"num_objects":-440,"num_object_clones":0,"num_object_copies":-880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-440,"num_whiteouts":0,"num_read":738,"num_read_kb":678,"num_write":566,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005940"},"pg_stats":[{"pgid":"3.3f","version":"94'12","reported_seq":115,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.327026+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:59.327026+0000","last_peered":"2024-09-10T15:27:59.327026+0000","last_clean":"2024-09-10T15:27:59.327026+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:59.327026+0000","last_undegraded":"2024-09-10T15:27:59.327026+0000","last_fullsized":"2024-09-10T15:27:59.327026+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:35.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.184755+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:43.184755+0000","last_peered":"2024-09-10T15:27:43.184755+0000","last_clean":"2024-09-10T15:27:43.184755+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:43.184755+0000","last_undegraded":"2024-09-10T15:27:43.184755+0000","last_fullsized":"2024-09-10T15:27:43.184755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"94'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.107298+0000","last_change":"2024-09-10T15:25:11.858279+0000","last_active":"2024-09-10T15:27:59.107298+0000","last_peered":"2024-09-10T15:27:59.107298+0000","last_clean":"2024-09-10T15:27:59.107298+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:27:59.107298+0000","last_undegraded":"2024-09-10T15:27:59.107298+0000","last_fullsized":"2024-09-10T15:27:59.107298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:45.139625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415253+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:28.415253+0000","last_peered":"2024-09-10T15:27:28.415253+0000","last_clean":"2024-09-10T15:27:28.415253+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:28.415253+0000","last_undegraded":"2024-09-10T15:27:28.415253+0000","last_fullsized":"2024-09-10T15:27:28.415253+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:25.262559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"94'24","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.349954+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:59.349954+0000","last_peered":"2024-09-10T15:27:59.349954+0000","last_clean":"2024-09-10T15:27:59.349954+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:59.349954+0000","last_undegraded":"2024-09-10T15:27:59.349954+0000","last_fullsized":"2024-09-10T15:27:59.349954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:23.341728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415252+0000","last_change":"2024-09-10T15:25:13.836648+0000","last_active":"2024-09-10T15:27:28.415252+0000","last_peered":"2024-09-10T15:27:28.415252+0000","last_clean":"2024-09-10T15:27:28.415252+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:27:28.415252+0000","last_undegraded":"2024-09-10T15:27:28.415252+0000","last_fullsized":"2024-09-10T15:27:28.415252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:49.658454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"94'4","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.959143+0000","last_change":"2024-09-10T15:25:11.822510+0000","last_active":"2024-09-10T15:27:58.959143+0000","last_peered":"2024-09-10T15:27:58.959143+0000","last_clean":"2024-09-10T15:27:58.959143+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:27:58.959143+0000","last_undegraded":"2024-09-10T15:27:58.959143+0000","last_fullsized":"2024-09-10T15:27:58.959143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315716+0000","last_change":"2024-09-10T15:25:13.843065+0000","last_active":"2024-09-10T15:27:28.315716+0000","last_peered":"2024-09-10T15:27:28.315716+0000","last_clean":"2024-09-10T15:27:28.315716+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:27:28.315716+0000","last_undegraded":"2024-09-10T15:27:28.315716+0000","last_fullsized":"2024-09-10T15:27:28.315716+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:10.142232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"94'24","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.246009+0000","last_change":"2024-09-10T15:25:11.848701+0000","last_active":"2024-09-10T15:27:59.246009+0000","last_peered":"2024-09-10T15:27:59.246009+0000","last_clean":"2024-09-10T15:27:59.246009+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:27:59.246009+0000","last_undegraded":"2024-09-10T15:27:59.246009+0000","last_fullsized":"2024-09-10T15:27:59.246009+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":45074,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314409+0000","last_change":"2024-09-10T15:25:13.847627+0000","last_active":"2024-09-10T15:27:28.314409+0000","last_peered":"2024-09-10T15:27:28.314409+0000","last_clean":"2024-09-10T15:27:28.314409+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:27:28.314409+0000","last_undegraded":"2024-09-10T15:27:28.314409+0000","last_fullsized":"2024-09-10T15:27:28.314409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"94'18","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.215818+0000","last_change":"2024-09-10T15:25:11.822377+0000","last_active":"2024-09-10T15:27:59.215818+0000","last_peered":"2024-09-10T15:27:59.215818+0000","last_clean":"2024-09-10T15:27:59.215818+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:27:59.215818+0000","last_undegraded":"2024-09-10T15:27:59.215818+0000","last_fullsized":"2024-09-10T15:27:59.215818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315826+0000","last_change":"2024-09-10T15:25:13.874088+0000","last_active":"2024-09-10T15:27:28.315826+0000","last_peered":"2024-09-10T15:27:28.315826+0000","last_clean":"2024-09-10T15:27:28.315826+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:27:28.315826+0000","last_undegraded":"2024-09-10T15:27:28.315826+0000","last_fullsized":"2024-09-10T15:27:28.315826+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"94'12","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.370020+0000","last_change":"2024-09-10T15:25:11.834673+0000","last_active":"2024-09-10T15:27:59.370020+0000","last_peered":"2024-09-10T15:27:59.370020+0000","last_clean":"2024-09-10T15:27:59.370020+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:27:59.370020+0000","last_undegraded":"2024-09-10T15:27:59.370020+0000","last_fullsized":"2024-09-10T15:27:59.370020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341680+0000","last_change":"2024-09-10T15:25:13.842694+0000","last_active":"2024-09-10T15:27:28.341680+0000","last_peered":"2024-09-10T15:27:28.341680+0000","last_clean":"2024-09-10T15:27:28.341680+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:27:28.341680+0000","last_undegraded":"2024-09-10T15:27:28.341680+0000","last_fullsized":"2024-09-10T15:27:28.341680+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"94'18","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.094719+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:59.094719+0000","last_peered":"2024-09-10T15:27:59.094719+0000","last_clean":"2024-09-10T15:27:59.094719+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:59.094719+0000","last_undegraded":"2024-09-10T15:27:59.094719+0000","last_fullsized":"2024-09-10T15:27:59.094719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697665+0000","last_change":"2024-09-10T15:25:13.877688+0000","last_active":"2024-09-10T15:27:28.697665+0000","last_peered":"2024-09-10T15:27:28.697665+0000","last_clean":"2024-09-10T15:27:28.697665+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:27:28.697665+0000","last_undegraded":"2024-09-10T15:27:28.697665+0000","last_fullsized":"2024-09-10T15:27:28.697665+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:37.232489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415085+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:28.415085+0000","last_peered":"2024-09-10T15:27:28.415085+0000","last_clean":"2024-09-10T15:27:28.415085+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:28.415085+0000","last_undegraded":"2024-09-10T15:27:28.415085+0000","last_fullsized":"2024-09-10T15:27:28.415085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:12.712253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"94'16","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.365558+0000","last_change":"2024-09-10T15:25:11.836952+0000","last_active":"2024-09-10T15:27:59.365558+0000","last_peered":"2024-09-10T15:27:59.365558+0000","last_clean":"2024-09-10T15:27:59.365558+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:27:59.365558+0000","last_undegraded":"2024-09-10T15:27:59.365558+0000","last_fullsized":"2024-09-10T15:27:59.365558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.185522+0000","last_change":"2024-09-10T15:25:13.859415+0000","last_active":"2024-09-10T15:27:33.185522+0000","last_peered":"2024-09-10T15:27:33.185522+0000","last_clean":"2024-09-10T15:27:33.185522+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:27:33.185522+0000","last_undegraded":"2024-09-10T15:27:33.185522+0000","last_fullsized":"2024-09-10T15:27:33.185522+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.270936+0000","last_change":"2024-09-10T15:25:11.849584+0000","last_active":"2024-09-10T15:27:59.270936+0000","last_peered":"2024-09-10T15:27:59.270936+0000","last_clean":"2024-09-10T15:27:59.270936+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:27:59.270936+0000","last_undegraded":"2024-09-10T15:27:59.270936+0000","last_fullsized":"2024-09-10T15:27:59.270936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.182939+0000","last_change":"2024-09-10T15:25:13.870171+0000","last_active":"2024-09-10T15:27:33.182939+0000","last_peered":"2024-09-10T15:27:33.182939+0000","last_clean":"2024-09-10T15:27:33.182939+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:27:33.182939+0000","last_undegraded":"2024-09-10T15:27:33.182939+0000","last_fullsized":"2024-09-10T15:27:33.182939+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"94'20","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.377902+0000","last_change":"2024-09-10T15:25:11.843165+0000","last_active":"2024-09-10T15:27:59.377902+0000","last_peered":"2024-09-10T15:27:59.377902+0000","last_clean":"2024-09-10T15:27:59.377902+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:27:59.377902+0000","last_undegraded":"2024-09-10T15:27:59.377902+0000","last_fullsized":"2024-09-10T15:27:59.377902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":34816,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333429+0000","last_change":"2024-09-10T15:25:13.866934+0000","last_active":"2024-09-10T15:27:28.333429+0000","last_peered":"2024-09-10T15:27:28.333429+0000","last_clean":"2024-09-10T15:27:28.333429+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:27:28.333429+0000","last_undegraded":"2024-09-10T15:27:28.333429+0000","last_fullsized":"2024-09-10T15:27:28.333429+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'22","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.326576+0000","last_change":"2024-09-10T15:25:11.837999+0000","last_active":"2024-09-10T15:27:59.326576+0000","last_peered":"2024-09-10T15:27:59.326576+0000","last_clean":"2024-09-10T15:27:59.326576+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:27:59.326576+0000","last_undegraded":"2024-09-10T15:27:59.326576+0000","last_fullsized":"2024-09-10T15:27:59.326576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695686+0000","last_change":"2024-09-10T15:25:13.868659+0000","last_active":"2024-09-10T15:27:28.695686+0000","last_peered":"2024-09-10T15:27:28.695686+0000","last_clean":"2024-09-10T15:27:28.695686+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:27:28.695686+0000","last_undegraded":"2024-09-10T15:27:28.695686+0000","last_fullsized":"2024-09-10T15:27:28.695686+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"94'18","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.224119+0000","last_change":"2024-09-10T15:25:11.844370+0000","last_active":"2024-09-10T15:27:59.224119+0000","last_peered":"2024-09-10T15:27:59.224119+0000","last_clean":"2024-09-10T15:27:59.224119+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:27:59.224119+0000","last_undegraded":"2024-09-10T15:27:59.224119+0000","last_fullsized":"2024-09-10T15:27:59.224119+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.183934+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:38.183934+0000","last_peered":"2024-09-10T15:27:38.183934+0000","last_clean":"2024-09-10T15:27:38.183934+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:38.183934+0000","last_undegraded":"2024-09-10T15:27:38.183934+0000","last_fullsized":"2024-09-10T15:27:38.183934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"94'22","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.381164+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:27:59.381164+0000","last_peered":"2024-09-10T15:27:59.381164+0000","last_clean":"2024-09-10T15:27:59.381164+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:27:59.381164+0000","last_undegraded":"2024-09-10T15:27:59.381164+0000","last_fullsized":"2024-09-10T15:27:59.381164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.188356+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:48.188356+0000","last_peered":"2024-09-10T15:27:48.188356+0000","last_clean":"2024-09-10T15:27:48.188356+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:48.188356+0000","last_undegraded":"2024-09-10T15:27:48.188356+0000","last_fullsized":"2024-09-10T15:27:48.188356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333852+0000","last_change":"2024-09-10T15:25:13.860064+0000","last_active":"2024-09-10T15:27:28.333852+0000","last_peered":"2024-09-10T15:27:28.333852+0000","last_clean":"2024-09-10T15:27:28.333852+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:27:28.333852+0000","last_undegraded":"2024-09-10T15:27:28.333852+0000","last_fullsized":"2024-09-10T15:27:28.333852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"94'22","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.295653+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:59.295653+0000","last_peered":"2024-09-10T15:27:59.295653+0000","last_clean":"2024-09-10T15:27:59.295653+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:59.295653+0000","last_undegraded":"2024-09-10T15:27:59.295653+0000","last_fullsized":"2024-09-10T15:27:59.295653+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:05.184735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416694+0000","last_change":"2024-09-10T15:25:15.869666+0000","last_active":"2024-09-10T15:27:28.416694+0000","last_peered":"2024-09-10T15:27:28.416694+0000","last_clean":"2024-09-10T15:27:28.416694+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:27:28.416694+0000","last_undegraded":"2024-09-10T15:27:28.416694+0000","last_fullsized":"2024-09-10T15:27:28.416694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:28:37.511002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"94'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.879391+0000","last_change":"2024-09-10T15:25:17.871502+0000","last_active":"2024-09-10T15:27:58.879391+0000","last_peered":"2024-09-10T15:27:58.879391+0000","last_clean":"2024-09-10T15:27:58.879391+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:27:58.879391+0000","last_undegraded":"2024-09-10T15:27:58.879391+0000","last_fullsized":"2024-09-10T15:27:58.879391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:34.398505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":71,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.186020+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:48.186020+0000","last_peered":"2024-09-10T15:27:48.186020+0000","last_clean":"2024-09-10T15:27:48.186020+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:48.186020+0000","last_undegraded":"2024-09-10T15:27:48.186020+0000","last_fullsized":"2024-09-10T15:27:48.186020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185774+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:48.185774+0000","last_peered":"2024-09-10T15:27:48.185774+0000","last_clean":"2024-09-10T15:27:48.185774+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:48.185774+0000","last_undegraded":"2024-09-10T15:27:48.185774+0000","last_fullsized":"2024-09-10T15:27:48.185774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416344+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:28.416344+0000","last_peered":"2024-09-10T15:27:28.416344+0000","last_clean":"2024-09-10T15:27:28.416344+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:28.416344+0000","last_undegraded":"2024-09-10T15:27:28.416344+0000","last_fullsized":"2024-09-10T15:27:28.416344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:04:56.435523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"94'16","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.338022+0000","last_change":"2024-09-10T15:25:11.841221+0000","last_active":"2024-09-10T15:27:59.338022+0000","last_peered":"2024-09-10T15:27:59.338022+0000","last_clean":"2024-09-10T15:27:59.338022+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:27:59.338022+0000","last_undegraded":"2024-09-10T15:27:59.338022+0000","last_fullsized":"2024-09-10T15:27:59.338022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314735+0000","last_change":"2024-09-10T15:25:15.851241+0000","last_active":"2024-09-10T15:27:28.314735+0000","last_peered":"2024-09-10T15:27:28.314735+0000","last_clean":"2024-09-10T15:27:28.314735+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:27:28.314735+0000","last_undegraded":"2024-09-10T15:27:28.314735+0000","last_fullsized":"2024-09-10T15:27:28.314735+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:27.269452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.184923+0000","last_change":"2024-09-10T15:25:17.867051+0000","last_active":"2024-09-10T15:27:43.184923+0000","last_peered":"2024-09-10T15:27:43.184923+0000","last_clean":"2024-09-10T15:27:43.184923+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:27:43.184923+0000","last_undegraded":"2024-09-10T15:27:43.184923+0000","last_fullsized":"2024-09-10T15:27:43.184923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185941+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:48.185941+0000","last_peered":"2024-09-10T15:27:48.185941+0000","last_clean":"2024-09-10T15:27:48.185941+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:48.185941+0000","last_undegraded":"2024-09-10T15:27:48.185941+0000","last_fullsized":"2024-09-10T15:27:48.185941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331754+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:28.331754+0000","last_peered":"2024-09-10T15:27:28.331754+0000","last_clean":"2024-09-10T15:27:28.331754+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:28.331754+0000","last_undegraded":"2024-09-10T15:27:28.331754+0000","last_fullsized":"2024-09-10T15:27:28.331754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696836+0000","last_change":"2024-09-10T15:25:13.862653+0000","last_active":"2024-09-10T15:27:28.696836+0000","last_peered":"2024-09-10T15:27:28.696836+0000","last_clean":"2024-09-10T15:27:28.696836+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:27:28.696836+0000","last_undegraded":"2024-09-10T15:27:28.696836+0000","last_fullsized":"2024-09-10T15:27:28.696836+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'24","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.297400+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:59.297400+0000","last_peered":"2024-09-10T15:27:59.297400+0000","last_clean":"2024-09-10T15:27:59.297400+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:59.297400+0000","last_undegraded":"2024-09-10T15:27:59.297400+0000","last_fullsized":"2024-09-10T15:27:59.297400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:05.839335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315726+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:28.315726+0000","last_peered":"2024-09-10T15:27:28.315726+0000","last_clean":"2024-09-10T15:27:28.315726+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:28.315726+0000","last_undegraded":"2024-09-10T15:27:28.315726+0000","last_fullsized":"2024-09-10T15:27:28.315726+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:15.310561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314442+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:28.314442+0000","last_peered":"2024-09-10T15:27:28.314442+0000","last_clean":"2024-09-10T15:27:28.314442+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:28.314442+0000","last_undegraded":"2024-09-10T15:27:28.314442+0000","last_fullsized":"2024-09-10T15:27:28.314442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:28.791838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'18","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.678689+0000","last_change":"2024-09-10T15:25:19.887406+0000","last_active":"2024-09-10T15:27:58.678689+0000","last_peered":"2024-09-10T15:27:58.678689+0000","last_clean":"2024-09-10T15:27:58.678689+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:27:58.678689+0000","last_undegraded":"2024-09-10T15:27:58.678689+0000","last_fullsized":"2024-09-10T15:27:58.678689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:12:45.220125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340622+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:28.340622+0000","last_peered":"2024-09-10T15:27:28.340622+0000","last_clean":"2024-09-10T15:27:28.340622+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:28.340622+0000","last_undegraded":"2024-09-10T15:27:28.340622+0000","last_fullsized":"2024-09-10T15:27:28.340622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:05:48.156325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696983+0000","last_change":"2024-09-10T15:25:13.867183+0000","last_active":"2024-09-10T15:27:28.696983+0000","last_peered":"2024-09-10T15:27:28.696983+0000","last_clean":"2024-09-10T15:27:28.696983+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:27:28.696983+0000","last_undegraded":"2024-09-10T15:27:28.696983+0000","last_fullsized":"2024-09-10T15:27:28.696983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:16.457391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"94'12","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.156811+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:59.156811+0000","last_peered":"2024-09-10T15:27:59.156811+0000","last_clean":"2024-09-10T15:27:59.156811+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:59.156811+0000","last_undegraded":"2024-09-10T15:27:59.156811+0000","last_fullsized":"2024-09-10T15:27:59.156811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20492,"num_write":32,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416291+0000","last_change":"2024-09-10T15:25:15.864767+0000","last_active":"2024-09-10T15:27:28.416291+0000","last_peered":"2024-09-10T15:27:28.416291+0000","last_clean":"2024-09-10T15:27:28.416291+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:27:28.416291+0000","last_undegraded":"2024-09-10T15:27:28.416291+0000","last_fullsized":"2024-09-10T15:27:28.416291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:26:45.596093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"94'22","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.384820+0000","last_change":"2024-09-10T15:25:17.865124+0000","last_active":"2024-09-10T15:27:59.384820+0000","last_peered":"2024-09-10T15:27:59.384820+0000","last_clean":"2024-09-10T15:27:59.384820+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:27:59.384820+0000","last_undegraded":"2024-09-10T15:27:59.384820+0000","last_fullsized":"2024-09-10T15:27:59.384820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:02.750873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":74,"num_write":28,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.688981+0000","last_change":"2024-09-10T15:25:19.887372+0000","last_active":"2024-09-10T15:27:58.688981+0000","last_peered":"2024-09-10T15:27:58.688981+0000","last_clean":"2024-09-10T15:27:58.688981+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:27:58.688981+0000","last_undegraded":"2024-09-10T15:27:58.688981+0000","last_fullsized":"2024-09-10T15:27:58.688981+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:30.798359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415061+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415061+0000","last_peered":"2024-09-10T15:27:28.415061+0000","last_clean":"2024-09-10T15:27:28.415061+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415061+0000","last_undegraded":"2024-09-10T15:27:28.415061+0000","last_fullsized":"2024-09-10T15:27:28.415061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:38.955445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"94'10","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.311950+0000","last_change":"2024-09-10T15:25:11.841715+0000","last_active":"2024-09-10T15:27:59.311950+0000","last_peered":"2024-09-10T15:27:59.311950+0000","last_clean":"2024-09-10T15:27:59.311950+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:27:59.311950+0000","last_undegraded":"2024-09-10T15:27:59.311950+0000","last_fullsized":"2024-09-10T15:27:59.311950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16396,"num_write":30,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947337+0000","last_change":"2024-09-10T15:25:15.851909+0000","last_active":"2024-09-10T15:27:28.947337+0000","last_peered":"2024-09-10T15:27:28.947337+0000","last_clean":"2024-09-10T15:27:28.947337+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:27:28.947337+0000","last_undegraded":"2024-09-10T15:27:28.947337+0000","last_fullsized":"2024-09-10T15:27:28.947337+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'27","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.996542+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:58.996542+0000","last_peered":"2024-09-10T15:27:58.996542+0000","last_clean":"2024-09-10T15:27:58.996542+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:58.996542+0000","last_undegraded":"2024-09-10T15:27:58.996542+0000","last_fullsized":"2024-09-10T15:27:58.996542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332970+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:28.332970+0000","last_peered":"2024-09-10T15:27:28.332970+0000","last_clean":"2024-09-10T15:27:28.332970+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:28.332970+0000","last_undegraded":"2024-09-10T15:27:28.332970+0000","last_fullsized":"2024-09-10T15:27:28.332970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:02.460487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341427+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341427+0000","last_peered":"2024-09-10T15:27:28.341427+0000","last_clean":"2024-09-10T15:27:28.341427+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341427+0000","last_undegraded":"2024-09-10T15:27:28.341427+0000","last_fullsized":"2024-09-10T15:27:28.341427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:35.589437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947423+0000","last_change":"2024-09-10T15:25:13.866851+0000","last_active":"2024-09-10T15:27:28.947423+0000","last_peered":"2024-09-10T15:27:28.947423+0000","last_clean":"2024-09-10T15:27:28.947423+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:27:28.947423+0000","last_undegraded":"2024-09-10T15:27:28.947423+0000","last_fullsized":"2024-09-10T15:27:28.947423+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"94'20","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.172000+0000","last_change":"2024-09-10T15:25:11.848854+0000","last_active":"2024-09-10T15:27:59.172000+0000","last_peered":"2024-09-10T15:27:59.172000+0000","last_clean":"2024-09-10T15:27:59.172000+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:27:59.172000+0000","last_undegraded":"2024-09-10T15:27:59.172000+0000","last_fullsized":"2024-09-10T15:27:59.172000+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32786,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331759+0000","last_change":"2024-09-10T15:25:15.853914+0000","last_active":"2024-09-10T15:27:28.331759+0000","last_peered":"2024-09-10T15:27:28.331759+0000","last_clean":"2024-09-10T15:27:28.331759+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:27:28.331759+0000","last_undegraded":"2024-09-10T15:27:28.331759+0000","last_fullsized":"2024-09-10T15:27:28.331759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:12.149125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"94'19","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.189810+0000","last_change":"2024-09-10T15:25:17.869831+0000","last_active":"2024-09-10T15:27:59.189810+0000","last_peered":"2024-09-10T15:27:59.189810+0000","last_clean":"2024-09-10T15:27:59.189810+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:27:59.189810+0000","last_undegraded":"2024-09-10T15:27:59.189810+0000","last_fullsized":"2024-09-10T15:27:59.189810+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:02.437642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313553+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:28.313553+0000","last_peered":"2024-09-10T15:27:28.313553+0000","last_clean":"2024-09-10T15:27:28.313553+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:28.313553+0000","last_undegraded":"2024-09-10T15:27:28.313553+0000","last_fullsized":"2024-09-10T15:27:28.313553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:41:35.536421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947853+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947853+0000","last_peered":"2024-09-10T15:27:28.947853+0000","last_clean":"2024-09-10T15:27:28.947853+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947853+0000","last_undegraded":"2024-09-10T15:27:28.947853+0000","last_fullsized":"2024-09-10T15:27:28.947853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340664+0000","last_change":"2024-09-10T15:25:13.841622+0000","last_active":"2024-09-10T15:27:28.340664+0000","last_peered":"2024-09-10T15:27:28.340664+0000","last_clean":"2024-09-10T15:27:28.340664+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:27:28.340664+0000","last_undegraded":"2024-09-10T15:27:28.340664+0000","last_fullsized":"2024-09-10T15:27:28.340664+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"94'14","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.223305+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:59.223305+0000","last_peered":"2024-09-10T15:27:59.223305+0000","last_clean":"2024-09-10T15:27:59.223305+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:59.223305+0000","last_undegraded":"2024-09-10T15:27:59.223305+0000","last_fullsized":"2024-09-10T15:27:59.223305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:52.534210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695255+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:28.695255+0000","last_peered":"2024-09-10T15:27:28.695255+0000","last_clean":"2024-09-10T15:27:28.695255+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:28.695255+0000","last_undegraded":"2024-09-10T15:27:28.695255+0000","last_fullsized":"2024-09-10T15:27:28.695255+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"94'26","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.021721+0000","last_change":"2024-09-10T15:25:17.862962+0000","last_active":"2024-09-10T15:27:59.021721+0000","last_peered":"2024-09-10T15:27:59.021721+0000","last_clean":"2024-09-10T15:27:59.021721+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:27:59.021721+0000","last_undegraded":"2024-09-10T15:27:59.021721+0000","last_fullsized":"2024-09-10T15:27:59.021721+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:47:57.786754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'18","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.691090+0000","last_change":"2024-09-10T15:25:19.881573+0000","last_active":"2024-09-10T15:27:58.691090+0000","last_peered":"2024-09-10T15:27:58.691090+0000","last_clean":"2024-09-10T15:27:58.691090+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:27:58.691090+0000","last_undegraded":"2024-09-10T15:27:58.691090+0000","last_fullsized":"2024-09-10T15:27:58.691090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:43.048379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334472+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:28.334472+0000","last_peered":"2024-09-10T15:27:28.334472+0000","last_clean":"2024-09-10T15:27:28.334472+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:28.334472+0000","last_undegraded":"2024-09-10T15:27:28.334472+0000","last_fullsized":"2024-09-10T15:27:28.334472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:32:38.419338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696128+0000","last_change":"2024-09-10T15:25:13.868808+0000","last_active":"2024-09-10T15:27:28.696128+0000","last_peered":"2024-09-10T15:27:28.696128+0000","last_clean":"2024-09-10T15:27:28.696128+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:27:28.696128+0000","last_undegraded":"2024-09-10T15:27:28.696128+0000","last_fullsized":"2024-09-10T15:27:28.696128+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:00.660271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"94'20","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.338421+0000","last_change":"2024-09-10T15:25:11.834596+0000","last_active":"2024-09-10T15:27:59.338421+0000","last_peered":"2024-09-10T15:27:59.338421+0000","last_clean":"2024-09-10T15:27:59.338421+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:27:59.338421+0000","last_undegraded":"2024-09-10T15:27:59.338421+0000","last_fullsized":"2024-09-10T15:27:59.338421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332058+0000","last_change":"2024-09-10T15:25:15.851740+0000","last_active":"2024-09-10T15:27:28.332058+0000","last_peered":"2024-09-10T15:27:28.332058+0000","last_clean":"2024-09-10T15:27:28.332058+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:27:28.332058+0000","last_undegraded":"2024-09-10T15:27:28.332058+0000","last_fullsized":"2024-09-10T15:27:28.332058+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:10.159168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"94'33","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.262305+0000","last_change":"2024-09-10T15:25:17.869873+0000","last_active":"2024-09-10T15:27:59.262305+0000","last_peered":"2024-09-10T15:27:59.262305+0000","last_clean":"2024-09-10T15:27:59.262305+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:27:59.262305+0000","last_undegraded":"2024-09-10T15:27:59.262305+0000","last_fullsized":"2024-09-10T15:27:59.262305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:06:31.568604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":103,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694615+0000","last_change":"2024-09-10T15:25:19.883932+0000","last_active":"2024-09-10T15:27:28.694615+0000","last_peered":"2024-09-10T15:27:28.694615+0000","last_clean":"2024-09-10T15:27:28.694615+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:27:28.694615+0000","last_undegraded":"2024-09-10T15:27:28.694615+0000","last_fullsized":"2024-09-10T15:27:28.694615+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:04.444163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492786+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:28.492786+0000","last_peered":"2024-09-10T15:27:28.492786+0000","last_clean":"2024-09-10T15:27:28.492786+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:28.492786+0000","last_undegraded":"2024-09-10T15:27:28.492786+0000","last_fullsized":"2024-09-10T15:27:28.492786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:04.474800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315358+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.315358+0000","last_peered":"2024-09-10T15:27:28.315358+0000","last_clean":"2024-09-10T15:27:28.315358+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:27:28.315358+0000","last_undegraded":"2024-09-10T15:27:28.315358+0000","last_fullsized":"2024-09-10T15:27:28.315358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"94'22","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.299974+0000","last_change":"2024-09-10T15:25:11.858561+0000","last_active":"2024-09-10T15:27:59.299974+0000","last_peered":"2024-09-10T15:27:59.299974+0000","last_clean":"2024-09-10T15:27:59.299974+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:27:59.299974+0000","last_undegraded":"2024-09-10T15:27:59.299974+0000","last_fullsized":"2024-09-10T15:27:59.299974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:57.192127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491267+0000","last_change":"2024-09-10T15:25:15.860393+0000","last_active":"2024-09-10T15:27:28.491267+0000","last_peered":"2024-09-10T15:27:28.491267+0000","last_clean":"2024-09-10T15:27:28.491267+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:27:28.491267+0000","last_undegraded":"2024-09-10T15:27:28.491267+0000","last_fullsized":"2024-09-10T15:27:28.491267+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:56.516468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"94'22","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.275517+0000","last_change":"2024-09-10T15:25:17.868778+0000","last_active":"2024-09-10T15:27:59.275517+0000","last_peered":"2024-09-10T15:27:59.275517+0000","last_clean":"2024-09-10T15:27:59.275517+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:27:59.275517+0000","last_undegraded":"2024-09-10T15:27:59.275517+0000","last_fullsized":"2024-09-10T15:27:59.275517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489636+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:28.489636+0000","last_peered":"2024-09-10T15:27:28.489636+0000","last_clean":"2024-09-10T15:27:28.489636+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:28.489636+0000","last_undegraded":"2024-09-10T15:27:28.489636+0000","last_fullsized":"2024-09-10T15:27:28.489636+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:43.257453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693570+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693570+0000","last_peered":"2024-09-10T15:27:28.693570+0000","last_clean":"2024-09-10T15:27:28.693570+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693570+0000","last_undegraded":"2024-09-10T15:27:28.693570+0000","last_fullsized":"2024-09-10T15:27:28.693570+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:23:01.973050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416540+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416540+0000","last_peered":"2024-09-10T15:27:28.416540+0000","last_clean":"2024-09-10T15:27:28.416540+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416540+0000","last_undegraded":"2024-09-10T15:27:28.416540+0000","last_fullsized":"2024-09-10T15:27:28.416540+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:13.303668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"94'10","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.180384+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:59.180384+0000","last_peered":"2024-09-10T15:27:59.180384+0000","last_clean":"2024-09-10T15:27:59.180384+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:59.180384+0000","last_undegraded":"2024-09-10T15:27:59.180384+0000","last_fullsized":"2024-09-10T15:27:59.180384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:00.861281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696187+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:28.696187+0000","last_peered":"2024-09-10T15:27:28.696187+0000","last_clean":"2024-09-10T15:27:28.696187+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:28.696187+0000","last_undegraded":"2024-09-10T15:27:28.696187+0000","last_fullsized":"2024-09-10T15:27:28.696187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"94'23","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.135096+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:59.135096+0000","last_peered":"2024-09-10T15:27:59.135096+0000","last_clean":"2024-09-10T15:27:59.135096+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:59.135096+0000","last_undegraded":"2024-09-10T15:27:59.135096+0000","last_fullsized":"2024-09-10T15:27:59.135096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:17.322112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'18","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.680639+0000","last_change":"2024-09-10T15:25:19.885097+0000","last_active":"2024-09-10T15:27:58.680639+0000","last_peered":"2024-09-10T15:27:58.680639+0000","last_clean":"2024-09-10T15:27:58.680639+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:27:58.680639+0000","last_undegraded":"2024-09-10T15:27:58.680639+0000","last_fullsized":"2024-09-10T15:27:58.680639+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:22.482355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331612+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331612+0000","last_peered":"2024-09-10T15:27:28.331612+0000","last_clean":"2024-09-10T15:27:28.331612+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331612+0000","last_undegraded":"2024-09-10T15:27:28.331612+0000","last_fullsized":"2024-09-10T15:27:28.331612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341512+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341512+0000","last_peered":"2024-09-10T15:27:28.341512+0000","last_clean":"2024-09-10T15:27:28.341512+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341512+0000","last_undegraded":"2024-09-10T15:27:28.341512+0000","last_fullsized":"2024-09-10T15:27:28.341512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"94'16","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.225369+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:59.225369+0000","last_peered":"2024-09-10T15:27:59.225369+0000","last_clean":"2024-09-10T15:27:59.225369+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:59.225369+0000","last_undegraded":"2024-09-10T15:27:59.225369+0000","last_fullsized":"2024-09-10T15:27:59.225369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:19.450283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.668048+0000","last_change":"2024-09-10T15:25:15.851115+0000","last_active":"2024-09-10T15:27:58.668048+0000","last_peered":"2024-09-10T15:27:58.668048+0000","last_clean":"2024-09-10T15:27:58.668048+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:27:58.668048+0000","last_undegraded":"2024-09-10T15:27:58.668048+0000","last_fullsized":"2024-09-10T15:27:58.668048+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333326+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:28.333326+0000","last_peered":"2024-09-10T15:27:28.333326+0000","last_clean":"2024-09-10T15:27:28.333326+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:28.333326+0000","last_undegraded":"2024-09-10T15:27:28.333326+0000","last_fullsized":"2024-09-10T15:27:28.333326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:16.663174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'18","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.397136+0000","last_change":"2024-09-10T15:25:19.876680+0000","last_active":"2024-09-10T15:27:59.397136+0000","last_peered":"2024-09-10T15:27:59.397136+0000","last_clean":"2024-09-10T15:27:59.397136+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:27:59.397136+0000","last_undegraded":"2024-09-10T15:27:59.397136+0000","last_fullsized":"2024-09-10T15:27:59.397136+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340473+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340473+0000","last_peered":"2024-09-10T15:27:28.340473+0000","last_clean":"2024-09-10T15:27:28.340473+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340473+0000","last_undegraded":"2024-09-10T15:27:28.340473+0000","last_fullsized":"2024-09-10T15:27:28.340473+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:40.541523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493307+0000","last_change":"2024-09-10T15:25:13.869348+0000","last_active":"2024-09-10T15:27:28.493307+0000","last_peered":"2024-09-10T15:27:28.493307+0000","last_clean":"2024-09-10T15:27:28.493307+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:27:28.493307+0000","last_undegraded":"2024-09-10T15:27:28.493307+0000","last_fullsized":"2024-09-10T15:27:28.493307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:57:47.158396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"94'18","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.370003+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:59.370003+0000","last_peered":"2024-09-10T15:27:59.370003+0000","last_clean":"2024-09-10T15:27:59.370003+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:59.370003+0000","last_undegraded":"2024-09-10T15:27:59.370003+0000","last_fullsized":"2024-09-10T15:27:59.370003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:22:55.800048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416759+0000","last_change":"2024-09-10T15:25:15.869644+0000","last_active":"2024-09-10T15:27:28.416759+0000","last_peered":"2024-09-10T15:27:28.416759+0000","last_clean":"2024-09-10T15:27:28.416759+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:27:28.416759+0000","last_undegraded":"2024-09-10T15:27:28.416759+0000","last_fullsized":"2024-09-10T15:27:28.416759+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:58:04.137138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"94'25","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.897517+0000","last_change":"2024-09-10T15:25:17.871001+0000","last_active":"2024-09-10T15:27:58.897517+0000","last_peered":"2024-09-10T15:27:58.897517+0000","last_clean":"2024-09-10T15:27:58.897517+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:27:58.897517+0000","last_undegraded":"2024-09-10T15:27:58.897517+0000","last_fullsized":"2024-09-10T15:27:58.897517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341994+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:28.341994+0000","last_peered":"2024-09-10T15:27:28.341994+0000","last_clean":"2024-09-10T15:27:28.341994+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:28.341994+0000","last_undegraded":"2024-09-10T15:27:28.341994+0000","last_fullsized":"2024-09-10T15:27:28.341994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:44.980409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489952+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.489952+0000","last_peered":"2024-09-10T15:27:28.489952+0000","last_clean":"2024-09-10T15:27:28.489952+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.489952+0000","last_undegraded":"2024-09-10T15:27:28.489952+0000","last_fullsized":"2024-09-10T15:27:28.489952+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:57.697730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416212+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416212+0000","last_peered":"2024-09-10T15:27:28.416212+0000","last_clean":"2024-09-10T15:27:28.416212+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416212+0000","last_undegraded":"2024-09-10T15:27:28.416212+0000","last_fullsized":"2024-09-10T15:27:28.416212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:13:42.992179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":316,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947841+0000","last_change":"2024-09-10T15:25:00.654075+0000","last_active":"2024-09-10T15:27:28.947841+0000","last_peered":"2024-09-10T15:27:28.947841+0000","last_clean":"2024-09-10T15:27:28.947841+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:27:28.947841+0000","last_undegraded":"2024-09-10T15:27:28.947841+0000","last_fullsized":"2024-09-10T15:27:28.947841+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:24:59.310560+0000","last_clean_scrub_stamp":"2024-09-10T15:24:59.310560+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415740+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415740+0000","last_peered":"2024-09-10T15:27:28.415740+0000","last_clean":"2024-09-10T15:27:28.415740+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415740+0000","last_undegraded":"2024-09-10T15:27:28.415740+0000","last_fullsized":"2024-09-10T15:27:28.415740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:42.264776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"94'24","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.083687+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:59.083687+0000","last_peered":"2024-09-10T15:27:59.083687+0000","last_clean":"2024-09-10T15:27:59.083687+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:59.083687+0000","last_undegraded":"2024-09-10T15:27:59.083687+0000","last_fullsized":"2024-09-10T15:27:59.083687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:46.689896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":49176,"num_write":64,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314129+0000","last_change":"2024-09-10T15:25:15.860122+0000","last_active":"2024-09-10T15:27:28.314129+0000","last_peered":"2024-09-10T15:27:28.314129+0000","last_clean":"2024-09-10T15:27:28.314129+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:27:28.314129+0000","last_undegraded":"2024-09-10T15:27:28.314129+0000","last_fullsized":"2024-09-10T15:27:28.314129+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'42","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.109386+0000","last_change":"2024-09-10T15:25:17.868805+0000","last_active":"2024-09-10T15:27:59.109386+0000","last_peered":"2024-09-10T15:27:59.109386+0000","last_clean":"2024-09-10T15:27:59.109386+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:27:59.109386+0000","last_undegraded":"2024-09-10T15:27:59.109386+0000","last_fullsized":"2024-09-10T15:27:59.109386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:24:10.854260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":140,"num_write":50,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693638+0000","last_change":"2024-09-10T15:25:19.894536+0000","last_active":"2024-09-10T15:27:28.693638+0000","last_peered":"2024-09-10T15:27:28.693638+0000","last_clean":"2024-09-10T15:27:28.693638+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:27:28.693638+0000","last_undegraded":"2024-09-10T15:27:28.693638+0000","last_fullsized":"2024-09-10T15:27:28.693638+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:40.380439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.185472+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:33.185472+0000","last_peered":"2024-09-10T15:27:33.185472+0000","last_clean":"2024-09-10T15:27:33.185472+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:33.185472+0000","last_undegraded":"2024-09-10T15:27:33.185472+0000","last_fullsized":"2024-09-10T15:27:33.185472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696870+0000","last_change":"2024-09-10T15:25:13.862045+0000","last_active":"2024-09-10T15:27:28.696870+0000","last_peered":"2024-09-10T15:27:28.696870+0000","last_clean":"2024-09-10T15:27:28.696870+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:27:28.696870+0000","last_undegraded":"2024-09-10T15:27:28.696870+0000","last_fullsized":"2024-09-10T15:27:28.696870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:39:58.732429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415458+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415458+0000","last_peered":"2024-09-10T15:27:28.415458+0000","last_clean":"2024-09-10T15:27:28.415458+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415458+0000","last_undegraded":"2024-09-10T15:27:28.415458+0000","last_fullsized":"2024-09-10T15:27:28.415458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:30.833549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"94'28","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.376140+0000","last_change":"2024-09-10T15:25:11.855735+0000","last_active":"2024-09-10T15:27:59.376140+0000","last_peered":"2024-09-10T15:27:59.376140+0000","last_clean":"2024-09-10T15:27:59.376140+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:27:59.376140+0000","last_undegraded":"2024-09-10T15:27:59.376140+0000","last_fullsized":"2024-09-10T15:27:59.376140+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:39.117435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49164,"num_write":48,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416394+0000","last_change":"2024-09-10T15:25:15.860974+0000","last_active":"2024-09-10T15:27:28.416394+0000","last_peered":"2024-09-10T15:27:28.416394+0000","last_clean":"2024-09-10T15:27:28.416394+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:27:28.416394+0000","last_undegraded":"2024-09-10T15:27:28.416394+0000","last_fullsized":"2024-09-10T15:27:28.416394+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:01.295686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'63","reported_seq":259,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.205872+0000","last_change":"2024-09-10T15:25:17.869953+0000","last_active":"2024-09-10T15:27:59.205872+0000","last_peered":"2024-09-10T15:27:59.205872+0000","last_clean":"2024-09-10T15:27:59.205872+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:27:59.205872+0000","last_undegraded":"2024-09-10T15:27:59.205872+0000","last_fullsized":"2024-09-10T15:27:59.205872+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:12.170718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":106,"num_read_kb":151,"num_write":60,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416482+0000","last_change":"2024-09-10T15:25:19.886735+0000","last_active":"2024-09-10T15:27:28.416482+0000","last_peered":"2024-09-10T15:27:28.416482+0000","last_clean":"2024-09-10T15:27:28.416482+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:27:28.416482+0000","last_undegraded":"2024-09-10T15:27:28.416482+0000","last_fullsized":"2024-09-10T15:27:28.416482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:13:40.307995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.694935+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:28.694935+0000","last_peered":"2024-09-10T15:27:28.694935+0000","last_clean":"2024-09-10T15:27:28.694935+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:28.694935+0000","last_undegraded":"2024-09-10T15:27:28.694935+0000","last_fullsized":"2024-09-10T15:27:28.694935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:16:23.609013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334556+0000","last_change":"2024-09-10T15:25:13.852532+0000","last_active":"2024-09-10T15:27:28.334556+0000","last_peered":"2024-09-10T15:27:28.334556+0000","last_clean":"2024-09-10T15:27:28.334556+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:27:28.334556+0000","last_undegraded":"2024-09-10T15:27:28.334556+0000","last_fullsized":"2024-09-10T15:27:28.334556+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490049+0000","last_change":"2024-09-10T15:25:06.156936+0000","last_active":"2024-09-10T15:27:28.490049+0000","last_peered":"2024-09-10T15:27:28.490049+0000","last_clean":"2024-09-10T15:27:28.490049+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:27:28.490049+0000","last_undegraded":"2024-09-10T15:27:28.490049+0000","last_fullsized":"2024-09-10T15:27:28.490049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"94'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.306331+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:59.306331+0000","last_peered":"2024-09-10T15:27:59.306331+0000","last_clean":"2024-09-10T15:27:59.306331+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:59.306331+0000","last_undegraded":"2024-09-10T15:27:59.306331+0000","last_fullsized":"2024-09-10T15:27:59.306331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492515+0000","last_change":"2024-09-10T15:25:15.860311+0000","last_active":"2024-09-10T15:27:28.492515+0000","last_peered":"2024-09-10T15:27:28.492515+0000","last_clean":"2024-09-10T15:27:28.492515+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:27:28.492515+0000","last_undegraded":"2024-09-10T15:27:28.492515+0000","last_fullsized":"2024-09-10T15:27:28.492515+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:53.546087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'16","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:34.002163+0000","last_change":"2024-09-10T15:25:17.867079+0000","last_active":"2024-09-10T15:27:34.002163+0000","last_peered":"2024-09-10T15:27:34.002163+0000","last_clean":"2024-09-10T15:27:34.002163+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:27:34.002163+0000","last_undegraded":"2024-09-10T15:27:34.002163+0000","last_fullsized":"2024-09-10T15:27:34.002163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314725+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.314725+0000","last_peered":"2024-09-10T15:27:28.314725+0000","last_clean":"2024-09-10T15:27:28.314725+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.314725+0000","last_undegraded":"2024-09-10T15:27:28.314725+0000","last_fullsized":"2024-09-10T15:27:28.314725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:59.958737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314109+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:28.314109+0000","last_peered":"2024-09-10T15:27:28.314109+0000","last_clean":"2024-09-10T15:27:28.314109+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:28.314109+0000","last_undegraded":"2024-09-10T15:27:28.314109+0000","last_fullsized":"2024-09-10T15:27:28.314109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333823+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333823+0000","last_peered":"2024-09-10T15:27:28.333823+0000","last_clean":"2024-09-10T15:27:28.333823+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333823+0000","last_undegraded":"2024-09-10T15:27:28.333823+0000","last_fullsized":"2024-09-10T15:27:28.333823+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:13:07.858106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415593+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415593+0000","last_peered":"2024-09-10T15:27:28.415593+0000","last_clean":"2024-09-10T15:27:28.415593+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415593+0000","last_undegraded":"2024-09-10T15:27:28.415593+0000","last_fullsized":"2024-09-10T15:27:28.415593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:39.196068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"94'14","reported_seq":118,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.227830+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:59.227830+0000","last_peered":"2024-09-10T15:27:59.227830+0000","last_clean":"2024-09-10T15:27:59.227830+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:59.227830+0000","last_undegraded":"2024-09-10T15:27:59.227830+0000","last_fullsized":"2024-09-10T15:27:59.227830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:50:22.754624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491363+0000","last_change":"2024-09-10T15:25:15.869964+0000","last_active":"2024-09-10T15:27:28.491363+0000","last_peered":"2024-09-10T15:27:28.491363+0000","last_clean":"2024-09-10T15:27:28.491363+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:27:28.491363+0000","last_undegraded":"2024-09-10T15:27:28.491363+0000","last_fullsized":"2024-09-10T15:27:28.491363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:50.883769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"35'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696503+0000","last_change":"2024-09-10T15:25:17.876101+0000","last_active":"2024-09-10T15:27:28.696503+0000","last_peered":"2024-09-10T15:27:28.696503+0000","last_clean":"2024-09-10T15:27:28.696503+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:27:28.696503+0000","last_undegraded":"2024-09-10T15:27:28.696503+0000","last_fullsized":"2024-09-10T15:27:28.696503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:29.281003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416993+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:28.416993+0000","last_peered":"2024-09-10T15:27:28.416993+0000","last_clean":"2024-09-10T15:27:28.416993+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:28.416993+0000","last_undegraded":"2024-09-10T15:27:28.416993+0000","last_fullsized":"2024-09-10T15:27:28.416993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:33:09.523645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.182824+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:33.182824+0000","last_peered":"2024-09-10T15:27:33.182824+0000","last_clean":"2024-09-10T15:27:33.182824+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:33.182824+0000","last_undegraded":"2024-09-10T15:27:33.182824+0000","last_fullsized":"2024-09-10T15:27:33.182824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332108+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332108+0000","last_peered":"2024-09-10T15:27:28.332108+0000","last_clean":"2024-09-10T15:27:28.332108+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332108+0000","last_undegraded":"2024-09-10T15:27:28.332108+0000","last_fullsized":"2024-09-10T15:27:28.332108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"94'18","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.300753+0000","last_change":"2024-09-10T15:25:11.847180+0000","last_active":"2024-09-10T15:27:59.300753+0000","last_peered":"2024-09-10T15:27:59.300753+0000","last_clean":"2024-09-10T15:27:59.300753+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:27:59.300753+0000","last_undegraded":"2024-09-10T15:27:59.300753+0000","last_fullsized":"2024-09-10T15:27:59.300753+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697320+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697320+0000","last_peered":"2024-09-10T15:27:28.697320+0000","last_clean":"2024-09-10T15:27:28.697320+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697320+0000","last_undegraded":"2024-09-10T15:27:28.697320+0000","last_fullsized":"2024-09-10T15:27:28.697320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:35:27.644620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314579+0000","last_change":"2024-09-10T15:25:15.853445+0000","last_active":"2024-09-10T15:27:28.314579+0000","last_peered":"2024-09-10T15:27:28.314579+0000","last_clean":"2024-09-10T15:27:28.314579+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:27:28.314579+0000","last_undegraded":"2024-09-10T15:27:28.314579+0000","last_fullsized":"2024-09-10T15:27:28.314579+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:40.962338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"94'36","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.122008+0000","last_change":"2024-09-10T15:25:17.860826+0000","last_active":"2024-09-10T15:27:59.122008+0000","last_peered":"2024-09-10T15:27:59.122008+0000","last_clean":"2024-09-10T15:27:59.122008+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:27:59.122008+0000","last_undegraded":"2024-09-10T15:27:59.122008+0000","last_fullsized":"2024-09-10T15:27:59.122008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:06.898495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":90,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340394+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340394+0000","last_peered":"2024-09-10T15:27:28.340394+0000","last_clean":"2024-09-10T15:27:28.340394+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340394+0000","last_undegraded":"2024-09-10T15:27:28.340394+0000","last_fullsized":"2024-09-10T15:27:28.340394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:18.669694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696197+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:28.696197+0000","last_peered":"2024-09-10T15:27:28.696197+0000","last_clean":"2024-09-10T15:27:28.696197+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:28.696197+0000","last_undegraded":"2024-09-10T15:27:28.696197+0000","last_fullsized":"2024-09-10T15:27:28.696197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:14.381597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333620+0000","last_change":"2024-09-10T15:25:13.853898+0000","last_active":"2024-09-10T15:27:28.333620+0000","last_peered":"2024-09-10T15:27:28.333620+0000","last_clean":"2024-09-10T15:27:28.333620+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:27:28.333620+0000","last_undegraded":"2024-09-10T15:27:28.333620+0000","last_fullsized":"2024-09-10T15:27:28.333620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"94'18","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.285314+0000","last_change":"2024-09-10T15:25:11.854953+0000","last_active":"2024-09-10T15:27:59.285314+0000","last_peered":"2024-09-10T15:27:59.285314+0000","last_clean":"2024-09-10T15:27:59.285314+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:27:59.285314+0000","last_undegraded":"2024-09-10T15:27:59.285314+0000","last_fullsized":"2024-09-10T15:27:59.285314+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414797+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414797+0000","last_peered":"2024-09-10T15:27:28.414797+0000","last_clean":"2024-09-10T15:27:28.414797+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414797+0000","last_undegraded":"2024-09-10T15:27:28.414797+0000","last_fullsized":"2024-09-10T15:27:28.414797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:16:48.908242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313813+0000","last_change":"2024-09-10T15:25:15.863471+0000","last_active":"2024-09-10T15:27:28.313813+0000","last_peered":"2024-09-10T15:27:28.313813+0000","last_clean":"2024-09-10T15:27:28.313813+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:27:28.313813+0000","last_undegraded":"2024-09-10T15:27:28.313813+0000","last_fullsized":"2024-09-10T15:27:28.313813+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331980+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.331980+0000","last_peered":"2024-09-10T15:27:28.331980+0000","last_clean":"2024-09-10T15:27:28.331980+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.331980+0000","last_undegraded":"2024-09-10T15:27:28.331980+0000","last_fullsized":"2024-09-10T15:27:28.331980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:06:41.250932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'18","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.392371+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:59.392371+0000","last_peered":"2024-09-10T15:27:59.392371+0000","last_clean":"2024-09-10T15:27:59.392371+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:59.392371+0000","last_undegraded":"2024-09-10T15:27:59.392371+0000","last_fullsized":"2024-09-10T15:27:59.392371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492360+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:28.492360+0000","last_peered":"2024-09-10T15:27:28.492360+0000","last_clean":"2024-09-10T15:27:28.492360+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:28.492360+0000","last_undegraded":"2024-09-10T15:27:28.492360+0000","last_fullsized":"2024-09-10T15:27:28.492360+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:21.342945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313734+0000","last_change":"2024-09-10T15:25:13.846660+0000","last_active":"2024-09-10T15:27:28.313734+0000","last_peered":"2024-09-10T15:27:28.313734+0000","last_clean":"2024-09-10T15:27:28.313734+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:27:28.313734+0000","last_undegraded":"2024-09-10T15:27:28.313734+0000","last_fullsized":"2024-09-10T15:27:28.313734+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:19.646679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"94'20","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.308592+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:59.308592+0000","last_peered":"2024-09-10T15:27:59.308592+0000","last_clean":"2024-09-10T15:27:59.308592+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:59.308592+0000","last_undegraded":"2024-09-10T15:27:59.308592+0000","last_fullsized":"2024-09-10T15:27:59.308592+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316149+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316149+0000","last_peered":"2024-09-10T15:27:28.316149+0000","last_clean":"2024-09-10T15:27:28.316149+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316149+0000","last_undegraded":"2024-09-10T15:27:28.316149+0000","last_fullsized":"2024-09-10T15:27:28.316149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:34:45.740908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414992+0000","last_change":"2024-09-10T15:25:15.861029+0000","last_active":"2024-09-10T15:27:28.414992+0000","last_peered":"2024-09-10T15:27:28.414992+0000","last_clean":"2024-09-10T15:27:28.414992+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:27:28.414992+0000","last_undegraded":"2024-09-10T15:27:28.414992+0000","last_fullsized":"2024-09-10T15:27:28.414992+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:55.768174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415219+0000","last_change":"2024-09-10T15:25:17.861227+0000","last_active":"2024-09-10T15:27:28.415219+0000","last_peered":"2024-09-10T15:27:28.415219+0000","last_clean":"2024-09-10T15:27:28.415219+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:27:28.415219+0000","last_undegraded":"2024-09-10T15:27:28.415219+0000","last_fullsized":"2024-09-10T15:27:28.415219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:31:10.360764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'18","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.685807+0000","last_change":"2024-09-10T15:25:19.888156+0000","last_active":"2024-09-10T15:27:58.685807+0000","last_peered":"2024-09-10T15:27:58.685807+0000","last_clean":"2024-09-10T15:27:58.685807+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:27:58.685807+0000","last_undegraded":"2024-09-10T15:27:58.685807+0000","last_fullsized":"2024-09-10T15:27:58.685807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:33:05.313757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695333+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:28.695333+0000","last_peered":"2024-09-10T15:27:28.695333+0000","last_clean":"2024-09-10T15:27:28.695333+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:28.695333+0000","last_undegraded":"2024-09-10T15:27:28.695333+0000","last_fullsized":"2024-09-10T15:27:28.695333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:48:01.807588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340766+0000","last_change":"2024-09-10T15:25:13.841872+0000","last_active":"2024-09-10T15:27:28.340766+0000","last_peered":"2024-09-10T15:27:28.340766+0000","last_clean":"2024-09-10T15:27:28.340766+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:27:28.340766+0000","last_undegraded":"2024-09-10T15:27:28.340766+0000","last_fullsized":"2024-09-10T15:27:28.340766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:45.965259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"94'14","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.201462+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:59.201462+0000","last_peered":"2024-09-10T15:27:59.201462+0000","last_clean":"2024-09-10T15:27:59.201462+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:59.201462+0000","last_undegraded":"2024-09-10T15:27:59.201462+0000","last_fullsized":"2024-09-10T15:27:59.201462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:46.203643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414338+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414338+0000","last_peered":"2024-09-10T15:27:28.414338+0000","last_clean":"2024-09-10T15:27:28.414338+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414338+0000","last_undegraded":"2024-09-10T15:27:28.414338+0000","last_fullsized":"2024-09-10T15:27:28.414338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:14.409181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313222+0000","last_change":"2024-09-10T15:25:15.851033+0000","last_active":"2024-09-10T15:27:28.313222+0000","last_peered":"2024-09-10T15:27:28.313222+0000","last_clean":"2024-09-10T15:27:28.313222+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:27:28.313222+0000","last_undegraded":"2024-09-10T15:27:28.313222+0000","last_fullsized":"2024-09-10T15:27:28.313222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:54.362758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"94'41","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.343695+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:59.343695+0000","last_peered":"2024-09-10T15:27:59.343695+0000","last_clean":"2024-09-10T15:27:59.343695+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:59.343695+0000","last_undegraded":"2024-09-10T15:27:59.343695+0000","last_fullsized":"2024-09-10T15:27:59.343695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314089+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314089+0000","last_peered":"2024-09-10T15:27:28.314089+0000","last_clean":"2024-09-10T15:27:28.314089+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314089+0000","last_undegraded":"2024-09-10T15:27:28.314089+0000","last_fullsized":"2024-09-10T15:27:28.314089+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:20:56.005307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341327+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:28.341327+0000","last_peered":"2024-09-10T15:27:28.341327+0000","last_clean":"2024-09-10T15:27:28.341327+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:28.341327+0000","last_undegraded":"2024-09-10T15:27:28.341327+0000","last_fullsized":"2024-09-10T15:27:28.341327+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:38:29.760457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314871+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314871+0000","last_peered":"2024-09-10T15:27:28.314871+0000","last_clean":"2024-09-10T15:27:28.314871+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314871+0000","last_undegraded":"2024-09-10T15:27:28.314871+0000","last_fullsized":"2024-09-10T15:27:28.314871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341154+0000","last_change":"2024-09-10T15:25:13.841509+0000","last_active":"2024-09-10T15:27:28.341154+0000","last_peered":"2024-09-10T15:27:28.341154+0000","last_clean":"2024-09-10T15:27:28.341154+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:27:28.341154+0000","last_undegraded":"2024-09-10T15:27:28.341154+0000","last_fullsized":"2024-09-10T15:27:28.341154+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:51.539194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"94'22","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.364928+0000","last_change":"2024-09-10T15:25:11.847773+0000","last_active":"2024-09-10T15:27:59.364928+0000","last_peered":"2024-09-10T15:27:59.364928+0000","last_clean":"2024-09-10T15:27:59.364928+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:27:59.364928+0000","last_undegraded":"2024-09-10T15:27:59.364928+0000","last_fullsized":"2024-09-10T15:27:59.364928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:06.133504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":45068,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332605+0000","last_change":"2024-09-10T15:25:15.855730+0000","last_active":"2024-09-10T15:27:28.332605+0000","last_peered":"2024-09-10T15:27:28.332605+0000","last_clean":"2024-09-10T15:27:28.332605+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:27:28.332605+0000","last_undegraded":"2024-09-10T15:27:28.332605+0000","last_fullsized":"2024-09-10T15:27:28.332605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"94'22","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.008797+0000","last_change":"2024-09-10T15:25:17.870028+0000","last_active":"2024-09-10T15:27:59.008797+0000","last_peered":"2024-09-10T15:27:59.008797+0000","last_clean":"2024-09-10T15:27:59.008797+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:27:59.008797+0000","last_undegraded":"2024-09-10T15:27:59.008797+0000","last_fullsized":"2024-09-10T15:27:59.008797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:42.418029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489143+0000","last_change":"2024-09-10T15:25:19.891109+0000","last_active":"2024-09-10T15:27:28.489143+0000","last_peered":"2024-09-10T15:27:28.489143+0000","last_clean":"2024-09-10T15:27:28.489143+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:27:28.489143+0000","last_undegraded":"2024-09-10T15:27:28.489143+0000","last_fullsized":"2024-09-10T15:27:28.489143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:40.335204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492067+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492067+0000","last_peered":"2024-09-10T15:27:28.492067+0000","last_clean":"2024-09-10T15:27:28.492067+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492067+0000","last_undegraded":"2024-09-10T15:27:28.492067+0000","last_fullsized":"2024-09-10T15:27:28.492067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:07:33.301836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314013+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:28.314013+0000","last_peered":"2024-09-10T15:27:28.314013+0000","last_clean":"2024-09-10T15:27:28.314013+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:28.314013+0000","last_undegraded":"2024-09-10T15:27:28.314013+0000","last_fullsized":"2024-09-10T15:27:28.314013+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:07.203505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"94'18","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.256435+0000","last_change":"2024-09-10T15:25:11.857493+0000","last_active":"2024-09-10T15:27:59.256435+0000","last_peered":"2024-09-10T15:27:59.256435+0000","last_clean":"2024-09-10T15:27:59.256435+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:27:59.256435+0000","last_undegraded":"2024-09-10T15:27:59.256435+0000","last_fullsized":"2024-09-10T15:27:59.256435+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314352+0000","last_change":"2024-09-10T15:25:15.853413+0000","last_active":"2024-09-10T15:27:28.314352+0000","last_peered":"2024-09-10T15:27:28.314352+0000","last_clean":"2024-09-10T15:27:28.314352+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:27:28.314352+0000","last_undegraded":"2024-09-10T15:27:28.314352+0000","last_fullsized":"2024-09-10T15:27:28.314352+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:14.719146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313070+0000","last_change":"2024-09-10T15:25:17.865572+0000","last_active":"2024-09-10T15:27:28.313070+0000","last_peered":"2024-09-10T15:27:28.313070+0000","last_clean":"2024-09-10T15:27:28.313070+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:27:28.313070+0000","last_undegraded":"2024-09-10T15:27:28.313070+0000","last_fullsized":"2024-09-10T15:27:28.313070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:50.971999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339866+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:28.339866+0000","last_peered":"2024-09-10T15:27:28.339866+0000","last_clean":"2024-09-10T15:27:28.339866+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:28.339866+0000","last_undegraded":"2024-09-10T15:27:28.339866+0000","last_fullsized":"2024-09-10T15:27:28.339866+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:58.380829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333594+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:28.333594+0000","last_peered":"2024-09-10T15:27:28.333594+0000","last_clean":"2024-09-10T15:27:28.333594+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:28.333594+0000","last_undegraded":"2024-09-10T15:27:28.333594+0000","last_fullsized":"2024-09-10T15:27:28.333594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:36:54.992833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313586+0000","last_change":"2024-09-10T15:25:13.841634+0000","last_active":"2024-09-10T15:27:28.313586+0000","last_peered":"2024-09-10T15:27:28.313586+0000","last_clean":"2024-09-10T15:27:28.313586+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:27:28.313586+0000","last_undegraded":"2024-09-10T15:27:28.313586+0000","last_fullsized":"2024-09-10T15:27:28.313586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:19:21.469053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.223650+0000","last_change":"2024-09-10T15:25:11.840002+0000","last_active":"2024-09-10T15:27:59.223650+0000","last_peered":"2024-09-10T15:27:59.223650+0000","last_clean":"2024-09-10T15:27:59.223650+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:27:59.223650+0000","last_undegraded":"2024-09-10T15:27:59.223650+0000","last_fullsized":"2024-09-10T15:27:59.223650+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:43:47.479954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340106+0000","last_change":"2024-09-10T15:25:15.851550+0000","last_active":"2024-09-10T15:27:28.340106+0000","last_peered":"2024-09-10T15:27:28.340106+0000","last_clean":"2024-09-10T15:27:28.340106+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:27:28.340106+0000","last_undegraded":"2024-09-10T15:27:28.340106+0000","last_fullsized":"2024-09-10T15:27:28.340106+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"94'18","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.352115+0000","last_change":"2024-09-10T15:25:17.860339+0000","last_active":"2024-09-10T15:27:59.352115+0000","last_peered":"2024-09-10T15:27:59.352115+0000","last_clean":"2024-09-10T15:27:59.352115+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:27:59.352115+0000","last_undegraded":"2024-09-10T15:27:59.352115+0000","last_fullsized":"2024-09-10T15:27:59.352115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:43:11.221949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.184806+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:43.184806+0000","last_peered":"2024-09-10T15:27:43.184806+0000","last_clean":"2024-09-10T15:27:43.184806+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:43.184806+0000","last_undegraded":"2024-09-10T15:27:43.184806+0000","last_fullsized":"2024-09-10T15:27:43.184806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415920+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:28.415920+0000","last_peered":"2024-09-10T15:27:28.415920+0000","last_clean":"2024-09-10T15:27:28.415920+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:28.415920+0000","last_undegraded":"2024-09-10T15:27:28.415920+0000","last_fullsized":"2024-09-10T15:27:28.415920+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:05:30.161358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490524+0000","last_change":"2024-09-10T15:25:13.845080+0000","last_active":"2024-09-10T15:27:28.490524+0000","last_peered":"2024-09-10T15:27:28.490524+0000","last_clean":"2024-09-10T15:27:28.490524+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:27:28.490524+0000","last_undegraded":"2024-09-10T15:27:28.490524+0000","last_fullsized":"2024-09-10T15:27:28.490524+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:18:48.708666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"94'14","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.034488+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:59.034488+0000","last_peered":"2024-09-10T15:27:59.034488+0000","last_clean":"2024-09-10T15:27:59.034488+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:59.034488+0000","last_undegraded":"2024-09-10T15:27:59.034488+0000","last_fullsized":"2024-09-10T15:27:59.034488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:46.858105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415092+0000","last_change":"2024-09-10T15:25:15.858566+0000","last_active":"2024-09-10T15:27:28.415092+0000","last_peered":"2024-09-10T15:27:28.415092+0000","last_clean":"2024-09-10T15:27:28.415092+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:27:28.415092+0000","last_undegraded":"2024-09-10T15:27:28.415092+0000","last_fullsized":"2024-09-10T15:27:28.415092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:30:36.362368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"94'20","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.319711+0000","last_change":"2024-09-10T15:25:17.856189+0000","last_active":"2024-09-10T15:27:59.319711+0000","last_peered":"2024-09-10T15:27:59.319711+0000","last_clean":"2024-09-10T15:27:59.319711+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:27:59.319711+0000","last_undegraded":"2024-09-10T15:27:59.319711+0000","last_fullsized":"2024-09-10T15:27:59.319711+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490332+0000","last_change":"2024-09-10T15:25:19.887441+0000","last_active":"2024-09-10T15:27:28.490332+0000","last_peered":"2024-09-10T15:27:28.490332+0000","last_clean":"2024-09-10T15:27:28.490332+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:27:28.490332+0000","last_undegraded":"2024-09-10T15:27:28.490332+0000","last_fullsized":"2024-09-10T15:27:28.490332+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:40:04.757393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416768+0000","last_change":"2024-09-10T15:25:13.864768+0000","last_active":"2024-09-10T15:27:28.416768+0000","last_peered":"2024-09-10T15:27:28.416768+0000","last_clean":"2024-09-10T15:27:28.416768+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:27:28.416768+0000","last_undegraded":"2024-09-10T15:27:28.416768+0000","last_fullsized":"2024-09-10T15:27:28.416768+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:58.417666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"94'22","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.285005+0000","last_change":"2024-09-10T15:25:11.858513+0000","last_active":"2024-09-10T15:27:59.285005+0000","last_peered":"2024-09-10T15:27:59.285005+0000","last_clean":"2024-09-10T15:27:59.285005+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:27:59.285005+0000","last_undegraded":"2024-09-10T15:27:59.285005+0000","last_fullsized":"2024-09-10T15:27:59.285005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:45.104069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.334748+0000","last_change":"2024-09-10T15:25:15.860683+0000","last_active":"2024-09-10T15:27:28.334748+0000","last_peered":"2024-09-10T15:27:28.334748+0000","last_clean":"2024-09-10T15:27:28.334748+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:27:28.334748+0000","last_undegraded":"2024-09-10T15:27:28.334748+0000","last_fullsized":"2024-09-10T15:27:28.334748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:56.559874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"94'30","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.287203+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:59.287203+0000","last_peered":"2024-09-10T15:27:59.287203+0000","last_clean":"2024-09-10T15:27:59.287203+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:59.287203+0000","last_undegraded":"2024-09-10T15:27:59.287203+0000","last_fullsized":"2024-09-10T15:27:59.287203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:16.730696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":76,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.339933+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:28.339933+0000","last_peered":"2024-09-10T15:27:28.339933+0000","last_clean":"2024-09-10T15:27:28.339933+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:28.339933+0000","last_undegraded":"2024-09-10T15:27:28.339933+0000","last_fullsized":"2024-09-10T15:27:28.339933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:35:18.737217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":126,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695048+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:28.695048+0000","last_peered":"2024-09-10T15:27:28.695048+0000","last_clean":"2024-09-10T15:27:28.695048+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:28.695048+0000","last_undegraded":"2024-09-10T15:27:28.695048+0000","last_fullsized":"2024-09-10T15:27:28.695048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:10:48.236345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315808+0000","last_change":"2024-09-10T15:25:13.843248+0000","last_active":"2024-09-10T15:27:28.315808+0000","last_peered":"2024-09-10T15:27:28.315808+0000","last_clean":"2024-09-10T15:27:28.315808+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:27:28.315808+0000","last_undegraded":"2024-09-10T15:27:28.315808+0000","last_fullsized":"2024-09-10T15:27:28.315808+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:06:02.880051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"94'22","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.382327+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:59.382327+0000","last_peered":"2024-09-10T15:27:59.382327+0000","last_clean":"2024-09-10T15:27:59.382327+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:59.382327+0000","last_undegraded":"2024-09-10T15:27:59.382327+0000","last_fullsized":"2024-09-10T15:27:59.382327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341227+0000","last_change":"2024-09-10T15:25:15.867828+0000","last_active":"2024-09-10T15:27:28.341227+0000","last_peered":"2024-09-10T15:27:28.341227+0000","last_clean":"2024-09-10T15:27:28.341227+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:27:28.341227+0000","last_undegraded":"2024-09-10T15:27:28.341227+0000","last_fullsized":"2024-09-10T15:27:28.341227+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:17.658517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"94'24","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.329213+0000","last_change":"2024-09-10T15:25:17.872173+0000","last_active":"2024-09-10T15:27:59.329213+0000","last_peered":"2024-09-10T15:27:59.329213+0000","last_clean":"2024-09-10T15:27:59.329213+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:27:59.329213+0000","last_undegraded":"2024-09-10T15:27:59.329213+0000","last_fullsized":"2024-09-10T15:27:59.329213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:34.635036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695668+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:28.695668+0000","last_peered":"2024-09-10T15:27:28.695668+0000","last_clean":"2024-09-10T15:27:28.695668+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:28.695668+0000","last_undegraded":"2024-09-10T15:27:28.695668+0000","last_fullsized":"2024-09-10T15:27:28.695668+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:59.786245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415602+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:28.415602+0000","last_peered":"2024-09-10T15:27:28.415602+0000","last_clean":"2024-09-10T15:27:28.415602+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:28.415602+0000","last_undegraded":"2024-09-10T15:27:28.415602+0000","last_fullsized":"2024-09-10T15:27:28.415602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:35:56.260031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.491600+0000","last_change":"2024-09-10T15:25:13.867031+0000","last_active":"2024-09-10T15:27:28.491600+0000","last_peered":"2024-09-10T15:27:28.491600+0000","last_clean":"2024-09-10T15:27:28.491600+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:27:28.491600+0000","last_undegraded":"2024-09-10T15:27:28.491600+0000","last_fullsized":"2024-09-10T15:27:28.491600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:59.409752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"94'12","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.364898+0000","last_change":"2024-09-10T15:25:11.846738+0000","last_active":"2024-09-10T15:27:59.364898+0000","last_peered":"2024-09-10T15:27:59.364898+0000","last_clean":"2024-09-10T15:27:59.364898+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:27:59.364898+0000","last_undegraded":"2024-09-10T15:27:59.364898+0000","last_fullsized":"2024-09-10T15:27:59.364898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341641+0000","last_change":"2024-09-10T15:25:15.866287+0000","last_active":"2024-09-10T15:27:28.341641+0000","last_peered":"2024-09-10T15:27:28.341641+0000","last_clean":"2024-09-10T15:27:28.341641+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:27:28.341641+0000","last_undegraded":"2024-09-10T15:27:28.341641+0000","last_fullsized":"2024-09-10T15:27:28.341641+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:24.050770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"94'18","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.075478+0000","last_change":"2024-09-10T15:25:17.873068+0000","last_active":"2024-09-10T15:27:59.075478+0000","last_peered":"2024-09-10T15:27:59.075478+0000","last_clean":"2024-09-10T15:27:59.075478+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:27:59.075478+0000","last_undegraded":"2024-09-10T15:27:59.075478+0000","last_fullsized":"2024-09-10T15:27:59.075478+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:42.973888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489208+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489208+0000","last_peered":"2024-09-10T15:27:28.489208+0000","last_clean":"2024-09-10T15:27:28.489208+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489208+0000","last_undegraded":"2024-09-10T15:27:28.489208+0000","last_fullsized":"2024-09-10T15:27:28.489208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:48:06.685235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414558+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:28.414558+0000","last_peered":"2024-09-10T15:27:28.414558+0000","last_clean":"2024-09-10T15:27:28.414558+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:28.414558+0000","last_undegraded":"2024-09-10T15:27:28.414558+0000","last_fullsized":"2024-09-10T15:27:28.414558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:59.299873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315425+0000","last_change":"2024-09-10T15:25:13.855749+0000","last_active":"2024-09-10T15:27:28.315425+0000","last_peered":"2024-09-10T15:27:28.315425+0000","last_clean":"2024-09-10T15:27:28.315425+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:27:28.315425+0000","last_undegraded":"2024-09-10T15:27:28.315425+0000","last_fullsized":"2024-09-10T15:27:28.315425+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:00:08.152275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"94'26","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.200049+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:59.200049+0000","last_peered":"2024-09-10T15:27:59.200049+0000","last_clean":"2024-09-10T15:27:59.200049+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:59.200049+0000","last_undegraded":"2024-09-10T15:27:59.200049+0000","last_fullsized":"2024-09-10T15:27:59.200049+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47122,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"28'1","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.633158+0000","last_change":"2024-09-10T15:25:15.848590+0000","last_active":"2024-09-10T15:27:58.633158+0000","last_peered":"2024-09-10T15:27:58.633158+0000","last_clean":"2024-09-10T15:27:58.633158+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:27:58.633158+0000","last_undegraded":"2024-09-10T15:27:58.633158+0000","last_fullsized":"2024-09-10T15:27:58.633158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:51.665347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"88'12","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416555+0000","last_change":"2024-09-10T15:25:17.872217+0000","last_active":"2024-09-10T15:27:28.416555+0000","last_peered":"2024-09-10T15:27:28.416555+0000","last_clean":"2024-09-10T15:27:28.416555+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:27:28.416555+0000","last_undegraded":"2024-09-10T15:27:28.416555+0000","last_fullsized":"2024-09-10T15:27:28.416555+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:08:31.942627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'18","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.390756+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:59.390756+0000","last_peered":"2024-09-10T15:27:59.390756+0000","last_clean":"2024-09-10T15:27:59.390756+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:59.390756+0000","last_undegraded":"2024-09-10T15:27:59.390756+0000","last_fullsized":"2024-09-10T15:27:59.390756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414710+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:28.414710+0000","last_peered":"2024-09-10T15:27:28.414710+0000","last_clean":"2024-09-10T15:27:28.414710+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:28.414710+0000","last_undegraded":"2024-09-10T15:27:28.414710+0000","last_fullsized":"2024-09-10T15:27:28.414710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:19:39.558746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341111+0000","last_change":"2024-09-10T15:25:13.860275+0000","last_active":"2024-09-10T15:27:28.341111+0000","last_peered":"2024-09-10T15:27:28.341111+0000","last_clean":"2024-09-10T15:27:28.341111+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:27:28.341111+0000","last_undegraded":"2024-09-10T15:27:28.341111+0000","last_fullsized":"2024-09-10T15:27:28.341111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:45:54.509575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"94'16","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.172745+0000","last_change":"2024-09-10T15:25:11.835047+0000","last_active":"2024-09-10T15:27:59.172745+0000","last_peered":"2024-09-10T15:27:59.172745+0000","last_clean":"2024-09-10T15:27:59.172745+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:27:59.172745+0000","last_undegraded":"2024-09-10T15:27:59.172745+0000","last_fullsized":"2024-09-10T15:27:59.172745+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185859+0000","last_change":"2024-09-10T15:25:15.854372+0000","last_active":"2024-09-10T15:27:48.185859+0000","last_peered":"2024-09-10T15:27:48.185859+0000","last_clean":"2024-09-10T15:27:48.185859+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:27:48.185859+0000","last_undegraded":"2024-09-10T15:27:48.185859+0000","last_fullsized":"2024-09-10T15:27:48.185859+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"94'24","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.149036+0000","last_change":"2024-09-10T15:25:17.866372+0000","last_active":"2024-09-10T15:27:59.149036+0000","last_peered":"2024-09-10T15:27:59.149036+0000","last_clean":"2024-09-10T15:27:59.149036+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:27:59.149036+0000","last_undegraded":"2024-09-10T15:27:59.149036+0000","last_fullsized":"2024-09-10T15:27:59.149036+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313219+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:28.313219+0000","last_peered":"2024-09-10T15:27:28.313219+0000","last_clean":"2024-09-10T15:27:28.313219+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:28.313219+0000","last_undegraded":"2024-09-10T15:27:28.313219+0000","last_fullsized":"2024-09-10T15:27:28.313219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:37:03.029121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185984+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:48.185984+0000","last_peered":"2024-09-10T15:27:48.185984+0000","last_clean":"2024-09-10T15:27:48.185984+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:48.185984+0000","last_undegraded":"2024-09-10T15:27:48.185984+0000","last_fullsized":"2024-09-10T15:27:48.185984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340645+0000","last_change":"2024-09-10T15:25:13.854971+0000","last_active":"2024-09-10T15:27:28.340645+0000","last_peered":"2024-09-10T15:27:28.340645+0000","last_clean":"2024-09-10T15:27:28.340645+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:27:28.340645+0000","last_undegraded":"2024-09-10T15:27:28.340645+0000","last_fullsized":"2024-09-10T15:27:28.340645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:42.498703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"94'14","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.889905+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:58.889905+0000","last_peered":"2024-09-10T15:27:58.889905+0000","last_clean":"2024-09-10T15:27:58.889905+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:58.889905+0000","last_undegraded":"2024-09-10T15:27:58.889905+0000","last_fullsized":"2024-09-10T15:27:58.889905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:38:08.123461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":24594,"num_write":44,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340914+0000","last_change":"2024-09-10T15:25:15.862289+0000","last_active":"2024-09-10T15:27:28.340914+0000","last_peered":"2024-09-10T15:27:28.340914+0000","last_clean":"2024-09-10T15:27:28.340914+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:27:28.340914+0000","last_undegraded":"2024-09-10T15:27:28.340914+0000","last_fullsized":"2024-09-10T15:27:28.340914+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:49.332484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"94'19","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.160221+0000","last_change":"2024-09-10T15:25:17.866630+0000","last_active":"2024-09-10T15:27:59.160221+0000","last_peered":"2024-09-10T15:27:59.160221+0000","last_clean":"2024-09-10T15:27:59.160221+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:27:59.160221+0000","last_undegraded":"2024-09-10T15:27:59.160221+0000","last_fullsized":"2024-09-10T15:27:59.160221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:41.041859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414873+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:28.414873+0000","last_peered":"2024-09-10T15:27:28.414873+0000","last_clean":"2024-09-10T15:27:28.414873+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:28.414873+0000","last_undegraded":"2024-09-10T15:27:28.414873+0000","last_fullsized":"2024-09-10T15:27:28.414873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:20:21.006862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696568+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:28.696568+0000","last_peered":"2024-09-10T15:27:28.696568+0000","last_clean":"2024-09-10T15:27:28.696568+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:28.696568+0000","last_undegraded":"2024-09-10T15:27:28.696568+0000","last_fullsized":"2024-09-10T15:27:28.696568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:23.511073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490260+0000","last_change":"2024-09-10T15:25:13.855710+0000","last_active":"2024-09-10T15:27:28.490260+0000","last_peered":"2024-09-10T15:27:28.490260+0000","last_clean":"2024-09-10T15:27:28.490260+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:27:28.490260+0000","last_undegraded":"2024-09-10T15:27:28.490260+0000","last_fullsized":"2024-09-10T15:27:28.490260+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:08:48.222414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"94'12","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.174175+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:59.174175+0000","last_peered":"2024-09-10T15:27:59.174175+0000","last_clean":"2024-09-10T15:27:59.174175+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:59.174175+0000","last_undegraded":"2024-09-10T15:27:59.174175+0000","last_fullsized":"2024-09-10T15:27:59.174175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:02:43.946488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"28'1","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.668348+0000","last_change":"2024-09-10T15:25:15.853818+0000","last_active":"2024-09-10T15:27:58.668348+0000","last_peered":"2024-09-10T15:27:58.668348+0000","last_clean":"2024-09-10T15:27:58.668348+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:27:58.668348+0000","last_undegraded":"2024-09-10T15:27:58.668348+0000","last_fullsized":"2024-09-10T15:27:58.668348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"94'17","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.052303+0000","last_change":"2024-09-10T15:25:17.864019+0000","last_active":"2024-09-10T15:27:59.052303+0000","last_peered":"2024-09-10T15:27:59.052303+0000","last_clean":"2024-09-10T15:27:59.052303+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:27:59.052303+0000","last_undegraded":"2024-09-10T15:27:59.052303+0000","last_fullsized":"2024-09-10T15:27:59.052303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:38:56.374308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":65,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414746+0000","last_change":"2024-09-10T15:25:19.883995+0000","last_active":"2024-09-10T15:27:28.414746+0000","last_peered":"2024-09-10T15:27:28.414746+0000","last_clean":"2024-09-10T15:27:28.414746+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:27:28.414746+0000","last_undegraded":"2024-09-10T15:27:28.414746+0000","last_fullsized":"2024-09-10T15:27:28.414746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:11:54.698969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415981+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:28.415981+0000","last_peered":"2024-09-10T15:27:28.415981+0000","last_clean":"2024-09-10T15:27:28.415981+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:28.415981+0000","last_undegraded":"2024-09-10T15:27:28.415981+0000","last_fullsized":"2024-09-10T15:27:28.415981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:34:36.470044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340248+0000","last_change":"2024-09-10T15:25:13.842855+0000","last_active":"2024-09-10T15:27:28.340248+0000","last_peered":"2024-09-10T15:27:28.340248+0000","last_clean":"2024-09-10T15:27:28.340248+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:27:28.340248+0000","last_undegraded":"2024-09-10T15:27:28.340248+0000","last_fullsized":"2024-09-10T15:27:28.340248+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:19.587262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"94'14","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.284391+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:59.284391+0000","last_peered":"2024-09-10T15:27:59.284391+0000","last_clean":"2024-09-10T15:27:59.284391+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:59.284391+0000","last_undegraded":"2024-09-10T15:27:59.284391+0000","last_fullsized":"2024-09-10T15:27:59.284391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:20:40.479933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313217+0000","last_change":"2024-09-10T15:25:15.860880+0000","last_active":"2024-09-10T15:27:28.313217+0000","last_peered":"2024-09-10T15:27:28.313217+0000","last_clean":"2024-09-10T15:27:28.313217+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:27:28.313217+0000","last_undegraded":"2024-09-10T15:27:28.313217+0000","last_fullsized":"2024-09-10T15:27:28.313217+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:50:14.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"94'17","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.086019+0000","last_change":"2024-09-10T15:25:17.859263+0000","last_active":"2024-09-10T15:27:59.086019+0000","last_peered":"2024-09-10T15:27:59.086019+0000","last_clean":"2024-09-10T15:27:59.086019+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:27:59.086019+0000","last_undegraded":"2024-09-10T15:27:59.086019+0000","last_fullsized":"2024-09-10T15:27:59.086019+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:19.490240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314980+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:28.314980+0000","last_peered":"2024-09-10T15:27:28.314980+0000","last_clean":"2024-09-10T15:27:28.314980+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:28.314980+0000","last_undegraded":"2024-09-10T15:27:28.314980+0000","last_fullsized":"2024-09-10T15:27:28.314980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:06.676340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.187586+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:43.187586+0000","last_peered":"2024-09-10T15:27:43.187586+0000","last_clean":"2024-09-10T15:27:43.187586+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:43.187586+0000","last_undegraded":"2024-09-10T15:27:43.187586+0000","last_fullsized":"2024-09-10T15:27:43.187586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315999+0000","last_change":"2024-09-10T15:25:13.839472+0000","last_active":"2024-09-10T15:27:28.315999+0000","last_peered":"2024-09-10T15:27:28.315999+0000","last_clean":"2024-09-10T15:27:28.315999+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:27:28.315999+0000","last_undegraded":"2024-09-10T15:27:28.315999+0000","last_fullsized":"2024-09-10T15:27:28.315999+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:51:54.552980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"94'16","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.326955+0000","last_change":"2024-09-10T15:25:11.847141+0000","last_active":"2024-09-10T15:27:59.326955+0000","last_peered":"2024-09-10T15:27:59.326955+0000","last_clean":"2024-09-10T15:27:59.326955+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:27:59.326955+0000","last_undegraded":"2024-09-10T15:27:59.326955+0000","last_fullsized":"2024-09-10T15:27:59.326955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492828+0000","last_change":"2024-09-10T15:25:13.868784+0000","last_active":"2024-09-10T15:27:28.492828+0000","last_peered":"2024-09-10T15:27:28.492828+0000","last_clean":"2024-09-10T15:27:28.492828+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:27:28.492828+0000","last_undegraded":"2024-09-10T15:27:28.492828+0000","last_fullsized":"2024-09-10T15:27:28.492828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:49.823895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"94'6","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.180390+0000","last_change":"2024-09-10T15:25:11.834022+0000","last_active":"2024-09-10T15:27:59.180390+0000","last_peered":"2024-09-10T15:27:59.180390+0000","last_clean":"2024-09-10T15:27:59.180390+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:27:59.180390+0000","last_undegraded":"2024-09-10T15:27:59.180390+0000","last_fullsized":"2024-09-10T15:27:59.180390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:50.913487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416056+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416056+0000","last_peered":"2024-09-10T15:27:28.416056+0000","last_clean":"2024-09-10T15:27:28.416056+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416056+0000","last_undegraded":"2024-09-10T15:27:28.416056+0000","last_fullsized":"2024-09-10T15:27:28.416056+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:18:32.502246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"94'22","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.306120+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:59.306120+0000","last_peered":"2024-09-10T15:27:59.306120+0000","last_clean":"2024-09-10T15:27:59.306120+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:59.306120+0000","last_undegraded":"2024-09-10T15:27:59.306120+0000","last_fullsized":"2024-09-10T15:27:59.306120+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:41.660440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696973+0000","last_change":"2024-09-10T15:25:13.868873+0000","last_active":"2024-09-10T15:27:28.696973+0000","last_peered":"2024-09-10T15:27:28.696973+0000","last_clean":"2024-09-10T15:27:28.696973+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:27:28.696973+0000","last_undegraded":"2024-09-10T15:27:28.696973+0000","last_fullsized":"2024-09-10T15:27:28.696973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:34.310240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"94'26","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.179791+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:59.179791+0000","last_peered":"2024-09-10T15:27:59.179791+0000","last_clean":"2024-09-10T15:27:59.179791+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:59.179791+0000","last_undegraded":"2024-09-10T15:27:59.179791+0000","last_fullsized":"2024-09-10T15:27:59.179791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:47.805125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":51212,"num_write":46,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.695873+0000","last_change":"2024-09-10T15:25:13.866714+0000","last_active":"2024-09-10T15:27:28.695873+0000","last_peered":"2024-09-10T15:27:28.695873+0000","last_clean":"2024-09-10T15:27:28.695873+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:27:28.695873+0000","last_undegraded":"2024-09-10T15:27:28.695873+0000","last_fullsized":"2024-09-10T15:27:28.695873+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:22.043877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"94'24","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.246019+0000","last_change":"2024-09-10T15:25:11.842762+0000","last_active":"2024-09-10T15:27:59.246019+0000","last_peered":"2024-09-10T15:27:59.246019+0000","last_clean":"2024-09-10T15:27:59.246019+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:27:59.246019+0000","last_undegraded":"2024-09-10T15:27:59.246019+0000","last_fullsized":"2024-09-10T15:27:59.246019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:36:52.938552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314309+0000","last_change":"2024-09-10T15:25:13.845449+0000","last_active":"2024-09-10T15:27:28.314309+0000","last_peered":"2024-09-10T15:27:28.314309+0000","last_clean":"2024-09-10T15:27:28.314309+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:27:28.314309+0000","last_undegraded":"2024-09-10T15:27:28.314309+0000","last_fullsized":"2024-09-10T15:27:28.314309+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"94'16","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.282633+0000","last_change":"2024-09-10T15:25:11.841948+0000","last_active":"2024-09-10T15:27:59.282633+0000","last_peered":"2024-09-10T15:27:59.282633+0000","last_clean":"2024-09-10T15:27:59.282633+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:27:59.282633+0000","last_undegraded":"2024-09-10T15:27:59.282633+0000","last_fullsized":"2024-09-10T15:27:59.282633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332571+0000","last_change":"2024-09-10T15:25:13.862060+0000","last_active":"2024-09-10T15:27:28.332571+0000","last_peered":"2024-09-10T15:27:28.332571+0000","last_clean":"2024-09-10T15:27:28.332571+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:27:28.332571+0000","last_undegraded":"2024-09-10T15:27:28.332571+0000","last_fullsized":"2024-09-10T15:27:28.332571+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:38:48.876875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"94'16","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.315643+0000","last_change":"2024-09-10T15:25:11.840067+0000","last_active":"2024-09-10T15:27:59.315643+0000","last_peered":"2024-09-10T15:27:59.315643+0000","last_clean":"2024-09-10T15:27:59.315643+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:27:59.315643+0000","last_undegraded":"2024-09-10T15:27:59.315643+0000","last_fullsized":"2024-09-10T15:27:59.315643+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:06:50.548661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947705+0000","last_change":"2024-09-10T15:25:13.872450+0000","last_active":"2024-09-10T15:27:28.947705+0000","last_peered":"2024-09-10T15:27:28.947705+0000","last_clean":"2024-09-10T15:27:28.947705+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:27:28.947705+0000","last_undegraded":"2024-09-10T15:27:28.947705+0000","last_fullsized":"2024-09-10T15:27:28.947705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"94'16","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.004152+0000","last_change":"2024-09-10T15:25:11.854447+0000","last_active":"2024-09-10T15:27:59.004152+0000","last_peered":"2024-09-10T15:27:59.004152+0000","last_clean":"2024-09-10T15:27:59.004152+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:27:59.004152+0000","last_undegraded":"2024-09-10T15:27:59.004152+0000","last_fullsized":"2024-09-10T15:27:59.004152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:55:17.568491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28684,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.493197+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:28.493197+0000","last_peered":"2024-09-10T15:27:28.493197+0000","last_clean":"2024-09-10T15:27:28.493197+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:28.493197+0000","last_undegraded":"2024-09-10T15:27:28.493197+0000","last_fullsized":"2024-09-10T15:27:28.493197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:57:25.360499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"94'14","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.270557+0000","last_change":"2024-09-10T15:25:11.853178+0000","last_active":"2024-09-10T15:27:59.270557+0000","last_peered":"2024-09-10T15:27:59.270557+0000","last_clean":"2024-09-10T15:27:59.270557+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:27:59.270557+0000","last_undegraded":"2024-09-10T15:27:59.270557+0000","last_fullsized":"2024-09-10T15:27:59.270557+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:17.627909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:29.176648+0000","last_change":"2024-09-10T15:25:13.851762+0000","last_active":"2024-09-10T15:27:29.176648+0000","last_peered":"2024-09-10T15:27:29.176648+0000","last_clean":"2024-09-10T15:27:29.176648+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:27:29.176648+0000","last_undegraded":"2024-09-10T15:27:29.176648+0000","last_fullsized":"2024-09-10T15:27:29.176648+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.306337+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:59.306337+0000","last_peered":"2024-09-10T15:27:59.306337+0000","last_clean":"2024-09-10T15:27:59.306337+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:59.306337+0000","last_undegraded":"2024-09-10T15:27:59.306337+0000","last_fullsized":"2024-09-10T15:27:59.306337+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:31:57.390982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.696443+0000","last_change":"2024-09-10T15:25:13.864676+0000","last_active":"2024-09-10T15:27:28.696443+0000","last_peered":"2024-09-10T15:27:28.696443+0000","last_clean":"2024-09-10T15:27:28.696443+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:27:28.696443+0000","last_undegraded":"2024-09-10T15:27:28.696443+0000","last_fullsized":"2024-09-10T15:27:28.696443+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:50:15.651624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"94'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.377226+0000","last_change":"2024-09-10T15:25:11.833303+0000","last_active":"2024-09-10T15:27:59.377226+0000","last_peered":"2024-09-10T15:27:59.377226+0000","last_clean":"2024-09-10T15:27:59.377226+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:27:59.377226+0000","last_undegraded":"2024-09-10T15:27:59.377226+0000","last_fullsized":"2024-09-10T15:27:59.377226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947728+0000","last_change":"2024-09-10T15:25:13.859097+0000","last_active":"2024-09-10T15:27:28.947728+0000","last_peered":"2024-09-10T15:27:28.947728+0000","last_clean":"2024-09-10T15:27:28.947728+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:27:28.947728+0000","last_undegraded":"2024-09-10T15:27:28.947728+0000","last_fullsized":"2024-09-10T15:27:28.947728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'30","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.297225+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:59.297225+0000","last_peered":"2024-09-10T15:27:59.297225+0000","last_clean":"2024-09-10T15:27:59.297225+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:59.297225+0000","last_undegraded":"2024-09-10T15:27:59.297225+0000","last_fullsized":"2024-09-10T15:27:59.297225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:51:49.291461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":53254,"num_write":40,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947662+0000","last_change":"2024-09-10T15:25:13.870440+0000","last_active":"2024-09-10T15:27:28.947662+0000","last_peered":"2024-09-10T15:27:28.947662+0000","last_clean":"2024-09-10T15:27:28.947662+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:27:28.947662+0000","last_undegraded":"2024-09-10T15:27:28.947662+0000","last_fullsized":"2024-09-10T15:27:28.947662+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"94'20","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.246433+0000","last_change":"2024-09-10T15:25:11.837816+0000","last_active":"2024-09-10T15:27:59.246433+0000","last_peered":"2024-09-10T15:27:59.246433+0000","last_clean":"2024-09-10T15:27:59.246433+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:27:59.246433+0000","last_undegraded":"2024-09-10T15:27:59.246433+0000","last_fullsized":"2024-09-10T15:27:59.246433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":216,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490207+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490207+0000","last_peered":"2024-09-10T15:27:28.490207+0000","last_clean":"2024-09-10T15:27:28.490207+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490207+0000","last_undegraded":"2024-09-10T15:27:28.490207+0000","last_fullsized":"2024-09-10T15:27:28.490207+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:39:47.122840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"94'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.258279+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:59.258279+0000","last_peered":"2024-09-10T15:27:59.258279+0000","last_clean":"2024-09-10T15:27:59.258279+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:59.258279+0000","last_undegraded":"2024-09-10T15:27:59.258279+0000","last_fullsized":"2024-09-10T15:27:59.258279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:21:20.025106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.313708+0000","last_change":"2024-09-10T15:25:13.865852+0000","last_active":"2024-09-10T15:27:28.313708+0000","last_peered":"2024-09-10T15:27:28.313708+0000","last_clean":"2024-09-10T15:27:28.313708+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:27:28.313708+0000","last_undegraded":"2024-09-10T15:27:28.313708+0000","last_fullsized":"2024-09-10T15:27:28.313708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:45:43.679211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"94'18","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.296901+0000","last_change":"2024-09-10T15:25:11.850128+0000","last_active":"2024-09-10T15:27:59.296901+0000","last_peered":"2024-09-10T15:27:59.296901+0000","last_clean":"2024-09-10T15:27:59.296901+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:27:59.296901+0000","last_undegraded":"2024-09-10T15:27:59.296901+0000","last_fullsized":"2024-09-10T15:27:59.296901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:08:22.693067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947551+0000","last_change":"2024-09-10T15:25:13.870480+0000","last_active":"2024-09-10T15:27:28.947551+0000","last_peered":"2024-09-10T15:27:28.947551+0000","last_clean":"2024-09-10T15:27:28.947551+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:27:28.947551+0000","last_undegraded":"2024-09-10T15:27:28.947551+0000","last_fullsized":"2024-09-10T15:27:28.947551+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"94'24","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.249804+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:59.249804+0000","last_peered":"2024-09-10T15:27:59.249804+0000","last_clean":"2024-09-10T15:27:59.249804+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:59.249804+0000","last_undegraded":"2024-09-10T15:27:59.249804+0000","last_fullsized":"2024-09-10T15:27:59.249804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:45.306820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"94'14","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.305382+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:59.305382+0000","last_peered":"2024-09-10T15:27:59.305382+0000","last_clean":"2024-09-10T15:27:59.305382+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:59.305382+0000","last_undegraded":"2024-09-10T15:27:59.305382+0000","last_fullsized":"2024-09-10T15:27:59.305382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:49:49.520423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":28672,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315903+0000","last_change":"2024-09-10T15:25:13.867695+0000","last_active":"2024-09-10T15:27:28.315903+0000","last_peered":"2024-09-10T15:27:28.315903+0000","last_clean":"2024-09-10T15:27:28.315903+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:27:28.315903+0000","last_undegraded":"2024-09-10T15:27:28.315903+0000","last_fullsized":"2024-09-10T15:27:28.315903+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:07:47.325591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"94'8","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.313055+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:59.313055+0000","last_peered":"2024-09-10T15:27:59.313055+0000","last_clean":"2024-09-10T15:27:59.313055+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:59.313055+0000","last_undegraded":"2024-09-10T15:27:59.313055+0000","last_fullsized":"2024-09-10T15:27:59.313055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:48.530717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.183964+0000","last_change":"2024-09-10T15:25:13.853337+0000","last_active":"2024-09-10T15:27:38.183964+0000","last_peered":"2024-09-10T15:27:38.183964+0000","last_clean":"2024-09-10T15:27:38.183964+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:27:38.183964+0000","last_undegraded":"2024-09-10T15:27:38.183964+0000","last_fullsized":"2024-09-10T15:27:38.183964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1215,"num_read_kb":1591,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":706,"ondisk_log_size":706,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1150976,"data_stored":629940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32352,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339488,"statfs":{"total":96636764160,"available":96603635712,"internally_reserved":0,"allocated":1155072,"data_stored":630988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32936,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338904,"statfs":{"total":96636764160,"available":96603037696,"internally_reserved":0,"allocated":1744896,"data_stored":1220454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1159168,"data_stored":631125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1146880,"data_stored":629821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1126400,"data_stored":629426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32976,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338864,"statfs":{"total":96636764160,"available":96602996736,"internally_reserved":0,"allocated":1773568,"data_stored":1221384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1179648,"data_stored":631034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:28:06.098 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.098 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.099 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.100 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.101 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.102 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.103 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.104 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.105 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.106 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.107 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.108 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.109 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T15:24:59.310560+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=24, tm_sec=59, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.110 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.111 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.112 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.113 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.113 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.113 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.113 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.113 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.113 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.114 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.114 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.114 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.114 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.114 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.114 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.115 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.116 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.117 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.118 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.119 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.120 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.121 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.122 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.123 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.124 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.125 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.126 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.127 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.128 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.129 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.129 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:06.129 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T15:28:26.130 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:28:26.487 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:28:26.494 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:28:26.511 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2024-09-10T15:28:24.994729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":4613,"num_read_kb":2051672,"num_write":3896,"num_write_kb":2051115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2701,"ondisk_log_size":2701,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259664,"kb_used_data":10192,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715056,"statfs":{"total":773094113280,"available":772828217344,"internally_reserved":0,"allocated":10436608,"data_stored":6224172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1020,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005820"},"pg_stats":[{"pgid":"3.3f","version":"94'12","reported_seq":116,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.377005+0000","last_change":"2024-09-10T15:25:51.165649+0000","last_active":"2024-09-10T15:27:59.377005+0000","last_peered":"2024-09-10T15:27:59.377005+0000","last_clean":"2024-09-10T15:27:59.377005+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:27:59.377005+0000","last_undegraded":"2024-09-10T15:27:59.377005+0000","last_fullsized":"2024-09-10T15:27:59.377005+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.184755+0000","last_change":"2024-09-10T15:25:13.843882+0000","last_active":"2024-09-10T15:27:43.184755+0000","last_peered":"2024-09-10T15:27:43.184755+0000","last_clean":"2024-09-10T15:27:43.184755+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:27:43.184755+0000","last_undegraded":"2024-09-10T15:27:43.184755+0000","last_fullsized":"2024-09-10T15:27:43.184755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"94'14","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.434327+0000","last_change":"2024-09-10T15:28:20.434391+0000","last_active":"2024-09-10T15:28:20.434327+0000","last_peered":"2024-09-10T15:28:20.434327+0000","last_clean":"2024-09-10T15:28:20.434327+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:28:20.434327+0000","last_undegraded":"2024-09-10T15:28:20.434327+0000","last_fullsized":"2024-09-10T15:28:20.434327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:20.434136+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:20.434136+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.434136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:21.152835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188930+0000","last_change":"2024-09-10T15:25:13.844143+0000","last_active":"2024-09-10T15:27:43.188930+0000","last_peered":"2024-09-10T15:27:43.188930+0000","last_clean":"2024-09-10T15:27:43.188930+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:27:43.188930+0000","last_undegraded":"2024-09-10T15:27:43.188930+0000","last_fullsized":"2024-09-10T15:27:43.188930+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"94'24","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.362402+0000","last_change":"2024-09-10T15:25:11.854296+0000","last_active":"2024-09-10T15:27:59.362402+0000","last_peered":"2024-09-10T15:27:59.362402+0000","last_clean":"2024-09-10T15:27:59.362402+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:27:59.362402+0000","last_undegraded":"2024-09-10T15:27:59.362402+0000","last_fullsized":"2024-09-10T15:27:59.362402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.273907+0000","last_change":"2024-09-10T15:28:22.273961+0000","last_active":"2024-09-10T15:28:22.273907+0000","last_peered":"2024-09-10T15:28:22.273907+0000","last_clean":"2024-09-10T15:28:22.273907+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:28:22.273907+0000","last_undegraded":"2024-09-10T15:28:22.273907+0000","last_fullsized":"2024-09-10T15:28:22.273907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:22.273680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:22.273680+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.273680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:09.159963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"94'4","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.502181+0000","last_change":"2024-09-10T15:28:17.502242+0000","last_active":"2024-09-10T15:28:17.502181+0000","last_peered":"2024-09-10T15:28:17.502181+0000","last_clean":"2024-09-10T15:28:17.502181+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:28:17.502181+0000","last_undegraded":"2024-09-10T15:28:17.502181+0000","last_fullsized":"2024-09-10T15:28:17.502181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T15:28:17.501983+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T15:28:17.501983+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.501983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:09.311891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.561094+0000","last_change":"2024-09-10T15:28:18.561151+0000","last_active":"2024-09-10T15:28:18.561094+0000","last_peered":"2024-09-10T15:28:18.561094+0000","last_clean":"2024-09-10T15:28:18.561094+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:28:18.561094+0000","last_undegraded":"2024-09-10T15:28:18.561094+0000","last_fullsized":"2024-09-10T15:28:18.561094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:18.560887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:18.560887+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.560887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:43.920879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"94'24","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.354603+0000","last_change":"2024-09-10T15:28:20.354666+0000","last_active":"2024-09-10T15:28:20.354603+0000","last_peered":"2024-09-10T15:28:20.354603+0000","last_clean":"2024-09-10T15:28:20.354603+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:28:20.354603+0000","last_undegraded":"2024-09-10T15:28:20.354603+0000","last_fullsized":"2024-09-10T15:28:20.354603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:20.354411+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:20.354411+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.354411+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:13.494879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":45074,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.350584+0000","last_change":"2024-09-10T15:28:09.350640+0000","last_active":"2024-09-10T15:28:09.350584+0000","last_peered":"2024-09-10T15:28:09.350584+0000","last_clean":"2024-09-10T15:28:09.350584+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:28:09.350584+0000","last_undegraded":"2024-09-10T15:28:09.350584+0000","last_fullsized":"2024-09-10T15:28:09.350584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.350386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.350386+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.350386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:12.114598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.541413+0000","last_change":"2024-09-10T15:28:16.541475+0000","last_active":"2024-09-10T15:28:16.541413+0000","last_peered":"2024-09-10T15:28:16.541413+0000","last_clean":"2024-09-10T15:28:16.541413+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:28:16.541413+0000","last_undegraded":"2024-09-10T15:28:16.541413+0000","last_fullsized":"2024-09-10T15:28:16.541413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:16.541230+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:16.541230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.541230+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:50.279022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.384778+0000","last_change":"2024-09-10T15:28:04.384862+0000","last_active":"2024-09-10T15:28:04.384778+0000","last_peered":"2024-09-10T15:28:04.384778+0000","last_clean":"2024-09-10T15:28:04.384778+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:28:04.384778+0000","last_undegraded":"2024-09-10T15:28:04.384778+0000","last_fullsized":"2024-09-10T15:28:04.384778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.384654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.384654+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.384654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:16.482396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"94'12","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.351301+0000","last_change":"2024-09-10T15:28:15.351367+0000","last_active":"2024-09-10T15:28:15.351301+0000","last_peered":"2024-09-10T15:28:15.351301+0000","last_clean":"2024-09-10T15:28:15.351301+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:28:15.351301+0000","last_undegraded":"2024-09-10T15:28:15.351301+0000","last_fullsized":"2024-09-10T15:28:15.351301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:15.351108+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:15.351108+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.351108+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:44.889976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.494819+0000","last_change":"2024-09-10T15:28:09.494877+0000","last_active":"2024-09-10T15:28:09.494819+0000","last_peered":"2024-09-10T15:28:09.494819+0000","last_clean":"2024-09-10T15:28:09.494819+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:28:09.494819+0000","last_undegraded":"2024-09-10T15:28:09.494819+0000","last_fullsized":"2024-09-10T15:28:09.494819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:09.494606+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:09.494606+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.494606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:16.571912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"94'18","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.302489+0000","last_change":"2024-09-10T15:25:11.851101+0000","last_active":"2024-09-10T15:27:59.302489+0000","last_peered":"2024-09-10T15:27:59.302489+0000","last_clean":"2024-09-10T15:27:59.302489+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:27:59.302489+0000","last_undegraded":"2024-09-10T15:27:59.302489+0000","last_fullsized":"2024-09-10T15:27:59.302489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.398276+0000","last_change":"2024-09-10T15:28:21.398329+0000","last_active":"2024-09-10T15:28:21.398276+0000","last_peered":"2024-09-10T15:28:21.398276+0000","last_clean":"2024-09-10T15:28:21.398276+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:28:21.398276+0000","last_undegraded":"2024-09-10T15:28:21.398276+0000","last_fullsized":"2024-09-10T15:28:21.398276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:21.398068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:21.398068+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.398068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:34.317030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.186882+0000","last_change":"2024-09-10T15:25:13.842476+0000","last_active":"2024-09-10T15:27:33.186882+0000","last_peered":"2024-09-10T15:27:33.186882+0000","last_clean":"2024-09-10T15:27:33.186882+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:27:33.186882+0000","last_undegraded":"2024-09-10T15:27:33.186882+0000","last_fullsized":"2024-09-10T15:27:33.186882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.255624+0000","last_change":"2024-09-10T15:28:21.255693+0000","last_active":"2024-09-10T15:28:21.255624+0000","last_peered":"2024-09-10T15:28:21.255624+0000","last_clean":"2024-09-10T15:28:21.255624+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:28:21.255624+0000","last_undegraded":"2024-09-10T15:28:21.255624+0000","last_fullsized":"2024-09-10T15:28:21.255624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:21.255422+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:21.255422+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.255422+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:49.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:03.431539+0000","last_change":"2024-09-10T15:28:03.431569+0000","last_active":"2024-09-10T15:28:03.431539+0000","last_peered":"2024-09-10T15:28:03.431539+0000","last_clean":"2024-09-10T15:28:03.431539+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:28:03.431539+0000","last_undegraded":"2024-09-10T15:28:03.431539+0000","last_fullsized":"2024-09-10T15:28:03.431539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:03.431437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:03.431437+0000","last_clean_scrub_stamp":"2024-09-10T15:28:03.431437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:18.730138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.359533+0000","last_change":"2024-09-10T15:28:21.359594+0000","last_active":"2024-09-10T15:28:21.359533+0000","last_peered":"2024-09-10T15:28:21.359533+0000","last_clean":"2024-09-10T15:28:21.359533+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:28:21.359533+0000","last_undegraded":"2024-09-10T15:28:21.359533+0000","last_fullsized":"2024-09-10T15:28:21.359533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:21.359342+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:21.359342+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.359342+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:49.690779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.390476+0000","last_change":"2024-09-10T15:28:11.390530+0000","last_active":"2024-09-10T15:28:11.390476+0000","last_peered":"2024-09-10T15:28:11.390476+0000","last_clean":"2024-09-10T15:28:11.390476+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:28:11.390476+0000","last_undegraded":"2024-09-10T15:28:11.390476+0000","last_fullsized":"2024-09-10T15:28:11.390476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.390292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.390292+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.390292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:23.435043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"94'20","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.345867+0000","last_change":"2024-09-10T15:28:19.346020+0000","last_active":"2024-09-10T15:28:19.345867+0000","last_peered":"2024-09-10T15:28:19.345867+0000","last_clean":"2024-09-10T15:28:19.345867+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:28:19.345867+0000","last_undegraded":"2024-09-10T15:28:19.345867+0000","last_fullsized":"2024-09-10T15:28:19.345867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:19.345604+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:19.345604+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.345604+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:58.767942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":34816,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.255213+0000","last_change":"2024-09-10T15:28:08.255274+0000","last_active":"2024-09-10T15:28:08.255213+0000","last_peered":"2024-09-10T15:28:08.255213+0000","last_clean":"2024-09-10T15:28:08.255213+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:28:08.255213+0000","last_undegraded":"2024-09-10T15:28:08.255213+0000","last_fullsized":"2024-09-10T15:28:08.255213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'38","last_scrub_stamp":"2024-09-10T15:28:08.255025+0000","last_deep_scrub":"76'38","last_deep_scrub_stamp":"2024-09-10T15:28:08.255025+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.255025+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:17.678997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'22","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.311639+0000","last_change":"2024-09-10T15:28:17.311699+0000","last_active":"2024-09-10T15:28:17.311639+0000","last_peered":"2024-09-10T15:28:17.311639+0000","last_clean":"2024-09-10T15:28:17.311639+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:28:17.311639+0000","last_undegraded":"2024-09-10T15:28:17.311639+0000","last_fullsized":"2024-09-10T15:28:17.311639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:17.311443+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:17.311443+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.311443+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:21.219093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.358366+0000","last_change":"2024-09-10T15:28:15.358417+0000","last_active":"2024-09-10T15:28:15.358366+0000","last_peered":"2024-09-10T15:28:15.358366+0000","last_clean":"2024-09-10T15:28:15.358366+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:28:15.358366+0000","last_undegraded":"2024-09-10T15:28:15.358366+0000","last_fullsized":"2024-09-10T15:28:15.358366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.358133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.358133+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.358133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:43.689569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.295185+0000","last_change":"2024-09-10T15:28:20.295252+0000","last_active":"2024-09-10T15:28:20.295185+0000","last_peered":"2024-09-10T15:28:20.295185+0000","last_clean":"2024-09-10T15:28:20.295185+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:28:20.295185+0000","last_undegraded":"2024-09-10T15:28:20.295185+0000","last_fullsized":"2024-09-10T15:28:20.295185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:20.294987+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:20.294987+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.294987+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:21.863028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.183934+0000","last_change":"2024-09-10T15:25:13.844152+0000","last_active":"2024-09-10T15:27:38.183934+0000","last_peered":"2024-09-10T15:27:38.183934+0000","last_clean":"2024-09-10T15:27:38.183934+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:27:38.183934+0000","last_undegraded":"2024-09-10T15:27:38.183934+0000","last_fullsized":"2024-09-10T15:27:38.183934+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"94'22","reported_seq":141,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:02.471488+0000","last_change":"2024-09-10T15:25:44.110365+0000","last_active":"2024-09-10T15:28:02.471488+0000","last_peered":"2024-09-10T15:28:02.471488+0000","last_clean":"2024-09-10T15:28:02.471488+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:28:02.471488+0000","last_undegraded":"2024-09-10T15:28:02.471488+0000","last_fullsized":"2024-09-10T15:28:02.471488+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.188356+0000","last_change":"2024-09-10T15:25:21.900671+0000","last_active":"2024-09-10T15:27:48.188356+0000","last_peered":"2024-09-10T15:27:48.188356+0000","last_clean":"2024-09-10T15:27:48.188356+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:27:48.188356+0000","last_undegraded":"2024-09-10T15:27:48.188356+0000","last_fullsized":"2024-09-10T15:27:48.188356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.219088+0000","last_change":"2024-09-10T15:28:12.219204+0000","last_active":"2024-09-10T15:28:12.219088+0000","last_peered":"2024-09-10T15:28:12.219088+0000","last_clean":"2024-09-10T15:28:12.219088+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:28:12.219088+0000","last_undegraded":"2024-09-10T15:28:12.219088+0000","last_fullsized":"2024-09-10T15:28:12.219088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.218854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.218854+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.218854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:04.113397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"94'22","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.365590+0000","last_change":"2024-09-10T15:25:11.844780+0000","last_active":"2024-09-10T15:27:59.365590+0000","last_peered":"2024-09-10T15:27:59.365590+0000","last_clean":"2024-09-10T15:27:59.365590+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:27:59.365590+0000","last_undegraded":"2024-09-10T15:27:59.365590+0000","last_fullsized":"2024-09-10T15:27:59.365590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.212186+0000","last_change":"2024-09-10T15:28:11.212245+0000","last_active":"2024-09-10T15:28:11.212186+0000","last_peered":"2024-09-10T15:28:11.212186+0000","last_clean":"2024-09-10T15:28:11.212186+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:28:11.212186+0000","last_undegraded":"2024-09-10T15:28:11.212186+0000","last_fullsized":"2024-09-10T15:28:11.212186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.211987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.211987+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.211987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:50.802107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"94'26","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.746574+0000","last_change":"2024-09-10T15:28:07.746675+0000","last_active":"2024-09-10T15:28:07.746574+0000","last_peered":"2024-09-10T15:28:07.746574+0000","last_clean":"2024-09-10T15:28:07.746574+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:28:07.746574+0000","last_undegraded":"2024-09-10T15:28:07.746574+0000","last_fullsized":"2024-09-10T15:28:07.746574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:07.746369+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:07.746369+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.746369+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:53.711912+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":71,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.186020+0000","last_change":"2024-09-10T15:25:19.891926+0000","last_active":"2024-09-10T15:27:48.186020+0000","last_peered":"2024-09-10T15:27:48.186020+0000","last_clean":"2024-09-10T15:27:48.186020+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:27:48.186020+0000","last_undegraded":"2024-09-10T15:27:48.186020+0000","last_fullsized":"2024-09-10T15:27:48.186020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185774+0000","last_change":"2024-09-10T15:25:21.904503+0000","last_active":"2024-09-10T15:27:48.185774+0000","last_peered":"2024-09-10T15:27:48.185774+0000","last_clean":"2024-09-10T15:27:48.185774+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:27:48.185774+0000","last_undegraded":"2024-09-10T15:27:48.185774+0000","last_fullsized":"2024-09-10T15:27:48.185774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.188087+0000","last_change":"2024-09-10T15:25:13.839138+0000","last_active":"2024-09-10T15:27:38.188087+0000","last_peered":"2024-09-10T15:27:38.188087+0000","last_clean":"2024-09-10T15:27:38.188087+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:27:38.188087+0000","last_undegraded":"2024-09-10T15:27:38.188087+0000","last_fullsized":"2024-09-10T15:27:38.188087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"94'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.245428+0000","last_change":"2024-09-10T15:28:17.245601+0000","last_active":"2024-09-10T15:28:17.245428+0000","last_peered":"2024-09-10T15:28:17.245428+0000","last_clean":"2024-09-10T15:28:17.245428+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:28:17.245428+0000","last_undegraded":"2024-09-10T15:28:17.245428+0000","last_fullsized":"2024-09-10T15:28:17.245428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:17.245196+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:17.245196+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.245196+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:50.982987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.655880+0000","last_change":"2024-09-10T15:28:13.656024+0000","last_active":"2024-09-10T15:28:13.655880+0000","last_peered":"2024-09-10T15:28:13.655880+0000","last_clean":"2024-09-10T15:28:13.655880+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:28:13.655880+0000","last_undegraded":"2024-09-10T15:28:13.655880+0000","last_fullsized":"2024-09-10T15:28:13.655880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.655658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.655658+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.655658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:56.981659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"94'9","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.407907+0000","last_change":"2024-09-10T15:28:10.407979+0000","last_active":"2024-09-10T15:28:10.407907+0000","last_peered":"2024-09-10T15:28:10.407907+0000","last_clean":"2024-09-10T15:28:10.407907+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:28:10.407907+0000","last_undegraded":"2024-09-10T15:28:10.407907+0000","last_fullsized":"2024-09-10T15:28:10.407907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'9","last_scrub_stamp":"2024-09-10T15:28:10.407730+0000","last_deep_scrub":"94'9","last_deep_scrub_stamp":"2024-09-10T15:28:10.407730+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.407730+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:50.509573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185941+0000","last_change":"2024-09-10T15:25:19.881720+0000","last_active":"2024-09-10T15:27:48.185941+0000","last_peered":"2024-09-10T15:27:48.185941+0000","last_clean":"2024-09-10T15:27:48.185941+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:27:48.185941+0000","last_undegraded":"2024-09-10T15:27:48.185941+0000","last_fullsized":"2024-09-10T15:27:48.185941+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.194623+0000","last_change":"2024-09-10T15:25:21.885131+0000","last_active":"2024-09-10T15:27:53.194623+0000","last_peered":"2024-09-10T15:27:53.194623+0000","last_clean":"2024-09-10T15:27:53.194623+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:27:53.194623+0000","last_undegraded":"2024-09-10T15:27:53.194623+0000","last_fullsized":"2024-09-10T15:27:53.194623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.398030+0000","last_change":"2024-09-10T15:28:14.398082+0000","last_active":"2024-09-10T15:28:14.398030+0000","last_peered":"2024-09-10T15:28:14.398030+0000","last_clean":"2024-09-10T15:28:14.398030+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:28:14.398030+0000","last_undegraded":"2024-09-10T15:28:14.398030+0000","last_fullsized":"2024-09-10T15:28:14.398030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.397844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.397844+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.397844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:07.538311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'24","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.313171+0000","last_change":"2024-09-10T15:25:11.846586+0000","last_active":"2024-09-10T15:27:59.313171+0000","last_peered":"2024-09-10T15:27:59.313171+0000","last_clean":"2024-09-10T15:27:59.313171+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:27:59.313171+0000","last_undegraded":"2024-09-10T15:27:59.313171+0000","last_fullsized":"2024-09-10T15:27:59.313171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.192694+0000","last_change":"2024-09-10T15:25:15.861332+0000","last_active":"2024-09-10T15:27:43.192694+0000","last_peered":"2024-09-10T15:27:43.192694+0000","last_clean":"2024-09-10T15:27:43.192694+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:27:43.192694+0000","last_undegraded":"2024-09-10T15:27:43.192694+0000","last_fullsized":"2024-09-10T15:27:43.192694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"35'10","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.191398+0000","last_change":"2024-09-10T15:25:17.860553+0000","last_active":"2024-09-10T15:27:38.191398+0000","last_peered":"2024-09-10T15:27:38.191398+0000","last_clean":"2024-09-10T15:27:38.191398+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:27:38.191398+0000","last_undegraded":"2024-09-10T15:27:38.191398+0000","last_fullsized":"2024-09-10T15:27:38.191398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'18","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.347986+0000","last_change":"2024-09-10T15:28:18.348048+0000","last_active":"2024-09-10T15:28:18.347986+0000","last_peered":"2024-09-10T15:28:18.347986+0000","last_clean":"2024-09-10T15:28:18.347986+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:28:18.347986+0000","last_undegraded":"2024-09-10T15:28:18.347986+0000","last_fullsized":"2024-09-10T15:28:18.347986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:18.347799+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:18.347799+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.347799+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:28.999258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.193909+0000","last_change":"2024-09-10T15:25:21.899227+0000","last_active":"2024-09-10T15:27:53.193909+0000","last_peered":"2024-09-10T15:27:53.193909+0000","last_clean":"2024-09-10T15:27:53.193909+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:27:53.193909+0000","last_undegraded":"2024-09-10T15:27:53.193909+0000","last_fullsized":"2024-09-10T15:27:53.193909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.369224+0000","last_change":"2024-09-10T15:28:13.369289+0000","last_active":"2024-09-10T15:28:13.369224+0000","last_peered":"2024-09-10T15:28:13.369224+0000","last_clean":"2024-09-10T15:28:13.369224+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:28:13.369224+0000","last_undegraded":"2024-09-10T15:28:13.369224+0000","last_fullsized":"2024-09-10T15:28:13.369224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'38","last_scrub_stamp":"2024-09-10T15:28:13.368985+0000","last_deep_scrub":"76'38","last_deep_scrub_stamp":"2024-09-10T15:28:13.368985+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.368985+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:52.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"94'12","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.156811+0000","last_change":"2024-09-10T15:25:11.851663+0000","last_active":"2024-09-10T15:27:59.156811+0000","last_peered":"2024-09-10T15:27:59.156811+0000","last_clean":"2024-09-10T15:27:59.156811+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:27:59.156811+0000","last_undegraded":"2024-09-10T15:27:59.156811+0000","last_fullsized":"2024-09-10T15:27:59.156811+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20492,"num_write":32,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.245145+0000","last_change":"2024-09-10T15:28:13.245270+0000","last_active":"2024-09-10T15:28:13.245145+0000","last_peered":"2024-09-10T15:28:13.245145+0000","last_clean":"2024-09-10T15:28:13.245145+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:28:13.245145+0000","last_undegraded":"2024-09-10T15:28:13.245145+0000","last_fullsized":"2024-09-10T15:28:13.245145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.244886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.244886+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.244886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:14.671072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"94'25","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.532378+0000","last_change":"2024-09-10T15:28:14.532458+0000","last_active":"2024-09-10T15:28:14.532378+0000","last_peered":"2024-09-10T15:28:14.532378+0000","last_clean":"2024-09-10T15:28:14.532378+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:28:14.532378+0000","last_undegraded":"2024-09-10T15:28:14.532378+0000","last_fullsized":"2024-09-10T15:28:14.532378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'25","last_scrub_stamp":"2024-09-10T15:28:14.532155+0000","last_deep_scrub":"94'25","last_deep_scrub_stamp":"2024-09-10T15:28:14.532155+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.532155+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:26.576906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":74,"num_write":28,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'18","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.398739+0000","last_change":"2024-09-10T15:28:06.398818+0000","last_active":"2024-09-10T15:28:06.398739+0000","last_peered":"2024-09-10T15:28:06.398739+0000","last_clean":"2024-09-10T15:28:06.398739+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:28:06.398739+0000","last_undegraded":"2024-09-10T15:28:06.398739+0000","last_fullsized":"2024-09-10T15:28:06.398739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:06.398506+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:06.398506+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.398506+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:36.743473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415119+0000","last_change":"2024-09-10T15:25:13.845666+0000","last_active":"2024-09-10T15:27:28.415119+0000","last_peered":"2024-09-10T15:27:28.415119+0000","last_clean":"2024-09-10T15:27:28.415119+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:27:28.415119+0000","last_undegraded":"2024-09-10T15:27:28.415119+0000","last_fullsized":"2024-09-10T15:27:28.415119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"94'10","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.298012+0000","last_change":"2024-09-10T15:28:18.298189+0000","last_active":"2024-09-10T15:28:18.298012+0000","last_peered":"2024-09-10T15:28:18.298012+0000","last_clean":"2024-09-10T15:28:18.298012+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:28:18.298012+0000","last_undegraded":"2024-09-10T15:28:18.298012+0000","last_fullsized":"2024-09-10T15:28:18.298012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:18.297682+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:18.297682+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.297682+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:56.718101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16396,"num_write":30,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.282384+0000","last_change":"2024-09-10T15:28:04.282432+0000","last_active":"2024-09-10T15:28:04.282384+0000","last_peered":"2024-09-10T15:28:04.282384+0000","last_clean":"2024-09-10T15:28:04.282384+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:28:04.282384+0000","last_undegraded":"2024-09-10T15:28:04.282384+0000","last_fullsized":"2024-09-10T15:28:04.282384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.282198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.282198+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.282198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:42.136495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'27","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:58.996542+0000","last_change":"2024-09-10T15:25:17.867905+0000","last_active":"2024-09-10T15:27:58.996542+0000","last_peered":"2024-09-10T15:27:58.996542+0000","last_clean":"2024-09-10T15:27:58.996542+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:27:58.996542+0000","last_undegraded":"2024-09-10T15:27:58.996542+0000","last_fullsized":"2024-09-10T15:27:58.996542+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.192035+0000","last_change":"2024-09-10T15:25:19.886695+0000","last_active":"2024-09-10T15:27:38.192035+0000","last_peered":"2024-09-10T15:27:38.192035+0000","last_clean":"2024-09-10T15:27:38.192035+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:27:38.192035+0000","last_undegraded":"2024-09-10T15:27:38.192035+0000","last_fullsized":"2024-09-10T15:27:38.192035+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341482+0000","last_change":"2024-09-10T15:25:21.896885+0000","last_active":"2024-09-10T15:27:28.341482+0000","last_peered":"2024-09-10T15:27:28.341482+0000","last_clean":"2024-09-10T15:27:28.341482+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:27:28.341482+0000","last_undegraded":"2024-09-10T15:27:28.341482+0000","last_fullsized":"2024-09-10T15:27:28.341482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.377815+0000","last_change":"2024-09-10T15:28:13.377877+0000","last_active":"2024-09-10T15:28:13.377815+0000","last_peered":"2024-09-10T15:28:13.377815+0000","last_clean":"2024-09-10T15:28:13.377815+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:28:13.377815+0000","last_undegraded":"2024-09-10T15:28:13.377815+0000","last_fullsized":"2024-09-10T15:28:13.377815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.377606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.377606+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.377606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.424173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"94'20","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.527693+0000","last_change":"2024-09-10T15:28:22.527757+0000","last_active":"2024-09-10T15:28:22.527693+0000","last_peered":"2024-09-10T15:28:22.527693+0000","last_clean":"2024-09-10T15:28:22.527693+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:28:22.527693+0000","last_undegraded":"2024-09-10T15:28:22.527693+0000","last_fullsized":"2024-09-10T15:28:22.527693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:22.527486+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:22.527486+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.527486+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:15.667954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32786,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.262408+0000","last_change":"2024-09-10T15:28:05.262465+0000","last_active":"2024-09-10T15:28:05.262408+0000","last_peered":"2024-09-10T15:28:05.262408+0000","last_clean":"2024-09-10T15:28:05.262408+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:28:05.262408+0000","last_undegraded":"2024-09-10T15:28:05.262408+0000","last_fullsized":"2024-09-10T15:28:05.262408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.262207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.262207+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.262207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:41.417962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"94'22","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.720967+0000","last_change":"2024-09-10T15:28:05.721077+0000","last_active":"2024-09-10T15:28:05.720967+0000","last_peered":"2024-09-10T15:28:05.720967+0000","last_clean":"2024-09-10T15:28:05.720967+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:28:05.720967+0000","last_undegraded":"2024-09-10T15:28:05.720967+0000","last_fullsized":"2024-09-10T15:28:05.720967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:05.720712+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:05.720712+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.720712+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:45.822555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.190268+0000","last_change":"2024-09-10T15:25:19.889358+0000","last_active":"2024-09-10T15:27:33.190268+0000","last_peered":"2024-09-10T15:27:33.190268+0000","last_clean":"2024-09-10T15:27:33.190268+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:27:33.190268+0000","last_undegraded":"2024-09-10T15:27:33.190268+0000","last_fullsized":"2024-09-10T15:27:33.190268+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.947853+0000","last_change":"2024-09-10T15:25:21.903351+0000","last_active":"2024-09-10T15:27:28.947853+0000","last_peered":"2024-09-10T15:27:28.947853+0000","last_clean":"2024-09-10T15:27:28.947853+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:27:28.947853+0000","last_undegraded":"2024-09-10T15:27:28.947853+0000","last_fullsized":"2024-09-10T15:27:28.947853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.511472+0000","last_change":"2024-09-10T15:28:13.511528+0000","last_active":"2024-09-10T15:28:13.511472+0000","last_peered":"2024-09-10T15:28:13.511472+0000","last_clean":"2024-09-10T15:28:13.511472+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:28:13.511472+0000","last_undegraded":"2024-09-10T15:28:13.511472+0000","last_fullsized":"2024-09-10T15:28:13.511472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.511286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.511286+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.511286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.613128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"94'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.253885+0000","last_change":"2024-09-10T15:25:11.836868+0000","last_active":"2024-09-10T15:27:59.253885+0000","last_peered":"2024-09-10T15:27:59.253885+0000","last_clean":"2024-09-10T15:27:59.253885+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:27:59.253885+0000","last_undegraded":"2024-09-10T15:27:59.253885+0000","last_fullsized":"2024-09-10T15:27:59.253885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:29.191762+0000","last_change":"2024-09-10T15:25:15.860870+0000","last_active":"2024-09-10T15:27:29.191762+0000","last_peered":"2024-09-10T15:27:29.191762+0000","last_clean":"2024-09-10T15:27:29.191762+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:27:29.191762+0000","last_undegraded":"2024-09-10T15:27:29.191762+0000","last_fullsized":"2024-09-10T15:27:29.191762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"94'32","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.178082+0000","last_change":"2024-09-10T15:28:07.178166+0000","last_active":"2024-09-10T15:28:07.178082+0000","last_peered":"2024-09-10T15:28:07.178082+0000","last_clean":"2024-09-10T15:28:07.178082+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:28:07.178082+0000","last_undegraded":"2024-09-10T15:28:07.178082+0000","last_fullsized":"2024-09-10T15:28:07.178082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'32","last_scrub_stamp":"2024-09-10T15:28:07.177884+0000","last_deep_scrub":"94'32","last_deep_scrub_stamp":"2024-09-10T15:28:07.177884+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.177884+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:20.096846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.442390+0000","last_change":"2024-09-10T15:28:08.442555+0000","last_active":"2024-09-10T15:28:08.442390+0000","last_peered":"2024-09-10T15:28:08.442390+0000","last_clean":"2024-09-10T15:28:08.442390+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:28:08.442390+0000","last_undegraded":"2024-09-10T15:28:08.442390+0000","last_fullsized":"2024-09-10T15:28:08.442390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:08.442094+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:08.442094+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.442094+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:17.639917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:29.193292+0000","last_change":"2024-09-10T15:25:21.896709+0000","last_active":"2024-09-10T15:27:29.193292+0000","last_peered":"2024-09-10T15:27:29.193292+0000","last_clean":"2024-09-10T15:27:29.193292+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:27:29.193292+0000","last_undegraded":"2024-09-10T15:27:29.193292+0000","last_fullsized":"2024-09-10T15:27:29.193292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.446864+0000","last_change":"2024-09-10T15:28:17.446928+0000","last_active":"2024-09-10T15:28:17.446864+0000","last_peered":"2024-09-10T15:28:17.446864+0000","last_clean":"2024-09-10T15:28:17.446864+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:28:17.446864+0000","last_undegraded":"2024-09-10T15:28:17.446864+0000","last_fullsized":"2024-09-10T15:28:17.446864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.446652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.446652+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.446652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:02.704800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"94'20","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.326747+0000","last_change":"2024-09-10T15:28:14.326819+0000","last_active":"2024-09-10T15:28:14.326747+0000","last_peered":"2024-09-10T15:28:14.326747+0000","last_clean":"2024-09-10T15:28:14.326747+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:28:14.326747+0000","last_undegraded":"2024-09-10T15:28:14.326747+0000","last_fullsized":"2024-09-10T15:28:14.326747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:14.326557+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:14.326557+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.326557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:18.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.223347+0000","last_change":"2024-09-10T15:28:06.223397+0000","last_active":"2024-09-10T15:28:06.223347+0000","last_peered":"2024-09-10T15:28:06.223347+0000","last_clean":"2024-09-10T15:28:06.223347+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:28:06.223347+0000","last_undegraded":"2024-09-10T15:28:06.223347+0000","last_fullsized":"2024-09-10T15:28:06.223347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.223149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.223149+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.223149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:22.953621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"94'36","reported_seq":201,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.702652+0000","last_change":"2024-09-10T15:28:04.702743+0000","last_active":"2024-09-10T15:28:04.702652+0000","last_peered":"2024-09-10T15:28:04.702652+0000","last_clean":"2024-09-10T15:28:04.702652+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:28:04.702652+0000","last_undegraded":"2024-09-10T15:28:04.702652+0000","last_fullsized":"2024-09-10T15:28:04.702652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36","last_scrub_stamp":"2024-09-10T15:28:04.702463+0000","last_deep_scrub":"94'36","last_deep_scrub_stamp":"2024-09-10T15:28:04.702463+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.702463+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:56.597006+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":103,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.413946+0000","last_change":"2024-09-10T15:28:07.413998+0000","last_active":"2024-09-10T15:28:07.413946+0000","last_peered":"2024-09-10T15:28:07.413946+0000","last_clean":"2024-09-10T15:28:07.413946+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:28:07.413946+0000","last_undegraded":"2024-09-10T15:28:07.413946+0000","last_fullsized":"2024-09-10T15:28:07.413946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.413733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.413733+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.413733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:22.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.189160+0000","last_change":"2024-09-10T15:25:21.895220+0000","last_active":"2024-09-10T15:27:33.189160+0000","last_peered":"2024-09-10T15:27:33.189160+0000","last_clean":"2024-09-10T15:27:33.189160+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:27:33.189160+0000","last_undegraded":"2024-09-10T15:27:33.189160+0000","last_fullsized":"2024-09-10T15:27:33.189160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.408923+0000","last_change":"2024-09-10T15:28:05.408945+0000","last_active":"2024-09-10T15:28:05.408923+0000","last_peered":"2024-09-10T15:28:05.408923+0000","last_clean":"2024-09-10T15:28:05.408923+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:28:05.408923+0000","last_undegraded":"2024-09-10T15:28:05.408923+0000","last_fullsized":"2024-09-10T15:28:05.408923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.408844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.408844+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.408844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:41.714196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.729892+0000","last_change":"2024-09-10T15:28:20.729957+0000","last_active":"2024-09-10T15:28:20.729892+0000","last_peered":"2024-09-10T15:28:20.729892+0000","last_clean":"2024-09-10T15:28:20.729892+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:28:20.729892+0000","last_undegraded":"2024-09-10T15:28:20.729892+0000","last_fullsized":"2024-09-10T15:28:20.729892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:20.729648+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:20.729648+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.729648+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:54.467440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.786279+0000","last_change":"2024-09-10T15:28:08.786333+0000","last_active":"2024-09-10T15:28:08.786279+0000","last_peered":"2024-09-10T15:28:08.786279+0000","last_clean":"2024-09-10T15:28:08.786279+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:28:08.786279+0000","last_undegraded":"2024-09-10T15:28:08.786279+0000","last_fullsized":"2024-09-10T15:28:08.786279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.786060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.786060+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.786060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:44.941815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"94'27","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.367116+0000","last_change":"2024-09-10T15:28:12.367296+0000","last_active":"2024-09-10T15:28:12.367116+0000","last_peered":"2024-09-10T15:28:12.367116+0000","last_clean":"2024-09-10T15:28:12.367116+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:28:12.367116+0000","last_undegraded":"2024-09-10T15:28:12.367116+0000","last_fullsized":"2024-09-10T15:28:12.367116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'27","last_scrub_stamp":"2024-09-10T15:28:12.366890+0000","last_deep_scrub":"94'27","last_deep_scrub_stamp":"2024-09-10T15:28:12.366890+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.366890+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:58.332432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":770,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.190126+0000","last_change":"2024-09-10T15:25:19.894031+0000","last_active":"2024-09-10T15:27:38.190126+0000","last_peered":"2024-09-10T15:27:38.190126+0000","last_clean":"2024-09-10T15:27:38.190126+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:27:38.190126+0000","last_undegraded":"2024-09-10T15:27:38.190126+0000","last_fullsized":"2024-09-10T15:27:38.190126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.693691+0000","last_change":"2024-09-10T15:25:21.895098+0000","last_active":"2024-09-10T15:27:28.693691+0000","last_peered":"2024-09-10T15:27:28.693691+0000","last_clean":"2024-09-10T15:27:28.693691+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:27:28.693691+0000","last_undegraded":"2024-09-10T15:27:28.693691+0000","last_fullsized":"2024-09-10T15:27:28.693691+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416591+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416591+0000","last_peered":"2024-09-10T15:27:28.416591+0000","last_clean":"2024-09-10T15:27:28.416591+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416591+0000","last_undegraded":"2024-09-10T15:27:28.416591+0000","last_fullsized":"2024-09-10T15:27:28.416591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"94'10","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.222536+0000","last_change":"2024-09-10T15:25:11.833030+0000","last_active":"2024-09-10T15:27:59.222536+0000","last_peered":"2024-09-10T15:27:59.222536+0000","last_clean":"2024-09-10T15:27:59.222536+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:27:59.222536+0000","last_undegraded":"2024-09-10T15:27:59.222536+0000","last_fullsized":"2024-09-10T15:27:59.222536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.195114+0000","last_change":"2024-09-10T15:25:15.856195+0000","last_active":"2024-09-10T15:27:33.195114+0000","last_peered":"2024-09-10T15:27:33.195114+0000","last_clean":"2024-09-10T15:27:33.195114+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:27:33.195114+0000","last_undegraded":"2024-09-10T15:27:33.195114+0000","last_fullsized":"2024-09-10T15:27:33.195114+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:14.817065+0000","last_clean_scrub_stamp":"2024-09-10T15:25:14.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"94'23","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.137221+0000","last_change":"2024-09-10T15:25:17.866311+0000","last_active":"2024-09-10T15:27:59.137221+0000","last_peered":"2024-09-10T15:27:59.137221+0000","last_clean":"2024-09-10T15:27:59.137221+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:27:59.137221+0000","last_undegraded":"2024-09-10T15:27:59.137221+0000","last_fullsized":"2024-09-10T15:27:59.137221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'18","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.803408+0000","last_change":"2024-09-10T15:28:11.803530+0000","last_active":"2024-09-10T15:28:11.803408+0000","last_peered":"2024-09-10T15:28:11.803408+0000","last_clean":"2024-09-10T15:28:11.803408+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:28:11.803408+0000","last_undegraded":"2024-09-10T15:28:11.803408+0000","last_fullsized":"2024-09-10T15:28:11.803408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:11.803181+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:11.803181+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.803181+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:21.227153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.331717+0000","last_change":"2024-09-10T15:25:21.880863+0000","last_active":"2024-09-10T15:27:28.331717+0000","last_peered":"2024-09-10T15:27:28.331717+0000","last_clean":"2024-09-10T15:27:28.331717+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:27:28.331717+0000","last_undegraded":"2024-09-10T15:27:28.331717+0000","last_fullsized":"2024-09-10T15:27:28.331717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.341531+0000","last_change":"2024-09-10T15:25:13.841397+0000","last_active":"2024-09-10T15:27:28.341531+0000","last_peered":"2024-09-10T15:27:28.341531+0000","last_clean":"2024-09-10T15:27:28.341531+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:27:28.341531+0000","last_undegraded":"2024-09-10T15:27:28.341531+0000","last_fullsized":"2024-09-10T15:27:28.341531+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"94'16","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.253894+0000","last_change":"2024-09-10T15:25:11.845721+0000","last_active":"2024-09-10T15:27:59.253894+0000","last_peered":"2024-09-10T15:27:59.253894+0000","last_clean":"2024-09-10T15:27:59.253894+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:27:59.253894+0000","last_undegraded":"2024-09-10T15:27:59.253894+0000","last_fullsized":"2024-09-10T15:27:59.253894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"94'4","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:03.323045+0000","last_change":"2024-09-10T15:28:03.323110+0000","last_active":"2024-09-10T15:28:03.323045+0000","last_peered":"2024-09-10T15:28:03.323045+0000","last_clean":"2024-09-10T15:28:03.323045+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:28:03.323045+0000","last_undegraded":"2024-09-10T15:28:03.323045+0000","last_fullsized":"2024-09-10T15:28:03.323045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T15:28:03.322854+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T15:28:03.322854+0000","last_clean_scrub_stamp":"2024-09-10T15:28:03.322854+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:40.200094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.191180+0000","last_change":"2024-09-10T15:25:17.874054+0000","last_active":"2024-09-10T15:27:33.191180+0000","last_peered":"2024-09-10T15:27:33.191180+0000","last_clean":"2024-09-10T15:27:33.191180+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:27:33.191180+0000","last_undegraded":"2024-09-10T15:27:33.191180+0000","last_fullsized":"2024-09-10T15:27:33.191180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'18","reported_seq":204,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.290994+0000","last_change":"2024-09-10T15:28:16.291073+0000","last_active":"2024-09-10T15:28:16.290994+0000","last_peered":"2024-09-10T15:28:16.290994+0000","last_clean":"2024-09-10T15:28:16.290994+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:28:16.290994+0000","last_undegraded":"2024-09-10T15:28:16.290994+0000","last_fullsized":"2024-09-10T15:28:16.290994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:16.290798+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:16.290798+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.290798+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:17.833998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340549+0000","last_change":"2024-09-10T15:25:21.886862+0000","last_active":"2024-09-10T15:27:28.340549+0000","last_peered":"2024-09-10T15:27:28.340549+0000","last_clean":"2024-09-10T15:27:28.340549+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:27:28.340549+0000","last_undegraded":"2024-09-10T15:27:28.340549+0000","last_fullsized":"2024-09-10T15:27:28.340549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.769058+0000","last_change":"2024-09-10T15:28:12.769114+0000","last_active":"2024-09-10T15:28:12.769058+0000","last_peered":"2024-09-10T15:28:12.769058+0000","last_clean":"2024-09-10T15:28:12.769058+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:28:12.769058+0000","last_undegraded":"2024-09-10T15:28:12.769058+0000","last_fullsized":"2024-09-10T15:28:12.769058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.768855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.768855+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.768855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:19.846162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"94'18","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.375703+0000","last_change":"2024-09-10T15:25:11.838830+0000","last_active":"2024-09-10T15:27:59.375703+0000","last_peered":"2024-09-10T15:27:59.375703+0000","last_clean":"2024-09-10T15:27:59.375703+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:27:59.375703+0000","last_undegraded":"2024-09-10T15:27:59.375703+0000","last_fullsized":"2024-09-10T15:27:59.375703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.228044+0000","last_change":"2024-09-10T15:28:12.228102+0000","last_active":"2024-09-10T15:28:12.228044+0000","last_peered":"2024-09-10T15:28:12.228044+0000","last_clean":"2024-09-10T15:28:12.228044+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:28:12.228044+0000","last_undegraded":"2024-09-10T15:28:12.228044+0000","last_fullsized":"2024-09-10T15:28:12.228044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.227843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.227843+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.227843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:05.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"94'32","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.364433+0000","last_change":"2024-09-10T15:28:14.364535+0000","last_active":"2024-09-10T15:28:14.364433+0000","last_peered":"2024-09-10T15:28:14.364433+0000","last_clean":"2024-09-10T15:28:14.364433+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:28:14.364433+0000","last_undegraded":"2024-09-10T15:28:14.364433+0000","last_fullsized":"2024-09-10T15:28:14.364433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'32","last_scrub_stamp":"2024-09-10T15:28:14.364256+0000","last_deep_scrub":"94'32","last_deep_scrub_stamp":"2024-09-10T15:28:14.364256+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.364256+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:48.102048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.191363+0000","last_change":"2024-09-10T15:25:19.886232+0000","last_active":"2024-09-10T15:27:38.191363+0000","last_peered":"2024-09-10T15:27:38.191363+0000","last_clean":"2024-09-10T15:27:38.191363+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:27:38.191363+0000","last_undegraded":"2024-09-10T15:27:38.191363+0000","last_fullsized":"2024-09-10T15:27:38.191363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490078+0000","last_change":"2024-09-10T15:25:21.882468+0000","last_active":"2024-09-10T15:27:28.490078+0000","last_peered":"2024-09-10T15:27:28.490078+0000","last_clean":"2024-09-10T15:27:28.490078+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:27:28.490078+0000","last_undegraded":"2024-09-10T15:27:28.490078+0000","last_fullsized":"2024-09-10T15:27:28.490078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416267+0000","last_change":"2024-09-10T15:25:13.846726+0000","last_active":"2024-09-10T15:27:28.416267+0000","last_peered":"2024-09-10T15:27:28.416267+0000","last_clean":"2024-09-10T15:27:28.416267+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:27:28.416267+0000","last_undegraded":"2024-09-10T15:27:28.416267+0000","last_fullsized":"2024-09-10T15:27:28.416267+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"94'119","reported_seq":326,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.301754+0000","last_change":"2024-09-10T15:28:18.301835+0000","last_active":"2024-09-10T15:28:18.301754+0000","last_peered":"2024-09-10T15:28:18.301754+0000","last_clean":"2024-09-10T15:28:18.301754+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:28:18.301754+0000","last_undegraded":"2024-09-10T15:28:18.301754+0000","last_fullsized":"2024-09-10T15:28:18.301754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'119","last_scrub_stamp":"2024-09-10T15:28:18.301551+0000","last_deep_scrub":"94'119","last_deep_scrub_stamp":"2024-09-10T15:28:18.301551+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.301551+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:58.514533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415769+0000","last_change":"2024-09-10T15:25:05.543386+0000","last_active":"2024-09-10T15:27:28.415769+0000","last_peered":"2024-09-10T15:27:28.415769+0000","last_clean":"2024-09-10T15:27:28.415769+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:27:28.415769+0000","last_undegraded":"2024-09-10T15:27:28.415769+0000","last_fullsized":"2024-09-10T15:27:28.415769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"94'24","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.253715+0000","last_change":"2024-09-10T15:25:11.822756+0000","last_active":"2024-09-10T15:27:59.253715+0000","last_peered":"2024-09-10T15:27:59.253715+0000","last_clean":"2024-09-10T15:27:59.253715+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:27:59.253715+0000","last_undegraded":"2024-09-10T15:27:59.253715+0000","last_fullsized":"2024-09-10T15:27:59.253715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":49176,"num_write":64,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.363824+0000","last_change":"2024-09-10T15:28:06.363895+0000","last_active":"2024-09-10T15:28:06.363824+0000","last_peered":"2024-09-10T15:28:06.363824+0000","last_clean":"2024-09-10T15:28:06.363824+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:28:06.363824+0000","last_undegraded":"2024-09-10T15:28:06.363824+0000","last_fullsized":"2024-09-10T15:28:06.363824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.363643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.363643+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.363643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:11.269225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'44","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.195215+0000","last_change":"2024-09-10T15:28:05.195290+0000","last_active":"2024-09-10T15:28:05.195215+0000","last_peered":"2024-09-10T15:28:05.195215+0000","last_clean":"2024-09-10T15:28:05.195215+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:28:05.195215+0000","last_undegraded":"2024-09-10T15:28:05.195215+0000","last_fullsized":"2024-09-10T15:28:05.195215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'44","last_scrub_stamp":"2024-09-10T15:28:05.194997+0000","last_deep_scrub":"94'44","last_deep_scrub_stamp":"2024-09-10T15:28:05.194997+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.194997+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:19.948133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":140,"num_write":50,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.459354+0000","last_change":"2024-09-10T15:28:09.459405+0000","last_active":"2024-09-10T15:28:09.459354+0000","last_peered":"2024-09-10T15:28:09.459354+0000","last_clean":"2024-09-10T15:28:09.459354+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:28:09.459354+0000","last_undegraded":"2024-09-10T15:28:09.459354+0000","last_fullsized":"2024-09-10T15:28:09.459354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.459158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.459158+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.459158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.804839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.185472+0000","last_change":"2024-09-10T15:25:21.897656+0000","last_active":"2024-09-10T15:27:33.185472+0000","last_peered":"2024-09-10T15:27:33.185472+0000","last_clean":"2024-09-10T15:27:33.185472+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:27:33.185472+0000","last_undegraded":"2024-09-10T15:27:33.185472+0000","last_fullsized":"2024-09-10T15:27:33.185472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.399187+0000","last_change":"2024-09-10T15:28:16.399239+0000","last_active":"2024-09-10T15:28:16.399187+0000","last_peered":"2024-09-10T15:28:16.399187+0000","last_clean":"2024-09-10T15:28:16.399187+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:28:16.399187+0000","last_undegraded":"2024-09-10T15:28:16.399187+0000","last_fullsized":"2024-09-10T15:28:16.399187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.399000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.399000+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.399000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:08.912626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415521+0000","last_change":"2024-09-10T15:25:05.543265+0000","last_active":"2024-09-10T15:27:28.415521+0000","last_peered":"2024-09-10T15:27:28.415521+0000","last_clean":"2024-09-10T15:27:28.415521+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:27:28.415521+0000","last_undegraded":"2024-09-10T15:27:28.415521+0000","last_fullsized":"2024-09-10T15:27:28.415521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"94'28","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.296195+0000","last_change":"2024-09-10T15:28:22.296324+0000","last_active":"2024-09-10T15:28:22.296195+0000","last_peered":"2024-09-10T15:28:22.296195+0000","last_clean":"2024-09-10T15:28:22.296195+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:28:22.296195+0000","last_undegraded":"2024-09-10T15:28:22.296195+0000","last_fullsized":"2024-09-10T15:28:22.296195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'28","last_scrub_stamp":"2024-09-10T15:28:22.295934+0000","last_deep_scrub":"94'28","last_deep_scrub_stamp":"2024-09-10T15:28:22.295934+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.295934+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:05.621936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49164,"num_write":48,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.300687+0000","last_change":"2024-09-10T15:28:16.300738+0000","last_active":"2024-09-10T15:28:16.300687+0000","last_peered":"2024-09-10T15:28:16.300687+0000","last_clean":"2024-09-10T15:28:16.300687+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:28:16.300687+0000","last_undegraded":"2024-09-10T15:28:16.300687+0000","last_fullsized":"2024-09-10T15:28:16.300687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.300492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.300492+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.300492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:09.568897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'69","reported_seq":274,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.839095+0000","last_change":"2024-09-10T15:28:09.839178+0000","last_active":"2024-09-10T15:28:09.839095+0000","last_peered":"2024-09-10T15:28:09.839095+0000","last_clean":"2024-09-10T15:28:09.839095+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:28:09.839095+0000","last_undegraded":"2024-09-10T15:28:09.839095+0000","last_fullsized":"2024-09-10T15:28:09.839095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69","last_scrub_stamp":"2024-09-10T15:28:09.838913+0000","last_deep_scrub":"94'69","last_deep_scrub_stamp":"2024-09-10T15:28:09.838913+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.838913+0000","objects_scrubbed":10,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:46.716153+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":106,"num_read_kb":151,"num_write":60,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.255889+0000","last_change":"2024-09-10T15:28:14.255942+0000","last_active":"2024-09-10T15:28:14.255889+0000","last_peered":"2024-09-10T15:28:14.255889+0000","last_clean":"2024-09-10T15:28:14.255889+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:28:14.255889+0000","last_undegraded":"2024-09-10T15:28:14.255889+0000","last_fullsized":"2024-09-10T15:28:14.255889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.255662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.255662+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.255662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:33.232191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.195066+0000","last_change":"2024-09-10T15:25:21.901455+0000","last_active":"2024-09-10T15:27:33.195066+0000","last_peered":"2024-09-10T15:27:33.195066+0000","last_clean":"2024-09-10T15:27:33.195066+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:27:33.195066+0000","last_undegraded":"2024-09-10T15:27:33.195066+0000","last_fullsized":"2024-09-10T15:27:33.195066+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.193090+0000","last_change":"2024-09-10T15:28:14.193148+0000","last_active":"2024-09-10T15:28:14.193090+0000","last_peered":"2024-09-10T15:28:14.193090+0000","last_clean":"2024-09-10T15:28:14.193090+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:28:14.193090+0000","last_undegraded":"2024-09-10T15:28:14.193090+0000","last_fullsized":"2024-09-10T15:28:14.193090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.192901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.192901+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.192901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:26.237652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.810225+0000","last_change":"2024-09-10T15:28:17.810281+0000","last_active":"2024-09-10T15:28:17.810225+0000","last_peered":"2024-09-10T15:28:17.810225+0000","last_clean":"2024-09-10T15:28:17.810225+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:28:17.810225+0000","last_undegraded":"2024-09-10T15:28:17.810225+0000","last_fullsized":"2024-09-10T15:28:17.810225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.810031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.810031+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.810031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:29.854782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"94'14","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.381088+0000","last_change":"2024-09-10T15:25:11.850685+0000","last_active":"2024-09-10T15:27:59.381088+0000","last_peered":"2024-09-10T15:27:59.381088+0000","last_clean":"2024-09-10T15:27:59.381088+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:27:59.381088+0000","last_undegraded":"2024-09-10T15:27:59.381088+0000","last_fullsized":"2024-09-10T15:27:59.381088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"94'2","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.818229+0000","last_change":"2024-09-10T15:28:10.818300+0000","last_active":"2024-09-10T15:28:10.818229+0000","last_peered":"2024-09-10T15:28:10.818229+0000","last_clean":"2024-09-10T15:28:10.818229+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:28:10.818229+0000","last_undegraded":"2024-09-10T15:28:10.818229+0000","last_fullsized":"2024-09-10T15:28:10.818229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:10.818023+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:10.818023+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.818023+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:48.672320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'24","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.328453+0000","last_change":"2024-09-10T15:28:22.328538+0000","last_active":"2024-09-10T15:28:22.328453+0000","last_peered":"2024-09-10T15:28:22.328453+0000","last_clean":"2024-09-10T15:28:22.328453+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:28:22.328453+0000","last_undegraded":"2024-09-10T15:28:22.328453+0000","last_fullsized":"2024-09-10T15:28:22.328453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:22.328241+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:22.328241+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.328241+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:14.841866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.315016+0000","last_change":"2024-09-10T15:25:19.871581+0000","last_active":"2024-09-10T15:27:28.315016+0000","last_peered":"2024-09-10T15:27:28.315016+0000","last_clean":"2024-09-10T15:27:28.315016+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:27:28.315016+0000","last_undegraded":"2024-09-10T15:27:28.315016+0000","last_fullsized":"2024-09-10T15:27:28.315016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.191298+0000","last_change":"2024-09-10T15:25:21.902707+0000","last_active":"2024-09-10T15:27:38.191298+0000","last_peered":"2024-09-10T15:27:38.191298+0000","last_clean":"2024-09-10T15:27:38.191298+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:27:38.191298+0000","last_undegraded":"2024-09-10T15:27:38.191298+0000","last_fullsized":"2024-09-10T15:27:38.191298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.333931+0000","last_change":"2024-09-10T15:25:13.851779+0000","last_active":"2024-09-10T15:27:28.333931+0000","last_peered":"2024-09-10T15:27:28.333931+0000","last_clean":"2024-09-10T15:27:28.333931+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:27:28.333931+0000","last_undegraded":"2024-09-10T15:27:28.333931+0000","last_fullsized":"2024-09-10T15:27:28.333931+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.415619+0000","last_change":"2024-09-10T15:25:05.544219+0000","last_active":"2024-09-10T15:27:28.415619+0000","last_peered":"2024-09-10T15:27:28.415619+0000","last_clean":"2024-09-10T15:27:28.415619+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:27:28.415619+0000","last_undegraded":"2024-09-10T15:27:28.415619+0000","last_fullsized":"2024-09-10T15:27:28.415619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"94'14","reported_seq":119,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.375618+0000","last_change":"2024-09-10T15:25:51.439594+0000","last_active":"2024-09-10T15:27:59.375618+0000","last_peered":"2024-09-10T15:27:59.375618+0000","last_clean":"2024-09-10T15:27:59.375618+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:27:59.375618+0000","last_undegraded":"2024-09-10T15:27:59.375618+0000","last_fullsized":"2024-09-10T15:27:59.375618+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.767883+0000","last_change":"2024-09-10T15:28:06.767943+0000","last_active":"2024-09-10T15:28:06.767883+0000","last_peered":"2024-09-10T15:28:06.767883+0000","last_clean":"2024-09-10T15:28:06.767883+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:28:06.767883+0000","last_undegraded":"2024-09-10T15:28:06.767883+0000","last_fullsized":"2024-09-10T15:28:06.767883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.767689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.767689+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.767689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:04.259990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"94'18","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.504780+0000","last_change":"2024-09-10T15:28:10.504864+0000","last_active":"2024-09-10T15:28:10.504780+0000","last_peered":"2024-09-10T15:28:10.504780+0000","last_clean":"2024-09-10T15:28:10.504780+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:28:10.504780+0000","last_undegraded":"2024-09-10T15:28:10.504780+0000","last_fullsized":"2024-09-10T15:28:10.504780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:10.504568+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:10.504568+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.504568+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:35.891993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.187165+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:33.187165+0000","last_peered":"2024-09-10T15:27:33.187165+0000","last_clean":"2024-09-10T15:27:33.187165+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:33.187165+0000","last_undegraded":"2024-09-10T15:27:33.187165+0000","last_fullsized":"2024-09-10T15:27:33.187165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.182824+0000","last_change":"2024-09-10T15:25:21.890156+0000","last_active":"2024-09-10T15:27:33.182824+0000","last_peered":"2024-09-10T15:27:33.182824+0000","last_clean":"2024-09-10T15:27:33.182824+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:27:33.182824+0000","last_undegraded":"2024-09-10T15:27:33.182824+0000","last_fullsized":"2024-09-10T15:27:33.182824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332212+0000","last_change":"2024-09-10T15:25:13.849068+0000","last_active":"2024-09-10T15:27:28.332212+0000","last_peered":"2024-09-10T15:27:28.332212+0000","last_clean":"2024-09-10T15:27:28.332212+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:27:28.332212+0000","last_undegraded":"2024-09-10T15:27:28.332212+0000","last_fullsized":"2024-09-10T15:27:28.332212+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.531208+0000","last_change":"2024-09-10T15:28:21.531275+0000","last_active":"2024-09-10T15:28:21.531208+0000","last_peered":"2024-09-10T15:28:21.531208+0000","last_clean":"2024-09-10T15:28:21.531208+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:28:21.531208+0000","last_undegraded":"2024-09-10T15:28:21.531208+0000","last_fullsized":"2024-09-10T15:28:21.531208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:21.531004+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:21.531004+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.531004+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:04.857005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":162,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.697422+0000","last_change":"2024-09-10T15:25:05.536068+0000","last_active":"2024-09-10T15:27:28.697422+0000","last_peered":"2024-09-10T15:27:28.697422+0000","last_clean":"2024-09-10T15:27:28.697422+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:27:28.697422+0000","last_undegraded":"2024-09-10T15:27:28.697422+0000","last_fullsized":"2024-09-10T15:27:28.697422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.555470+0000","last_change":"2024-09-10T15:28:19.555531+0000","last_active":"2024-09-10T15:28:19.555470+0000","last_peered":"2024-09-10T15:28:19.555470+0000","last_clean":"2024-09-10T15:28:19.555470+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:28:19.555470+0000","last_undegraded":"2024-09-10T15:28:19.555470+0000","last_fullsized":"2024-09-10T15:28:19.555470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.555260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.555260+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.555260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.279245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"94'42","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.825700+0000","last_change":"2024-09-10T15:28:07.825818+0000","last_active":"2024-09-10T15:28:07.825700+0000","last_peered":"2024-09-10T15:28:07.825700+0000","last_clean":"2024-09-10T15:28:07.825700+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:28:07.825700+0000","last_undegraded":"2024-09-10T15:28:07.825700+0000","last_fullsized":"2024-09-10T15:28:07.825700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42","last_scrub_stamp":"2024-09-10T15:28:07.825515+0000","last_deep_scrub":"94'42","last_deep_scrub_stamp":"2024-09-10T15:28:07.825515+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.825515+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:25.897632+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":90,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.340433+0000","last_change":"2024-09-10T15:25:19.888493+0000","last_active":"2024-09-10T15:27:28.340433+0000","last_peered":"2024-09-10T15:27:28.340433+0000","last_clean":"2024-09-10T15:27:28.340433+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:27:28.340433+0000","last_undegraded":"2024-09-10T15:27:28.340433+0000","last_fullsized":"2024-09-10T15:27:28.340433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.196082+0000","last_change":"2024-09-10T15:25:21.897282+0000","last_active":"2024-09-10T15:27:38.196082+0000","last_peered":"2024-09-10T15:27:38.196082+0000","last_clean":"2024-09-10T15:27:38.196082+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:27:38.196082+0000","last_undegraded":"2024-09-10T15:27:38.196082+0000","last_fullsized":"2024-09-10T15:27:38.196082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.267721+0000","last_change":"2024-09-10T15:28:16.267802+0000","last_active":"2024-09-10T15:28:16.267721+0000","last_peered":"2024-09-10T15:28:16.267721+0000","last_clean":"2024-09-10T15:28:16.267721+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:28:16.267721+0000","last_undegraded":"2024-09-10T15:28:16.267721+0000","last_fullsized":"2024-09-10T15:28:16.267721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.267507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.267507+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.267507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:48.314073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.288935+0000","last_change":"2024-09-10T15:28:21.288996+0000","last_active":"2024-09-10T15:28:21.288935+0000","last_peered":"2024-09-10T15:28:21.288935+0000","last_clean":"2024-09-10T15:28:21.288935+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:28:21.288935+0000","last_undegraded":"2024-09-10T15:28:21.288935+0000","last_fullsized":"2024-09-10T15:28:21.288935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:21.288727+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:21.288727+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.288727+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:01.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414840+0000","last_change":"2024-09-10T15:25:05.542546+0000","last_active":"2024-09-10T15:27:28.414840+0000","last_peered":"2024-09-10T15:27:28.414840+0000","last_clean":"2024-09-10T15:27:28.414840+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:27:28.414840+0000","last_undegraded":"2024-09-10T15:27:28.414840+0000","last_fullsized":"2024-09-10T15:27:28.414840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.317978+0000","last_change":"2024-09-10T15:28:08.318036+0000","last_active":"2024-09-10T15:28:08.317978+0000","last_peered":"2024-09-10T15:28:08.317978+0000","last_clean":"2024-09-10T15:28:08.317978+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:28:08.317978+0000","last_undegraded":"2024-09-10T15:28:08.317978+0000","last_fullsized":"2024-09-10T15:28:08.317978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.317783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.317783+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.317783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:43.508772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.332097+0000","last_change":"2024-09-10T15:25:17.873480+0000","last_active":"2024-09-10T15:27:28.332097+0000","last_peered":"2024-09-10T15:27:28.332097+0000","last_clean":"2024-09-10T15:27:28.332097+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:27:28.332097+0000","last_undegraded":"2024-09-10T15:27:28.332097+0000","last_fullsized":"2024-09-10T15:27:28.332097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'18","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.392371+0000","last_change":"2024-09-10T15:25:19.884539+0000","last_active":"2024-09-10T15:27:59.392371+0000","last_peered":"2024-09-10T15:27:59.392371+0000","last_clean":"2024-09-10T15:27:59.392371+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:27:59.392371+0000","last_undegraded":"2024-09-10T15:27:59.392371+0000","last_fullsized":"2024-09-10T15:27:59.392371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.190105+0000","last_change":"2024-09-10T15:25:21.883971+0000","last_active":"2024-09-10T15:27:38.190105+0000","last_peered":"2024-09-10T15:27:38.190105+0000","last_clean":"2024-09-10T15:27:38.190105+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:27:38.190105+0000","last_undegraded":"2024-09-10T15:27:38.190105+0000","last_fullsized":"2024-09-10T15:27:38.190105+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.614619+0000","last_change":"2024-09-10T15:28:14.614677+0000","last_active":"2024-09-10T15:28:14.614619+0000","last_peered":"2024-09-10T15:28:14.614619+0000","last_clean":"2024-09-10T15:28:14.614619+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:28:14.614619+0000","last_undegraded":"2024-09-10T15:28:14.614619+0000","last_fullsized":"2024-09-10T15:28:14.614619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.614427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.614427+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.614427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:07.754895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"94'20","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.311822+0000","last_change":"2024-09-10T15:25:11.850372+0000","last_active":"2024-09-10T15:27:59.311822+0000","last_peered":"2024-09-10T15:27:59.311822+0000","last_clean":"2024-09-10T15:27:59.311822+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:27:59.311822+0000","last_undegraded":"2024-09-10T15:27:59.311822+0000","last_fullsized":"2024-09-10T15:27:59.311822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.316248+0000","last_change":"2024-09-10T15:25:05.656824+0000","last_active":"2024-09-10T15:27:28.316248+0000","last_peered":"2024-09-10T15:27:28.316248+0000","last_clean":"2024-09-10T15:27:28.316248+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:27:28.316248+0000","last_undegraded":"2024-09-10T15:27:28.316248+0000","last_fullsized":"2024-09-10T15:27:28.316248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.281806+0000","last_change":"2024-09-10T15:28:15.281864+0000","last_active":"2024-09-10T15:28:15.281806+0000","last_peered":"2024-09-10T15:28:15.281806+0000","last_clean":"2024-09-10T15:28:15.281806+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:28:15.281806+0000","last_undegraded":"2024-09-10T15:28:15.281806+0000","last_fullsized":"2024-09-10T15:28:15.281806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.281594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.281594+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.281594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:23.291851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"94'15","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.158065+0000","last_change":"2024-09-10T15:28:08.158142+0000","last_active":"2024-09-10T15:28:08.158065+0000","last_peered":"2024-09-10T15:28:08.158065+0000","last_clean":"2024-09-10T15:28:08.158065+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:28:08.158065+0000","last_undegraded":"2024-09-10T15:28:08.158065+0000","last_fullsized":"2024-09-10T15:28:08.158065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:08.157860+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:08.157860+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.157860+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:11.817460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.446335+0000","last_change":"2024-09-10T15:28:05.446396+0000","last_active":"2024-09-10T15:28:05.446335+0000","last_peered":"2024-09-10T15:28:05.446335+0000","last_clean":"2024-09-10T15:28:05.446335+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:28:05.446335+0000","last_undegraded":"2024-09-10T15:28:05.446335+0000","last_fullsized":"2024-09-10T15:28:05.446335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:05.446121+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:05.446121+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.446121+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:08.178983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.196015+0000","last_change":"2024-09-10T15:25:21.896071+0000","last_active":"2024-09-10T15:27:38.196015+0000","last_peered":"2024-09-10T15:27:38.196015+0000","last_clean":"2024-09-10T15:27:38.196015+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:27:38.196015+0000","last_undegraded":"2024-09-10T15:27:38.196015+0000","last_fullsized":"2024-09-10T15:27:38.196015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":237,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.489609+0000","last_change":"2024-09-10T15:28:11.489721+0000","last_active":"2024-09-10T15:28:11.489609+0000","last_peered":"2024-09-10T15:28:11.489609+0000","last_clean":"2024-09-10T15:28:11.489609+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:28:11.489609+0000","last_undegraded":"2024-09-10T15:28:11.489609+0000","last_fullsized":"2024-09-10T15:28:11.489609+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'80","last_scrub_stamp":"2024-09-10T15:28:11.489305+0000","last_deep_scrub":"76'80","last_deep_scrub_stamp":"2024-09-10T15:28:11.489305+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.489305+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:14.253517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"94'14","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.326545+0000","last_change":"2024-09-10T15:25:11.838644+0000","last_active":"2024-09-10T15:27:59.326545+0000","last_peered":"2024-09-10T15:27:59.326545+0000","last_clean":"2024-09-10T15:27:59.326545+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:27:59.326545+0000","last_undegraded":"2024-09-10T15:27:59.326545+0000","last_fullsized":"2024-09-10T15:27:59.326545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.414375+0000","last_change":"2024-09-10T15:25:05.542555+0000","last_active":"2024-09-10T15:27:28.414375+0000","last_peered":"2024-09-10T15:27:28.414375+0000","last_clean":"2024-09-10T15:27:28.414375+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:27:28.414375+0000","last_undegraded":"2024-09-10T15:27:28.414375+0000","last_fullsized":"2024-09-10T15:27:28.414375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:02.507516+0000","last_clean_scrub_stamp":"2024-09-10T15:25:02.507516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.570445+0000","last_change":"2024-09-10T15:28:15.570501+0000","last_active":"2024-09-10T15:28:15.570445+0000","last_peered":"2024-09-10T15:28:15.570445+0000","last_clean":"2024-09-10T15:28:15.570445+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:28:15.570445+0000","last_undegraded":"2024-09-10T15:28:15.570445+0000","last_fullsized":"2024-09-10T15:28:15.570445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.570257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.570257+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.570257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:05.319691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"94'41","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.343695+0000","last_change":"2024-09-10T15:25:17.869444+0000","last_active":"2024-09-10T15:27:59.343695+0000","last_peered":"2024-09-10T15:27:59.343695+0000","last_clean":"2024-09-10T15:27:59.343695+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:27:59.343695+0000","last_undegraded":"2024-09-10T15:27:59.343695+0000","last_fullsized":"2024-09-10T15:27:59.343695+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314160+0000","last_change":"2024-09-10T15:25:19.889944+0000","last_active":"2024-09-10T15:27:28.314160+0000","last_peered":"2024-09-10T15:27:28.314160+0000","last_clean":"2024-09-10T15:27:28.314160+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:27:28.314160+0000","last_undegraded":"2024-09-10T15:27:28.314160+0000","last_fullsized":"2024-09-10T15:27:28.314160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:38.191390+0000","last_change":"2024-09-10T15:25:21.886475+0000","last_active":"2024-09-10T15:27:38.191390+0000","last_peered":"2024-09-10T15:27:38.191390+0000","last_clean":"2024-09-10T15:27:38.191390+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:27:38.191390+0000","last_undegraded":"2024-09-10T15:27:38.191390+0000","last_fullsized":"2024-09-10T15:27:38.191390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":130,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.314996+0000","last_change":"2024-09-10T15:25:21.897134+0000","last_active":"2024-09-10T15:27:28.314996+0000","last_peered":"2024-09-10T15:27:28.314996+0000","last_clean":"2024-09-10T15:27:28.314996+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:27:28.314996+0000","last_undegraded":"2024-09-10T15:27:28.314996+0000","last_fullsized":"2024-09-10T15:27:28.314996+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.527560+0000","last_change":"2024-09-10T15:28:15.527614+0000","last_active":"2024-09-10T15:28:15.527560+0000","last_peered":"2024-09-10T15:28:15.527560+0000","last_clean":"2024-09-10T15:28:15.527560+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:28:15.527560+0000","last_undegraded":"2024-09-10T15:28:15.527560+0000","last_fullsized":"2024-09-10T15:28:15.527560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.527362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.527362+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.527362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:47.573929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.301220+0000","last_change":"2024-09-10T15:28:21.301351+0000","last_active":"2024-09-10T15:28:21.301220+0000","last_peered":"2024-09-10T15:28:21.301220+0000","last_clean":"2024-09-10T15:28:21.301220+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:28:21.301220+0000","last_undegraded":"2024-09-10T15:28:21.301220+0000","last_fullsized":"2024-09-10T15:28:21.301220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:21.300929+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:21.300929+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.300929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.989573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":45068,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.208606+0000","last_change":"2024-09-10T15:28:07.208661+0000","last_active":"2024-09-10T15:28:07.208606+0000","last_peered":"2024-09-10T15:28:07.208606+0000","last_clean":"2024-09-10T15:28:07.208606+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:28:07.208606+0000","last_undegraded":"2024-09-10T15:28:07.208606+0000","last_fullsized":"2024-09-10T15:28:07.208606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.208393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.208393+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.208393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:45.062690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"94'26","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.200051+0000","last_change":"2024-09-10T15:28:13.200199+0000","last_active":"2024-09-10T15:28:13.200051+0000","last_peered":"2024-09-10T15:28:13.200051+0000","last_clean":"2024-09-10T15:28:13.200051+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:28:13.200051+0000","last_undegraded":"2024-09-10T15:28:13.200051+0000","last_fullsized":"2024-09-10T15:28:13.200051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:13.199820+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:13.199820+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.199820+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.301663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.799437+0000","last_change":"2024-09-10T15:28:15.799494+0000","last_active":"2024-09-10T15:28:15.799437+0000","last_peered":"2024-09-10T15:28:15.799437+0000","last_clean":"2024-09-10T15:28:15.799437+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:28:15.799437+0000","last_undegraded":"2024-09-10T15:28:15.799437+0000","last_fullsized":"2024-09-10T15:28:15.799437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.799245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.799245+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.799245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:07.693788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.492184+0000","last_change":"2024-09-10T15:25:21.899396+0000","last_active":"2024-09-10T15:27:28.492184+0000","last_peered":"2024-09-10T15:27:28.492184+0000","last_clean":"2024-09-10T15:27:28.492184+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:27:28.492184+0000","last_undegraded":"2024-09-10T15:27:28.492184+0000","last_fullsized":"2024-09-10T15:27:28.492184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.190292+0000","last_change":"2024-09-10T15:25:13.839320+0000","last_active":"2024-09-10T15:27:33.190292+0000","last_peered":"2024-09-10T15:27:33.190292+0000","last_clean":"2024-09-10T15:27:33.190292+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:27:33.190292+0000","last_undegraded":"2024-09-10T15:27:33.190292+0000","last_fullsized":"2024-09-10T15:27:33.190292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.373604+0000","last_change":"2024-09-10T15:28:13.373663+0000","last_active":"2024-09-10T15:28:13.373604+0000","last_peered":"2024-09-10T15:28:13.373604+0000","last_clean":"2024-09-10T15:28:13.373604+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:28:13.373604+0000","last_undegraded":"2024-09-10T15:28:13.373604+0000","last_fullsized":"2024-09-10T15:28:13.373604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:13.373405+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:13.373405+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.373405+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:59.338948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.524187+0000","last_change":"2024-09-10T15:28:17.524250+0000","last_active":"2024-09-10T15:28:17.524187+0000","last_peered":"2024-09-10T15:28:17.524187+0000","last_clean":"2024-09-10T15:28:17.524187+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:28:17.524187+0000","last_undegraded":"2024-09-10T15:28:17.524187+0000","last_fullsized":"2024-09-10T15:28:17.524187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.523948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.523948+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.523948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:02.782096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"94'8","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.700601+0000","last_change":"2024-09-10T15:28:08.700669+0000","last_active":"2024-09-10T15:28:08.700601+0000","last_peered":"2024-09-10T15:28:08.700601+0000","last_clean":"2024-09-10T15:28:08.700601+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:28:08.700601+0000","last_undegraded":"2024-09-10T15:28:08.700601+0000","last_fullsized":"2024-09-10T15:28:08.700601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:08.700414+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:08.700414+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.700414+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.046095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.192135+0000","last_change":"2024-09-10T15:25:19.895911+0000","last_active":"2024-09-10T15:27:43.192135+0000","last_peered":"2024-09-10T15:27:43.192135+0000","last_clean":"2024-09-10T15:27:43.192135+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:27:43.192135+0000","last_undegraded":"2024-09-10T15:27:43.192135+0000","last_fullsized":"2024-09-10T15:27:43.192135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.194718+0000","last_change":"2024-09-10T15:25:21.881407+0000","last_active":"2024-09-10T15:27:53.194718+0000","last_peered":"2024-09-10T15:27:53.194718+0000","last_clean":"2024-09-10T15:27:53.194718+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:27:53.194718+0000","last_undegraded":"2024-09-10T15:27:53.194718+0000","last_fullsized":"2024-09-10T15:27:53.194718+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.554589+0000","last_change":"2024-09-10T15:28:20.554641+0000","last_active":"2024-09-10T15:28:20.554589+0000","last_peered":"2024-09-10T15:28:20.554589+0000","last_clean":"2024-09-10T15:28:20.554589+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:28:20.554589+0000","last_undegraded":"2024-09-10T15:28:20.554589+0000","last_fullsized":"2024-09-10T15:28:20.554589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:20.554354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:20.554354+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.554354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:50.476162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.522414+0000","last_change":"2024-09-10T15:28:18.522472+0000","last_active":"2024-09-10T15:28:18.522414+0000","last_peered":"2024-09-10T15:28:18.522414+0000","last_clean":"2024-09-10T15:28:18.522414+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:28:18.522414+0000","last_undegraded":"2024-09-10T15:28:18.522414+0000","last_fullsized":"2024-09-10T15:28:18.522414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:18.522230+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:18.522230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.522230+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:20.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.407551+0000","last_change":"2024-09-10T15:28:06.407609+0000","last_active":"2024-09-10T15:28:06.407551+0000","last_peered":"2024-09-10T15:28:06.407551+0000","last_clean":"2024-09-10T15:28:06.407551+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:28:06.407551+0000","last_undegraded":"2024-09-10T15:28:06.407551+0000","last_fullsized":"2024-09-10T15:28:06.407551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.407347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.407347+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.407347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:23.137819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"94'22","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.742879+0000","last_change":"2024-09-10T15:28:05.742964+0000","last_active":"2024-09-10T15:28:05.742879+0000","last_peered":"2024-09-10T15:28:05.742879+0000","last_clean":"2024-09-10T15:28:05.742879+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:28:05.742879+0000","last_undegraded":"2024-09-10T15:28:05.742879+0000","last_fullsized":"2024-09-10T15:28:05.742879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:05.742670+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:05.742670+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.742670+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:02.895762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.184806+0000","last_change":"2024-09-10T15:25:19.884354+0000","last_active":"2024-09-10T15:27:43.184806+0000","last_peered":"2024-09-10T15:27:43.184806+0000","last_clean":"2024-09-10T15:27:43.184806+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:27:43.184806+0000","last_undegraded":"2024-09-10T15:27:43.184806+0000","last_fullsized":"2024-09-10T15:27:43.184806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.191110+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:53.191110+0000","last_peered":"2024-09-10T15:27:53.191110+0000","last_clean":"2024-09-10T15:27:53.191110+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:53.191110+0000","last_undegraded":"2024-09-10T15:27:53.191110+0000","last_fullsized":"2024-09-10T15:27:53.191110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.711513+0000","last_change":"2024-09-10T15:28:21.711566+0000","last_active":"2024-09-10T15:28:21.711513+0000","last_peered":"2024-09-10T15:28:21.711513+0000","last_clean":"2024-09-10T15:28:21.711513+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:28:21.711513+0000","last_undegraded":"2024-09-10T15:28:21.711513+0000","last_fullsized":"2024-09-10T15:28:21.711513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:21.711321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:21.711321+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.711321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:13.521229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"94'14","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.248422+0000","last_change":"2024-09-10T15:25:11.849740+0000","last_active":"2024-09-10T15:27:59.248422+0000","last_peered":"2024-09-10T15:27:59.248422+0000","last_clean":"2024-09-10T15:27:59.248422+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:27:59.248422+0000","last_undegraded":"2024-09-10T15:27:59.248422+0000","last_fullsized":"2024-09-10T15:27:59.248422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.332560+0000","last_change":"2024-09-10T15:28:17.332613+0000","last_active":"2024-09-10T15:28:17.332560+0000","last_peered":"2024-09-10T15:28:17.332560+0000","last_clean":"2024-09-10T15:28:17.332560+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:28:17.332560+0000","last_undegraded":"2024-09-10T15:28:17.332560+0000","last_fullsized":"2024-09-10T15:28:17.332560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.332339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.332339+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.332339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:01.715610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"94'23","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.344733+0000","last_change":"2024-09-10T15:28:10.344885+0000","last_active":"2024-09-10T15:28:10.344733+0000","last_peered":"2024-09-10T15:28:10.344733+0000","last_clean":"2024-09-10T15:28:10.344733+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:28:10.344733+0000","last_undegraded":"2024-09-10T15:28:10.344733+0000","last_fullsized":"2024-09-10T15:28:10.344733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'23","last_scrub_stamp":"2024-09-10T15:28:10.344514+0000","last_deep_scrub":"94'23","last_deep_scrub_stamp":"2024-09-10T15:28:10.344514+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.344514+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:31.737059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.782014+0000","last_change":"2024-09-10T15:28:13.782073+0000","last_active":"2024-09-10T15:28:13.782014+0000","last_peered":"2024-09-10T15:28:13.782014+0000","last_clean":"2024-09-10T15:28:13.782014+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:28:13.782014+0000","last_undegraded":"2024-09-10T15:28:13.782014+0000","last_fullsized":"2024-09-10T15:28:13.782014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.781760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.781760+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.781760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:48.972749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.308004+0000","last_change":"2024-09-10T15:28:19.308056+0000","last_active":"2024-09-10T15:28:19.308004+0000","last_peered":"2024-09-10T15:28:19.308004+0000","last_clean":"2024-09-10T15:28:19.308004+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:28:19.308004+0000","last_undegraded":"2024-09-10T15:28:19.308004+0000","last_fullsized":"2024-09-10T15:28:19.308004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.307814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.307814+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.307814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:18.808566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"94'22","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.412069+0000","last_change":"2024-09-10T15:28:18.412131+0000","last_active":"2024-09-10T15:28:18.412069+0000","last_peered":"2024-09-10T15:28:18.412069+0000","last_clean":"2024-09-10T15:28:18.412069+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:28:18.412069+0000","last_undegraded":"2024-09-10T15:28:18.412069+0000","last_fullsized":"2024-09-10T15:28:18.412069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:18.411860+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:18.411860+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.411860+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:27.091115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.302559+0000","last_change":"2024-09-10T15:28:09.302610+0000","last_active":"2024-09-10T15:28:09.302559+0000","last_peered":"2024-09-10T15:28:09.302559+0000","last_clean":"2024-09-10T15:28:09.302559+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:28:09.302559+0000","last_undegraded":"2024-09-10T15:28:09.302559+0000","last_fullsized":"2024-09-10T15:28:09.302559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.302345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.302345+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.302345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:16.379652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"94'30","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.288524+0000","last_change":"2024-09-10T15:25:17.873131+0000","last_active":"2024-09-10T15:27:59.288524+0000","last_peered":"2024-09-10T15:27:59.288524+0000","last_clean":"2024-09-10T15:27:59.288524+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:27:59.288524+0000","last_undegraded":"2024-09-10T15:27:59.288524+0000","last_fullsized":"2024-09-10T15:27:59.288524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:16.828616+0000","last_clean_scrub_stamp":"2024-09-10T15:25:16.828616+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":76,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.193957+0000","last_change":"2024-09-10T15:25:19.885841+0000","last_active":"2024-09-10T15:27:53.193957+0000","last_peered":"2024-09-10T15:27:53.193957+0000","last_clean":"2024-09-10T15:27:53.193957+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:27:53.193957+0000","last_undegraded":"2024-09-10T15:27:53.193957+0000","last_fullsized":"2024-09-10T15:27:53.193957+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.197049+0000","last_change":"2024-09-10T15:25:21.897472+0000","last_active":"2024-09-10T15:27:43.197049+0000","last_peered":"2024-09-10T15:27:43.197049+0000","last_clean":"2024-09-10T15:27:43.197049+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:27:43.197049+0000","last_undegraded":"2024-09-10T15:27:43.197049+0000","last_fullsized":"2024-09-10T15:27:43.197049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.570731+0000","last_change":"2024-09-10T15:28:16.570782+0000","last_active":"2024-09-10T15:28:16.570731+0000","last_peered":"2024-09-10T15:28:16.570731+0000","last_clean":"2024-09-10T15:28:16.570731+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:28:16.570731+0000","last_undegraded":"2024-09-10T15:28:16.570731+0000","last_fullsized":"2024-09-10T15:28:16.570731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.570520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.570520+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.570520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:40.436103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"94'22","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.382611+0000","last_change":"2024-09-10T15:25:11.840954+0000","last_active":"2024-09-10T15:27:59.382611+0000","last_peered":"2024-09-10T15:27:59.382611+0000","last_clean":"2024-09-10T15:27:59.382611+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:27:59.382611+0000","last_undegraded":"2024-09-10T15:27:59.382611+0000","last_fullsized":"2024-09-10T15:27:59.382611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.533155+0000","last_change":"2024-09-10T15:28:12.533208+0000","last_active":"2024-09-10T15:28:12.533155+0000","last_peered":"2024-09-10T15:28:12.533155+0000","last_clean":"2024-09-10T15:28:12.533155+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:28:12.533155+0000","last_undegraded":"2024-09-10T15:28:12.533155+0000","last_fullsized":"2024-09-10T15:28:12.533155+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.532916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.532916+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.532916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:33.925461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"94'30","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.226795+0000","last_change":"2024-09-10T15:28:06.226877+0000","last_active":"2024-09-10T15:28:06.226795+0000","last_peered":"2024-09-10T15:28:06.226795+0000","last_clean":"2024-09-10T15:28:06.226795+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:28:06.226795+0000","last_undegraded":"2024-09-10T15:28:06.226795+0000","last_fullsized":"2024-09-10T15:28:06.226795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:06.226556+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:06.226556+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.226556+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:06.945254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.198990+0000","last_change":"2024-09-10T15:25:19.894940+0000","last_active":"2024-09-10T15:27:53.198990+0000","last_peered":"2024-09-10T15:27:53.198990+0000","last_clean":"2024-09-10T15:27:53.198990+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:27:53.198990+0000","last_undegraded":"2024-09-10T15:27:53.198990+0000","last_fullsized":"2024-09-10T15:27:53.198990+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188992+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:43.188992+0000","last_peered":"2024-09-10T15:27:43.188992+0000","last_clean":"2024-09-10T15:27:43.188992+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:43.188992+0000","last_undegraded":"2024-09-10T15:27:43.188992+0000","last_fullsized":"2024-09-10T15:27:43.188992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.791411+0000","last_change":"2024-09-10T15:28:16.791472+0000","last_active":"2024-09-10T15:28:16.791411+0000","last_peered":"2024-09-10T15:28:16.791411+0000","last_clean":"2024-09-10T15:28:16.791411+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:28:16.791411+0000","last_undegraded":"2024-09-10T15:28:16.791411+0000","last_fullsized":"2024-09-10T15:28:16.791411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:16.791219+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:16.791219+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.791219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:56.893061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"94'12","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.207900+0000","last_change":"2024-09-10T15:28:22.207965+0000","last_active":"2024-09-10T15:28:22.207900+0000","last_peered":"2024-09-10T15:28:22.207900+0000","last_clean":"2024-09-10T15:28:22.207900+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:28:22.207900+0000","last_undegraded":"2024-09-10T15:28:22.207900+0000","last_fullsized":"2024-09-10T15:28:22.207900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:22.207680+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:22.207680+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.207680+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:14.721305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.527746+0000","last_change":"2024-09-10T15:28:10.527798+0000","last_active":"2024-09-10T15:28:10.527746+0000","last_peered":"2024-09-10T15:28:10.527746+0000","last_clean":"2024-09-10T15:28:10.527746+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:28:10.527746+0000","last_undegraded":"2024-09-10T15:28:10.527746+0000","last_fullsized":"2024-09-10T15:28:10.527746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.527550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.527550+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.527550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:45.718539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"94'22","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.223025+0000","last_change":"2024-09-10T15:28:15.223094+0000","last_active":"2024-09-10T15:28:15.223025+0000","last_peered":"2024-09-10T15:28:15.223025+0000","last_clean":"2024-09-10T15:28:15.223025+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:28:15.223025+0000","last_undegraded":"2024-09-10T15:28:15.223025+0000","last_fullsized":"2024-09-10T15:28:15.223025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:15.222819+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:15.222819+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.222819+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:01.188362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.489479+0000","last_change":"2024-09-10T15:25:19.891692+0000","last_active":"2024-09-10T15:27:28.489479+0000","last_peered":"2024-09-10T15:27:28.489479+0000","last_clean":"2024-09-10T15:27:28.489479+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:27:28.489479+0000","last_undegraded":"2024-09-10T15:27:28.489479+0000","last_fullsized":"2024-09-10T15:27:28.489479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188896+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:43.188896+0000","last_peered":"2024-09-10T15:27:43.188896+0000","last_clean":"2024-09-10T15:27:43.188896+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:43.188896+0000","last_undegraded":"2024-09-10T15:27:43.188896+0000","last_fullsized":"2024-09-10T15:27:43.188896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.606650+0000","last_change":"2024-09-10T15:28:12.606711+0000","last_active":"2024-09-10T15:28:12.606650+0000","last_peered":"2024-09-10T15:28:12.606650+0000","last_clean":"2024-09-10T15:28:12.606650+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:28:12.606650+0000","last_undegraded":"2024-09-10T15:28:12.606650+0000","last_fullsized":"2024-09-10T15:28:12.606650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:12.606456+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:12.606456+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.606456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:52.819438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"94'26","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.227708+0000","last_change":"2024-09-10T15:25:11.835602+0000","last_active":"2024-09-10T15:27:59.227708+0000","last_peered":"2024-09-10T15:27:59.227708+0000","last_clean":"2024-09-10T15:27:59.227708+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:27:59.227708+0000","last_undegraded":"2024-09-10T15:27:59.227708+0000","last_fullsized":"2024-09-10T15:27:59.227708+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47122,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"94'2","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.609951+0000","last_change":"2024-09-10T15:28:11.610023+0000","last_active":"2024-09-10T15:28:11.609951+0000","last_peered":"2024-09-10T15:28:11.609951+0000","last_clean":"2024-09-10T15:28:11.609951+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:28:11.609951+0000","last_undegraded":"2024-09-10T15:28:11.609951+0000","last_fullsized":"2024-09-10T15:28:11.609951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:11.609746+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:11.609746+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.609746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:15.517396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"94'18","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.194858+0000","last_change":"2024-09-10T15:28:04.194896+0000","last_active":"2024-09-10T15:28:04.194858+0000","last_peered":"2024-09-10T15:28:04.194858+0000","last_clean":"2024-09-10T15:28:04.194858+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:28:04.194858+0000","last_undegraded":"2024-09-10T15:28:04.194858+0000","last_fullsized":"2024-09-10T15:28:04.194858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:04.194769+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:04.194769+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.194769+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.602958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":770,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'18","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.390756+0000","last_change":"2024-09-10T15:25:19.892528+0000","last_active":"2024-09-10T15:27:59.390756+0000","last_peered":"2024-09-10T15:27:59.390756+0000","last_clean":"2024-09-10T15:27:59.390756+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:27:59.390756+0000","last_undegraded":"2024-09-10T15:27:59.390756+0000","last_fullsized":"2024-09-10T15:27:59.390756+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188839+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:43.188839+0000","last_peered":"2024-09-10T15:27:43.188839+0000","last_clean":"2024-09-10T15:27:43.188839+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:43.188839+0000","last_undegraded":"2024-09-10T15:27:43.188839+0000","last_fullsized":"2024-09-10T15:27:43.188839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.345798+0000","last_change":"2024-09-10T15:28:04.345846+0000","last_active":"2024-09-10T15:28:04.345798+0000","last_peered":"2024-09-10T15:28:04.345798+0000","last_clean":"2024-09-10T15:28:04.345798+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:28:04.345798+0000","last_undegraded":"2024-09-10T15:28:04.345798+0000","last_fullsized":"2024-09-10T15:28:04.345798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.345669+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:22.417786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.292588+0000","last_change":"2024-09-10T15:28:20.292654+0000","last_active":"2024-09-10T15:28:20.292588+0000","last_peered":"2024-09-10T15:28:20.292588+0000","last_clean":"2024-09-10T15:28:20.292588+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:28:20.292588+0000","last_undegraded":"2024-09-10T15:28:20.292588+0000","last_fullsized":"2024-09-10T15:28:20.292588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:20.292391+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:20.292391+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.292391+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:34:10.695700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.341356+0000","last_change":"2024-09-10T15:28:08.341408+0000","last_active":"2024-09-10T15:28:08.341356+0000","last_peered":"2024-09-10T15:28:08.341356+0000","last_clean":"2024-09-10T15:28:08.341356+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:28:08.341356+0000","last_undegraded":"2024-09-10T15:28:08.341356+0000","last_fullsized":"2024-09-10T15:28:08.341356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.341166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.341166+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.341166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:11.105377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"94'30","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.349890+0000","last_change":"2024-09-10T15:28:12.349970+0000","last_active":"2024-09-10T15:28:12.349890+0000","last_peered":"2024-09-10T15:28:12.349890+0000","last_clean":"2024-09-10T15:28:12.349890+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:28:12.349890+0000","last_undegraded":"2024-09-10T15:28:12.349890+0000","last_fullsized":"2024-09-10T15:28:12.349890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:12.349697+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:12.349697+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.349697+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:24.394448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.193460+0000","last_change":"2024-09-10T15:25:19.871243+0000","last_active":"2024-09-10T15:27:48.193460+0000","last_peered":"2024-09-10T15:27:48.193460+0000","last_clean":"2024-09-10T15:27:48.193460+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:27:48.193460+0000","last_undegraded":"2024-09-10T15:27:48.193460+0000","last_fullsized":"2024-09-10T15:27:48.193460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.185984+0000","last_change":"2024-09-10T15:25:21.904518+0000","last_active":"2024-09-10T15:27:48.185984+0000","last_peered":"2024-09-10T15:27:48.185984+0000","last_clean":"2024-09-10T15:27:48.185984+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:27:48.185984+0000","last_undegraded":"2024-09-10T15:27:48.185984+0000","last_fullsized":"2024-09-10T15:27:48.185984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.384920+0000","last_change":"2024-09-10T15:28:05.384942+0000","last_active":"2024-09-10T15:28:05.384920+0000","last_peered":"2024-09-10T15:28:05.384920+0000","last_clean":"2024-09-10T15:28:05.384920+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:28:05.384920+0000","last_undegraded":"2024-09-10T15:28:05.384920+0000","last_fullsized":"2024-09-10T15:28:05.384920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.384839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.384839+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.384839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:41.540594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"94'14","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.006645+0000","last_change":"2024-09-10T15:25:11.844469+0000","last_active":"2024-09-10T15:27:59.006645+0000","last_peered":"2024-09-10T15:27:59.006645+0000","last_clean":"2024-09-10T15:27:59.006645+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:27:59.006645+0000","last_undegraded":"2024-09-10T15:27:59.006645+0000","last_fullsized":"2024-09-10T15:27:59.006645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":24594,"num_write":44,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.470384+0000","last_change":"2024-09-10T15:28:08.470502+0000","last_active":"2024-09-10T15:28:08.470384+0000","last_peered":"2024-09-10T15:28:08.470384+0000","last_clean":"2024-09-10T15:28:08.470384+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:28:08.470384+0000","last_undegraded":"2024-09-10T15:28:08.470384+0000","last_fullsized":"2024-09-10T15:28:08.470384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.470147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.470147+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.470147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:17.894119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"94'22","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.726092+0000","last_change":"2024-09-10T15:28:06.726180+0000","last_active":"2024-09-10T15:28:06.726092+0000","last_peered":"2024-09-10T15:28:06.726092+0000","last_clean":"2024-09-10T15:28:06.726092+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:28:06.726092+0000","last_undegraded":"2024-09-10T15:28:06.726092+0000","last_fullsized":"2024-09-10T15:28:06.726092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:06.725874+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:06.725874+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.725874+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:18.770624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.189996+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:48.189996+0000","last_peered":"2024-09-10T15:27:48.189996+0000","last_clean":"2024-09-10T15:27:48.189996+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:48.189996+0000","last_undegraded":"2024-09-10T15:27:48.189996+0000","last_fullsized":"2024-09-10T15:27:48.189996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":129,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.198062+0000","last_change":"2024-09-10T15:25:21.901518+0000","last_active":"2024-09-10T15:27:48.198062+0000","last_peered":"2024-09-10T15:27:48.198062+0000","last_clean":"2024-09-10T15:27:48.198062+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:27:48.198062+0000","last_undegraded":"2024-09-10T15:27:48.198062+0000","last_fullsized":"2024-09-10T15:27:48.198062+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.711119+0000","last_change":"2024-09-10T15:28:22.711182+0000","last_active":"2024-09-10T15:28:22.711119+0000","last_peered":"2024-09-10T15:28:22.711119+0000","last_clean":"2024-09-10T15:28:22.711119+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:28:22.711119+0000","last_undegraded":"2024-09-10T15:28:22.711119+0000","last_fullsized":"2024-09-10T15:28:22.711119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:22.710926+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:22.710926+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.710926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:24.254126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"94'12","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.226767+0000","last_change":"2024-09-10T15:25:11.850375+0000","last_active":"2024-09-10T15:27:59.226767+0000","last_peered":"2024-09-10T15:27:59.226767+0000","last_clean":"2024-09-10T15:27:59.226767+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:27:59.226767+0000","last_undegraded":"2024-09-10T15:27:59.226767+0000","last_fullsized":"2024-09-10T15:27:59.226767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"94'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.362550+0000","last_change":"2024-09-10T15:28:06.362631+0000","last_active":"2024-09-10T15:28:06.362550+0000","last_peered":"2024-09-10T15:28:06.362550+0000","last_clean":"2024-09-10T15:28:06.362550+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:28:06.362550+0000","last_undegraded":"2024-09-10T15:28:06.362550+0000","last_fullsized":"2024-09-10T15:28:06.362550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:06.362369+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:06.362369+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.362369+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:13.439676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"94'18","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.255748+0000","last_change":"2024-09-10T15:28:11.255817+0000","last_active":"2024-09-10T15:28:11.255748+0000","last_peered":"2024-09-10T15:28:11.255748+0000","last_clean":"2024-09-10T15:28:11.255748+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:28:11.255748+0000","last_undegraded":"2024-09-10T15:28:11.255748+0000","last_fullsized":"2024-09-10T15:28:11.255748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:11.255531+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:11.255531+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.255531+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:14.019743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":65,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.171492+0000","last_change":"2024-09-10T15:28:10.171544+0000","last_active":"2024-09-10T15:28:10.171492+0000","last_peered":"2024-09-10T15:28:10.171492+0000","last_clean":"2024-09-10T15:28:10.171492+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:28:10.171492+0000","last_undegraded":"2024-09-10T15:28:10.171492+0000","last_fullsized":"2024-09-10T15:28:10.171492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.171291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.171291+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.171291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:42.166255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.190158+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:48.190158+0000","last_peered":"2024-09-10T15:27:48.190158+0000","last_clean":"2024-09-10T15:27:48.190158+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:48.190158+0000","last_undegraded":"2024-09-10T15:27:48.190158+0000","last_fullsized":"2024-09-10T15:27:48.190158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.457308+0000","last_change":"2024-09-10T15:28:07.457361+0000","last_active":"2024-09-10T15:28:07.457308+0000","last_peered":"2024-09-10T15:28:07.457308+0000","last_clean":"2024-09-10T15:28:07.457308+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:28:07.457308+0000","last_undegraded":"2024-09-10T15:28:07.457308+0000","last_fullsized":"2024-09-10T15:28:07.457308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.457108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.457108+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.457108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:45.311405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"94'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.368929+0000","last_change":"2024-09-10T15:25:11.850441+0000","last_active":"2024-09-10T15:27:59.368929+0000","last_peered":"2024-09-10T15:27:59.368929+0000","last_clean":"2024-09-10T15:27:59.368929+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:27:59.368929+0000","last_undegraded":"2024-09-10T15:27:59.368929+0000","last_fullsized":"2024-09-10T15:27:59.368929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"94'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.567698+0000","last_change":"2024-09-10T15:28:21.567764+0000","last_active":"2024-09-10T15:28:21.567698+0000","last_peered":"2024-09-10T15:28:21.567698+0000","last_clean":"2024-09-10T15:28:21.567698+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:28:21.567698+0000","last_undegraded":"2024-09-10T15:28:21.567698+0000","last_fullsized":"2024-09-10T15:28:21.567698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:21.567500+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:21.567500+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.567500+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:25.227099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"94'20","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.185943+0000","last_change":"2024-09-10T15:28:09.186040+0000","last_active":"2024-09-10T15:28:09.185943+0000","last_peered":"2024-09-10T15:28:09.185943+0000","last_clean":"2024-09-10T15:28:09.185943+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:28:09.185943+0000","last_undegraded":"2024-09-10T15:28:09.185943+0000","last_fullsized":"2024-09-10T15:28:09.185943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:09.185740+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:09.185740+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.185740+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:04.655249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":134,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.194557+0000","last_change":"2024-09-10T15:25:19.887398+0000","last_active":"2024-09-10T15:27:53.194557+0000","last_peered":"2024-09-10T15:27:53.194557+0000","last_clean":"2024-09-10T15:27:53.194557+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:27:53.194557+0000","last_undegraded":"2024-09-10T15:27:53.194557+0000","last_fullsized":"2024-09-10T15:27:53.194557+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.187586+0000","last_change":"2024-09-10T15:25:21.898805+0000","last_active":"2024-09-10T15:27:43.187586+0000","last_peered":"2024-09-10T15:27:43.187586+0000","last_clean":"2024-09-10T15:27:43.187586+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:27:43.187586+0000","last_undegraded":"2024-09-10T15:27:43.187586+0000","last_fullsized":"2024-09-10T15:27:43.187586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.556659+0000","last_change":"2024-09-10T15:28:22.556714+0000","last_active":"2024-09-10T15:28:22.556659+0000","last_peered":"2024-09-10T15:28:22.556659+0000","last_clean":"2024-09-10T15:28:22.556659+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:28:22.556659+0000","last_undegraded":"2024-09-10T15:28:22.556659+0000","last_fullsized":"2024-09-10T15:28:22.556659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:22.556457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:22.556457+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.556457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:53.008242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"94'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.480197+0000","last_change":"2024-09-10T15:28:20.480255+0000","last_active":"2024-09-10T15:28:20.480197+0000","last_peered":"2024-09-10T15:28:20.480197+0000","last_clean":"2024-09-10T15:28:20.480197+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:28:20.480197+0000","last_undegraded":"2024-09-10T15:28:20.480197+0000","last_fullsized":"2024-09-10T15:28:20.480197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:20.480004+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:20.480004+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.480004+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:00.692986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.830048+0000","last_change":"2024-09-10T15:28:14.830105+0000","last_active":"2024-09-10T15:28:14.830048+0000","last_peered":"2024-09-10T15:28:14.830048+0000","last_clean":"2024-09-10T15:28:14.830048+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:28:14.830048+0000","last_undegraded":"2024-09-10T15:28:14.830048+0000","last_fullsized":"2024-09-10T15:28:14.830048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.829829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.829829+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.829829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:17.594040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"94'6","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.787268+0000","last_change":"2024-09-10T15:28:18.787333+0000","last_active":"2024-09-10T15:28:18.787268+0000","last_peered":"2024-09-10T15:28:18.787268+0000","last_clean":"2024-09-10T15:28:18.787268+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:28:18.787268+0000","last_undegraded":"2024-09-10T15:28:18.787268+0000","last_fullsized":"2024-09-10T15:28:18.787268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T15:28:18.787079+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T15:28:18.787079+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.787079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:04.752621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416104+0000","last_change":"2024-09-10T15:25:13.846403+0000","last_active":"2024-09-10T15:27:28.416104+0000","last_peered":"2024-09-10T15:27:28.416104+0000","last_clean":"2024-09-10T15:27:28.416104+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:27:28.416104+0000","last_undegraded":"2024-09-10T15:27:28.416104+0000","last_fullsized":"2024-09-10T15:27:28.416104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"94'22","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.381833+0000","last_change":"2024-09-10T15:25:11.846836+0000","last_active":"2024-09-10T15:27:59.381833+0000","last_peered":"2024-09-10T15:27:59.381833+0000","last_clean":"2024-09-10T15:27:59.381833+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:27:59.381833+0000","last_undegraded":"2024-09-10T15:27:59.381833+0000","last_fullsized":"2024-09-10T15:27:59.381833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.404835+0000","last_change":"2024-09-10T15:28:19.404885+0000","last_active":"2024-09-10T15:28:19.404835+0000","last_peered":"2024-09-10T15:28:19.404835+0000","last_clean":"2024-09-10T15:28:19.404835+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:28:19.404835+0000","last_undegraded":"2024-09-10T15:28:19.404835+0000","last_fullsized":"2024-09-10T15:28:19.404835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.404642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.404642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.404642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.128627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"94'26","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.227723+0000","last_change":"2024-09-10T15:25:11.846784+0000","last_active":"2024-09-10T15:27:59.227723+0000","last_peered":"2024-09-10T15:27:59.227723+0000","last_clean":"2024-09-10T15:27:59.227723+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:27:59.227723+0000","last_undegraded":"2024-09-10T15:27:59.227723+0000","last_fullsized":"2024-09-10T15:27:59.227723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":51212,"num_write":46,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.462630+0000","last_change":"2024-09-10T15:28:11.462804+0000","last_active":"2024-09-10T15:28:11.462630+0000","last_peered":"2024-09-10T15:28:11.462630+0000","last_clean":"2024-09-10T15:28:11.462630+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:28:11.462630+0000","last_undegraded":"2024-09-10T15:28:11.462630+0000","last_fullsized":"2024-09-10T15:28:11.462630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:11.462398+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:11.462398+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.462398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:13.005598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"94'24","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.248422+0000","last_change":"2024-09-10T15:28:19.248484+0000","last_active":"2024-09-10T15:28:19.248422+0000","last_peered":"2024-09-10T15:28:19.248422+0000","last_clean":"2024-09-10T15:28:19.248422+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:28:19.248422+0000","last_undegraded":"2024-09-10T15:28:19.248422+0000","last_fullsized":"2024-09-10T15:28:19.248422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:19.248230+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:19.248230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.248230+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:20.791430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.340347+0000","last_change":"2024-09-10T15:28:11.340454+0000","last_active":"2024-09-10T15:28:11.340347+0000","last_peered":"2024-09-10T15:28:11.340347+0000","last_clean":"2024-09-10T15:28:11.340347+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:28:11.340347+0000","last_undegraded":"2024-09-10T15:28:11.340347+0000","last_fullsized":"2024-09-10T15:28:11.340347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.340123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.340123+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.340123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:14.072984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"94'16","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.230865+0000","last_change":"2024-09-10T15:28:18.230923+0000","last_active":"2024-09-10T15:28:18.230865+0000","last_peered":"2024-09-10T15:28:18.230865+0000","last_clean":"2024-09-10T15:28:18.230865+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:28:18.230865+0000","last_undegraded":"2024-09-10T15:28:18.230865+0000","last_fullsized":"2024-09-10T15:28:18.230865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:18.230663+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:18.230663+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.230663+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.040571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.257991+0000","last_change":"2024-09-10T15:28:10.258058+0000","last_active":"2024-09-10T15:28:10.257991+0000","last_peered":"2024-09-10T15:28:10.257991+0000","last_clean":"2024-09-10T15:28:10.257991+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:28:10.257991+0000","last_undegraded":"2024-09-10T15:28:10.257991+0000","last_fullsized":"2024-09-10T15:28:10.257991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T15:28:10.257770+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T15:28:10.257770+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.257770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:45.448759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"94'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.494825+0000","last_change":"2024-09-10T15:28:19.494885+0000","last_active":"2024-09-10T15:28:19.494825+0000","last_peered":"2024-09-10T15:28:19.494825+0000","last_clean":"2024-09-10T15:28:19.494825+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:28:19.494825+0000","last_undegraded":"2024-09-10T15:28:19.494825+0000","last_fullsized":"2024-09-10T15:28:19.494825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:19.494637+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:19.494637+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.494637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:21.062678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.332629+0000","last_change":"2024-09-10T15:28:05.332688+0000","last_active":"2024-09-10T15:28:05.332629+0000","last_peered":"2024-09-10T15:28:05.332629+0000","last_clean":"2024-09-10T15:28:05.332629+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:28:05.332629+0000","last_undegraded":"2024-09-10T15:28:05.332629+0000","last_fullsized":"2024-09-10T15:28:05.332629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'34","last_scrub_stamp":"2024-09-10T15:28:05.332434+0000","last_deep_scrub":"76'34","last_deep_scrub_stamp":"2024-09-10T15:28:05.332434+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.332434+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:14.756406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"94'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.397335+0000","last_change":"2024-09-10T15:28:22.397393+0000","last_active":"2024-09-10T15:28:22.397335+0000","last_peered":"2024-09-10T15:28:22.397335+0000","last_clean":"2024-09-10T15:28:22.397335+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:28:22.397335+0000","last_undegraded":"2024-09-10T15:28:22.397335+0000","last_fullsized":"2024-09-10T15:28:22.397335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:22.397138+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:22.397138+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.397138+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:26.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28684,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.189183+0000","last_change":"2024-09-10T15:25:13.858293+0000","last_active":"2024-09-10T15:27:33.189183+0000","last_peered":"2024-09-10T15:27:33.189183+0000","last_clean":"2024-09-10T15:27:33.189183+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:27:33.189183+0000","last_undegraded":"2024-09-10T15:27:33.189183+0000","last_fullsized":"2024-09-10T15:27:33.189183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"94'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.315200+0000","last_change":"2024-09-10T15:28:20.315261+0000","last_active":"2024-09-10T15:28:20.315200+0000","last_peered":"2024-09-10T15:28:20.315200+0000","last_clean":"2024-09-10T15:28:20.315200+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:28:20.315200+0000","last_undegraded":"2024-09-10T15:28:20.315200+0000","last_fullsized":"2024-09-10T15:28:20.315200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:20.314984+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:20.314984+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.314984+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:32.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.329904+0000","last_change":"2024-09-10T15:28:07.329963+0000","last_active":"2024-09-10T15:28:07.329904+0000","last_peered":"2024-09-10T15:28:07.329904+0000","last_clean":"2024-09-10T15:28:07.329904+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:28:07.329904+0000","last_undegraded":"2024-09-10T15:28:07.329904+0000","last_fullsized":"2024-09-10T15:28:07.329904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.329679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.329679+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.329679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:14.406986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.306933+0000","last_change":"2024-09-10T15:25:11.853992+0000","last_active":"2024-09-10T15:27:59.306933+0000","last_peered":"2024-09-10T15:27:59.306933+0000","last_clean":"2024-09-10T15:27:59.306933+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:27:59.306933+0000","last_undegraded":"2024-09-10T15:27:59.306933+0000","last_fullsized":"2024-09-10T15:27:59.306933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.417169+0000","last_change":"2024-09-10T15:28:12.417229+0000","last_active":"2024-09-10T15:28:12.417169+0000","last_peered":"2024-09-10T15:28:12.417169+0000","last_clean":"2024-09-10T15:28:12.417169+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:28:12.417169+0000","last_undegraded":"2024-09-10T15:28:12.417169+0000","last_fullsized":"2024-09-10T15:28:12.417169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:12.416983+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:12.416983+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.416983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:13.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"94'12","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.252318+0000","last_change":"2024-09-10T15:28:19.252386+0000","last_active":"2024-09-10T15:28:19.252318+0000","last_peered":"2024-09-10T15:28:19.252318+0000","last_clean":"2024-09-10T15:28:19.252318+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:28:19.252318+0000","last_undegraded":"2024-09-10T15:28:19.252318+0000","last_fullsized":"2024-09-10T15:28:19.252318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:19.252120+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:19.252120+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.252120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:02.578122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.333085+0000","last_change":"2024-09-10T15:28:15.333145+0000","last_active":"2024-09-10T15:28:15.333085+0000","last_peered":"2024-09-10T15:28:15.333085+0000","last_clean":"2024-09-10T15:28:15.333085+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:28:15.333085+0000","last_undegraded":"2024-09-10T15:28:15.333085+0000","last_fullsized":"2024-09-10T15:28:15.333085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.332891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.332891+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.332891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:07.142799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'30","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.381178+0000","last_change":"2024-09-10T15:25:11.822144+0000","last_active":"2024-09-10T15:27:59.381178+0000","last_peered":"2024-09-10T15:27:59.381178+0000","last_clean":"2024-09-10T15:27:59.381178+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:27:59.381178+0000","last_undegraded":"2024-09-10T15:27:59.381178+0000","last_fullsized":"2024-09-10T15:27:59.381178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":53254,"num_write":40,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.374584+0000","last_change":"2024-09-10T15:28:09.374751+0000","last_active":"2024-09-10T15:28:09.374584+0000","last_peered":"2024-09-10T15:28:09.374584+0000","last_clean":"2024-09-10T15:28:09.374584+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:28:09.374584+0000","last_undegraded":"2024-09-10T15:28:09.374584+0000","last_fullsized":"2024-09-10T15:28:09.374584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.374359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.374359+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.374359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"94'20","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.308768+0000","last_change":"2024-09-10T15:28:16.308828+0000","last_active":"2024-09-10T15:28:16.308768+0000","last_peered":"2024-09-10T15:28:16.308768+0000","last_clean":"2024-09-10T15:28:16.308768+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:28:16.308768+0000","last_undegraded":"2024-09-10T15:28:16.308768+0000","last_fullsized":"2024-09-10T15:28:16.308768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:16.308571+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:16.308571+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.308571+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:08.118479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":217,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.490268+0000","last_change":"2024-09-10T15:25:13.863972+0000","last_active":"2024-09-10T15:27:28.490268+0000","last_peered":"2024-09-10T15:27:28.490268+0000","last_clean":"2024-09-10T15:27:28.490268+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:27:28.490268+0000","last_undegraded":"2024-09-10T15:27:28.490268+0000","last_fullsized":"2024-09-10T15:27:28.490268+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"94'14","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.283747+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:59.283747+0000","last_peered":"2024-09-10T15:27:59.283747+0000","last_clean":"2024-09-10T15:27:59.283747+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:59.283747+0000","last_undegraded":"2024-09-10T15:27:59.283747+0000","last_fullsized":"2024-09-10T15:27:59.283747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.653228+0000","last_change":"2024-09-10T15:28:10.653280+0000","last_active":"2024-09-10T15:28:10.653228+0000","last_peered":"2024-09-10T15:28:10.653228+0000","last_clean":"2024-09-10T15:28:10.653228+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:28:10.653228+0000","last_undegraded":"2024-09-10T15:28:10.653228+0000","last_fullsized":"2024-09-10T15:28:10.653228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.653043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.653043+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.653043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:55.490592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"94'18","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.741569+0000","last_change":"2024-09-10T15:28:19.741689+0000","last_active":"2024-09-10T15:28:19.741569+0000","last_peered":"2024-09-10T15:28:19.741569+0000","last_clean":"2024-09-10T15:28:19.741569+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:28:19.741569+0000","last_undegraded":"2024-09-10T15:28:19.741569+0000","last_fullsized":"2024-09-10T15:28:19.741569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:19.741288+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:19.741288+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.741288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:51.787854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.333833+0000","last_change":"2024-09-10T15:28:07.333882+0000","last_active":"2024-09-10T15:28:07.333833+0000","last_peered":"2024-09-10T15:28:07.333833+0000","last_clean":"2024-09-10T15:28:07.333833+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:28:07.333833+0000","last_undegraded":"2024-09-10T15:28:07.333833+0000","last_fullsized":"2024-09-10T15:28:07.333833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.333654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.333654+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.333654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:42.524643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"94'24","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.312331+0000","last_change":"2024-09-10T15:25:11.845013+0000","last_active":"2024-09-10T15:27:59.312331+0000","last_peered":"2024-09-10T15:27:59.312331+0000","last_clean":"2024-09-10T15:27:59.312331+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:27:59.312331+0000","last_undegraded":"2024-09-10T15:27:59.312331+0000","last_fullsized":"2024-09-10T15:27:59.312331+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"94'14","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.326804+0000","last_change":"2024-09-10T15:25:11.847613+0000","last_active":"2024-09-10T15:27:59.326804+0000","last_peered":"2024-09-10T15:27:59.326804+0000","last_clean":"2024-09-10T15:27:59.326804+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:27:59.326804+0000","last_undegraded":"2024-09-10T15:27:59.326804+0000","last_fullsized":"2024-09-10T15:27:59.326804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":28672,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.659962+0000","last_change":"2024-09-10T15:28:09.660026+0000","last_active":"2024-09-10T15:28:09.659962+0000","last_peered":"2024-09-10T15:28:09.659962+0000","last_clean":"2024-09-10T15:28:09.659962+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:28:09.659962+0000","last_undegraded":"2024-09-10T15:28:09.659962+0000","last_fullsized":"2024-09-10T15:28:09.659962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'46","last_scrub_stamp":"2024-09-10T15:28:09.659764+0000","last_deep_scrub":"76'46","last_deep_scrub_stamp":"2024-09-10T15:28:09.659764+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.659764+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:39.198632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"94'8","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.338012+0000","last_change":"2024-09-10T15:25:11.847524+0000","last_active":"2024-09-10T15:27:59.338012+0000","last_peered":"2024-09-10T15:27:59.338012+0000","last_clean":"2024-09-10T15:27:59.338012+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:27:59.338012+0000","last_undegraded":"2024-09-10T15:27:59.338012+0000","last_fullsized":"2024-09-10T15:27:59.338012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.300150+0000","last_change":"2024-09-10T15:28:17.300207+0000","last_active":"2024-09-10T15:28:17.300150+0000","last_peered":"2024-09-10T15:28:17.300150+0000","last_clean":"2024-09-10T15:28:17.300150+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:28:17.300150+0000","last_undegraded":"2024-09-10T15:28:17.300150+0000","last_fullsized":"2024-09-10T15:28:17.300150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.299957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.299957+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.299957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:18.867998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1215,"num_read_kb":1591,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":815,"ondisk_log_size":815,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":629940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574893,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":630988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1744896,"data_stored":1220454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1159168,"data_stored":631125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":629821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":629426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1773568,"data_stored":1221384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574894,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1179648,"data_stored":631034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:28:26.521 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.522 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.523 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.524 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.525 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-10T15:25:14.817065+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=14, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.526 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.527 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.528 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.529 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T15:25:02.507516+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=2, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.530 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.531 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-10T15:25:16.828616+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=16, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.532 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.533 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.534 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.535 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:26.536 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T15:28:46.537 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:28:46.891 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:28:46.897 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:28:46.916 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-10T15:28:45.005273+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":4613,"num_read_kb":2051672,"num_write":3896,"num_write_kb":2051115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2743,"ondisk_log_size":2743,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259664,"kb_used_data":10192,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715056,"statfs":{"total":773094113280,"available":772828217344,"internally_reserved":0,"allocated":10436608,"data_stored":6224172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005961"},"pg_stats":[{"pgid":"3.3f","version":"94'12","reported_seq":124,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.859236+0000","last_change":"2024-09-10T15:28:31.859361+0000","last_active":"2024-09-10T15:28:31.859236+0000","last_peered":"2024-09-10T15:28:31.859236+0000","last_clean":"2024-09-10T15:28:31.859236+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:28:31.859236+0000","last_undegraded":"2024-09-10T15:28:31.859236+0000","last_fullsized":"2024-09-10T15:28:31.859236+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:31.858968+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:31.858968+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.858968+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:46.612105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.191539+0000","last_change":"2024-09-10T15:28:24.191708+0000","last_active":"2024-09-10T15:28:24.191539+0000","last_peered":"2024-09-10T15:28:24.191539+0000","last_clean":"2024-09-10T15:28:24.191539+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:28:24.191539+0000","last_undegraded":"2024-09-10T15:28:24.191539+0000","last_fullsized":"2024-09-10T15:28:24.191539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'42","last_scrub_stamp":"2024-09-10T15:28:24.191286+0000","last_deep_scrub":"76'42","last_deep_scrub_stamp":"2024-09-10T15:28:24.191286+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.191286+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:32.870541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"94'14","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.434327+0000","last_change":"2024-09-10T15:28:20.434391+0000","last_active":"2024-09-10T15:28:20.434327+0000","last_peered":"2024-09-10T15:28:20.434327+0000","last_clean":"2024-09-10T15:28:20.434327+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:28:20.434327+0000","last_undegraded":"2024-09-10T15:28:20.434327+0000","last_fullsized":"2024-09-10T15:28:20.434327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:20.434136+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:20.434136+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.434136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:21.152835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.334457+0000","last_change":"2024-09-10T15:28:28.334516+0000","last_active":"2024-09-10T15:28:28.334457+0000","last_peered":"2024-09-10T15:28:28.334457+0000","last_clean":"2024-09-10T15:28:28.334457+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:28:28.334457+0000","last_undegraded":"2024-09-10T15:28:28.334457+0000","last_fullsized":"2024-09-10T15:28:28.334457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.334254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.334254+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.334254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.840006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"94'24","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.359674+0000","last_change":"2024-09-10T15:28:24.359734+0000","last_active":"2024-09-10T15:28:24.359674+0000","last_peered":"2024-09-10T15:28:24.359674+0000","last_clean":"2024-09-10T15:28:24.359674+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:28:24.359674+0000","last_undegraded":"2024-09-10T15:28:24.359674+0000","last_fullsized":"2024-09-10T15:28:24.359674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:24.359496+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:24.359496+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.359496+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:51.654856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.273907+0000","last_change":"2024-09-10T15:28:22.273961+0000","last_active":"2024-09-10T15:28:22.273907+0000","last_peered":"2024-09-10T15:28:22.273907+0000","last_clean":"2024-09-10T15:28:22.273907+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:28:22.273907+0000","last_undegraded":"2024-09-10T15:28:22.273907+0000","last_fullsized":"2024-09-10T15:28:22.273907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:22.273680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:22.273680+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.273680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:09.159963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"94'4","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.502181+0000","last_change":"2024-09-10T15:28:17.502242+0000","last_active":"2024-09-10T15:28:17.502181+0000","last_peered":"2024-09-10T15:28:17.502181+0000","last_clean":"2024-09-10T15:28:17.502181+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:28:17.502181+0000","last_undegraded":"2024-09-10T15:28:17.502181+0000","last_fullsized":"2024-09-10T15:28:17.502181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T15:28:17.501983+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T15:28:17.501983+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.501983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:09.311891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.561094+0000","last_change":"2024-09-10T15:28:18.561151+0000","last_active":"2024-09-10T15:28:18.561094+0000","last_peered":"2024-09-10T15:28:18.561094+0000","last_clean":"2024-09-10T15:28:18.561094+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:28:18.561094+0000","last_undegraded":"2024-09-10T15:28:18.561094+0000","last_fullsized":"2024-09-10T15:28:18.561094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:18.560887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:18.560887+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.560887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:43.920879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"94'24","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.354603+0000","last_change":"2024-09-10T15:28:20.354666+0000","last_active":"2024-09-10T15:28:20.354603+0000","last_peered":"2024-09-10T15:28:20.354603+0000","last_clean":"2024-09-10T15:28:20.354603+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:28:20.354603+0000","last_undegraded":"2024-09-10T15:28:20.354603+0000","last_fullsized":"2024-09-10T15:28:20.354603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:20.354411+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:20.354411+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.354411+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:13.494879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":45074,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.350584+0000","last_change":"2024-09-10T15:28:09.350640+0000","last_active":"2024-09-10T15:28:09.350584+0000","last_peered":"2024-09-10T15:28:09.350584+0000","last_clean":"2024-09-10T15:28:09.350584+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:28:09.350584+0000","last_undegraded":"2024-09-10T15:28:09.350584+0000","last_fullsized":"2024-09-10T15:28:09.350584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.350386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.350386+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.350386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:12.114598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.541413+0000","last_change":"2024-09-10T15:28:16.541475+0000","last_active":"2024-09-10T15:28:16.541413+0000","last_peered":"2024-09-10T15:28:16.541413+0000","last_clean":"2024-09-10T15:28:16.541413+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:28:16.541413+0000","last_undegraded":"2024-09-10T15:28:16.541413+0000","last_fullsized":"2024-09-10T15:28:16.541413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:16.541230+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:16.541230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.541230+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:50.279022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.384778+0000","last_change":"2024-09-10T15:28:04.384862+0000","last_active":"2024-09-10T15:28:04.384778+0000","last_peered":"2024-09-10T15:28:04.384778+0000","last_clean":"2024-09-10T15:28:04.384778+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:28:04.384778+0000","last_undegraded":"2024-09-10T15:28:04.384778+0000","last_fullsized":"2024-09-10T15:28:04.384778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.384654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.384654+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.384654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:16.482396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"94'12","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.351301+0000","last_change":"2024-09-10T15:28:15.351367+0000","last_active":"2024-09-10T15:28:15.351301+0000","last_peered":"2024-09-10T15:28:15.351301+0000","last_clean":"2024-09-10T15:28:15.351301+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:28:15.351301+0000","last_undegraded":"2024-09-10T15:28:15.351301+0000","last_fullsized":"2024-09-10T15:28:15.351301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:15.351108+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:15.351108+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.351108+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:44.889976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.494819+0000","last_change":"2024-09-10T15:28:09.494877+0000","last_active":"2024-09-10T15:28:09.494819+0000","last_peered":"2024-09-10T15:28:09.494819+0000","last_clean":"2024-09-10T15:28:09.494819+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:28:09.494819+0000","last_undegraded":"2024-09-10T15:28:09.494819+0000","last_fullsized":"2024-09-10T15:28:09.494819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:09.494606+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:09.494606+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.494606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:16.571912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:34.259301+0000","last_change":"2024-09-10T15:28:34.259364+0000","last_active":"2024-09-10T15:28:34.259301+0000","last_peered":"2024-09-10T15:28:34.259301+0000","last_clean":"2024-09-10T15:28:34.259301+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:28:34.259301+0000","last_undegraded":"2024-09-10T15:28:34.259301+0000","last_fullsized":"2024-09-10T15:28:34.259301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:34.259104+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:34.259104+0000","last_clean_scrub_stamp":"2024-09-10T15:28:34.259104+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:33.759855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.398276+0000","last_change":"2024-09-10T15:28:21.398329+0000","last_active":"2024-09-10T15:28:21.398276+0000","last_peered":"2024-09-10T15:28:21.398276+0000","last_clean":"2024-09-10T15:28:21.398276+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:28:21.398276+0000","last_undegraded":"2024-09-10T15:28:21.398276+0000","last_fullsized":"2024-09-10T15:28:21.398276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:21.398068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:21.398068+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.398068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:34.317030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.303221+0000","last_change":"2024-09-10T15:28:26.303269+0000","last_active":"2024-09-10T15:28:26.303221+0000","last_peered":"2024-09-10T15:28:26.303221+0000","last_clean":"2024-09-10T15:28:26.303221+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:28:26.303221+0000","last_undegraded":"2024-09-10T15:28:26.303221+0000","last_fullsized":"2024-09-10T15:28:26.303221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'42","last_scrub_stamp":"2024-09-10T15:28:26.303089+0000","last_deep_scrub":"76'42","last_deep_scrub_stamp":"2024-09-10T15:28:26.303089+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.303089+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:49.341085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.255624+0000","last_change":"2024-09-10T15:28:21.255693+0000","last_active":"2024-09-10T15:28:21.255624+0000","last_peered":"2024-09-10T15:28:21.255624+0000","last_clean":"2024-09-10T15:28:21.255624+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:28:21.255624+0000","last_undegraded":"2024-09-10T15:28:21.255624+0000","last_fullsized":"2024-09-10T15:28:21.255624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:21.255422+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:21.255422+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.255422+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:49.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:03.431539+0000","last_change":"2024-09-10T15:28:03.431569+0000","last_active":"2024-09-10T15:28:03.431539+0000","last_peered":"2024-09-10T15:28:03.431539+0000","last_clean":"2024-09-10T15:28:03.431539+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:28:03.431539+0000","last_undegraded":"2024-09-10T15:28:03.431539+0000","last_fullsized":"2024-09-10T15:28:03.431539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:03.431437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:03.431437+0000","last_clean_scrub_stamp":"2024-09-10T15:28:03.431437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:18.730138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.359533+0000","last_change":"2024-09-10T15:28:21.359594+0000","last_active":"2024-09-10T15:28:21.359533+0000","last_peered":"2024-09-10T15:28:21.359533+0000","last_clean":"2024-09-10T15:28:21.359533+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:28:21.359533+0000","last_undegraded":"2024-09-10T15:28:21.359533+0000","last_fullsized":"2024-09-10T15:28:21.359533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:21.359342+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:21.359342+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.359342+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:49.690779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.390476+0000","last_change":"2024-09-10T15:28:11.390530+0000","last_active":"2024-09-10T15:28:11.390476+0000","last_peered":"2024-09-10T15:28:11.390476+0000","last_clean":"2024-09-10T15:28:11.390476+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:28:11.390476+0000","last_undegraded":"2024-09-10T15:28:11.390476+0000","last_fullsized":"2024-09-10T15:28:11.390476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.390292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.390292+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.390292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:23.435043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"94'20","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.345867+0000","last_change":"2024-09-10T15:28:19.346020+0000","last_active":"2024-09-10T15:28:19.345867+0000","last_peered":"2024-09-10T15:28:19.345867+0000","last_clean":"2024-09-10T15:28:19.345867+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:28:19.345867+0000","last_undegraded":"2024-09-10T15:28:19.345867+0000","last_fullsized":"2024-09-10T15:28:19.345867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:19.345604+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:19.345604+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.345604+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:58.767942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":34816,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.255213+0000","last_change":"2024-09-10T15:28:08.255274+0000","last_active":"2024-09-10T15:28:08.255213+0000","last_peered":"2024-09-10T15:28:08.255213+0000","last_clean":"2024-09-10T15:28:08.255213+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:28:08.255213+0000","last_undegraded":"2024-09-10T15:28:08.255213+0000","last_fullsized":"2024-09-10T15:28:08.255213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'38","last_scrub_stamp":"2024-09-10T15:28:08.255025+0000","last_deep_scrub":"76'38","last_deep_scrub_stamp":"2024-09-10T15:28:08.255025+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.255025+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:17.678997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'22","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.311639+0000","last_change":"2024-09-10T15:28:17.311699+0000","last_active":"2024-09-10T15:28:17.311639+0000","last_peered":"2024-09-10T15:28:17.311639+0000","last_clean":"2024-09-10T15:28:17.311639+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:28:17.311639+0000","last_undegraded":"2024-09-10T15:28:17.311639+0000","last_fullsized":"2024-09-10T15:28:17.311639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:17.311443+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:17.311443+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.311443+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:21.219093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.358366+0000","last_change":"2024-09-10T15:28:15.358417+0000","last_active":"2024-09-10T15:28:15.358366+0000","last_peered":"2024-09-10T15:28:15.358366+0000","last_clean":"2024-09-10T15:28:15.358366+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:28:15.358366+0000","last_undegraded":"2024-09-10T15:28:15.358366+0000","last_fullsized":"2024-09-10T15:28:15.358366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.358133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.358133+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.358133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:43.689569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.295185+0000","last_change":"2024-09-10T15:28:20.295252+0000","last_active":"2024-09-10T15:28:20.295185+0000","last_peered":"2024-09-10T15:28:20.295185+0000","last_clean":"2024-09-10T15:28:20.295185+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:28:20.295185+0000","last_undegraded":"2024-09-10T15:28:20.295185+0000","last_fullsized":"2024-09-10T15:28:20.295185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:20.294987+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:20.294987+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.294987+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:21.863028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.235587+0000","last_change":"2024-09-10T15:28:25.235648+0000","last_active":"2024-09-10T15:28:25.235587+0000","last_peered":"2024-09-10T15:28:25.235587+0000","last_clean":"2024-09-10T15:28:25.235587+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:28:25.235587+0000","last_undegraded":"2024-09-10T15:28:25.235587+0000","last_fullsized":"2024-09-10T15:28:25.235587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.235382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.235382+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.235382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:39.988519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"94'22","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.319405+0000","last_change":"2024-09-10T15:28:29.319469+0000","last_active":"2024-09-10T15:28:29.319405+0000","last_peered":"2024-09-10T15:28:29.319405+0000","last_clean":"2024-09-10T15:28:29.319405+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:28:29.319405+0000","last_undegraded":"2024-09-10T15:28:29.319405+0000","last_fullsized":"2024-09-10T15:28:29.319405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:29.319203+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:29.319203+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.319203+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:24.788712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.287784+0000","last_change":"2024-09-10T15:28:28.287938+0000","last_active":"2024-09-10T15:28:28.287784+0000","last_peered":"2024-09-10T15:28:28.287784+0000","last_clean":"2024-09-10T15:28:28.287784+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:28:28.287784+0000","last_undegraded":"2024-09-10T15:28:28.287784+0000","last_fullsized":"2024-09-10T15:28:28.287784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T15:28:28.287548+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T15:28:28.287548+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.287548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:10.745358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.219088+0000","last_change":"2024-09-10T15:28:12.219204+0000","last_active":"2024-09-10T15:28:12.219088+0000","last_peered":"2024-09-10T15:28:12.219088+0000","last_clean":"2024-09-10T15:28:12.219088+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:28:12.219088+0000","last_undegraded":"2024-09-10T15:28:12.219088+0000","last_fullsized":"2024-09-10T15:28:12.219088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.218854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.218854+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.218854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:04.113397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"94'22","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.428511+0000","last_change":"2024-09-10T15:28:33.428580+0000","last_active":"2024-09-10T15:28:33.428511+0000","last_peered":"2024-09-10T15:28:33.428511+0000","last_clean":"2024-09-10T15:28:33.428511+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:28:33.428511+0000","last_undegraded":"2024-09-10T15:28:33.428511+0000","last_fullsized":"2024-09-10T15:28:33.428511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:33.428276+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:33.428276+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.428276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:04.167364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.212186+0000","last_change":"2024-09-10T15:28:11.212245+0000","last_active":"2024-09-10T15:28:11.212186+0000","last_peered":"2024-09-10T15:28:11.212186+0000","last_clean":"2024-09-10T15:28:11.212186+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:28:11.212186+0000","last_undegraded":"2024-09-10T15:28:11.212186+0000","last_fullsized":"2024-09-10T15:28:11.212186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.211987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.211987+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.211987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:50.802107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"94'26","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.746574+0000","last_change":"2024-09-10T15:28:07.746675+0000","last_active":"2024-09-10T15:28:07.746574+0000","last_peered":"2024-09-10T15:28:07.746574+0000","last_clean":"2024-09-10T15:28:07.746574+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:28:07.746574+0000","last_undegraded":"2024-09-10T15:28:07.746574+0000","last_fullsized":"2024-09-10T15:28:07.746574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:07.746369+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:07.746369+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.746369+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:53.711912+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":71,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.216719+0000","last_change":"2024-09-10T15:28:29.216770+0000","last_active":"2024-09-10T15:28:29.216719+0000","last_peered":"2024-09-10T15:28:29.216719+0000","last_clean":"2024-09-10T15:28:29.216719+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:28:29.216719+0000","last_undegraded":"2024-09-10T15:28:29.216719+0000","last_fullsized":"2024-09-10T15:28:29.216719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.216532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.216532+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.216532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:24.686040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.203564+0000","last_change":"2024-09-10T15:28:32.203702+0000","last_active":"2024-09-10T15:28:32.203564+0000","last_peered":"2024-09-10T15:28:32.203564+0000","last_clean":"2024-09-10T15:28:32.203564+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:28:32.203564+0000","last_undegraded":"2024-09-10T15:28:32.203564+0000","last_fullsized":"2024-09-10T15:28:32.203564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:32.203297+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:32.203297+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.203297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:40.489016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.285402+0000","last_change":"2024-09-10T15:28:24.285458+0000","last_active":"2024-09-10T15:28:24.285402+0000","last_peered":"2024-09-10T15:28:24.285402+0000","last_clean":"2024-09-10T15:28:24.285402+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:28:24.285402+0000","last_undegraded":"2024-09-10T15:28:24.285402+0000","last_fullsized":"2024-09-10T15:28:24.285402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:24.285214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:24.285214+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.285214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:57.820484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"94'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.245428+0000","last_change":"2024-09-10T15:28:17.245601+0000","last_active":"2024-09-10T15:28:17.245428+0000","last_peered":"2024-09-10T15:28:17.245428+0000","last_clean":"2024-09-10T15:28:17.245428+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:28:17.245428+0000","last_undegraded":"2024-09-10T15:28:17.245428+0000","last_fullsized":"2024-09-10T15:28:17.245428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:17.245196+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:17.245196+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.245196+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:50.982987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.655880+0000","last_change":"2024-09-10T15:28:13.656024+0000","last_active":"2024-09-10T15:28:13.655880+0000","last_peered":"2024-09-10T15:28:13.655880+0000","last_clean":"2024-09-10T15:28:13.655880+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:28:13.655880+0000","last_undegraded":"2024-09-10T15:28:13.655880+0000","last_fullsized":"2024-09-10T15:28:13.655880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.655658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.655658+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.655658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:56.981659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"94'9","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.407907+0000","last_change":"2024-09-10T15:28:10.407979+0000","last_active":"2024-09-10T15:28:10.407907+0000","last_peered":"2024-09-10T15:28:10.407907+0000","last_clean":"2024-09-10T15:28:10.407907+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:28:10.407907+0000","last_undegraded":"2024-09-10T15:28:10.407907+0000","last_fullsized":"2024-09-10T15:28:10.407907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'9","last_scrub_stamp":"2024-09-10T15:28:10.407730+0000","last_deep_scrub":"94'9","last_deep_scrub_stamp":"2024-09-10T15:28:10.407730+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.407730+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:50.509573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.197587+0000","last_change":"2024-09-10T15:28:26.197612+0000","last_active":"2024-09-10T15:28:26.197587+0000","last_peered":"2024-09-10T15:28:26.197587+0000","last_clean":"2024-09-10T15:28:26.197587+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:28:26.197587+0000","last_undegraded":"2024-09-10T15:28:26.197587+0000","last_fullsized":"2024-09-10T15:28:26.197587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.197508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.197508+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.197508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:26.916206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.372863+0000","last_change":"2024-09-10T15:28:31.372997+0000","last_active":"2024-09-10T15:28:31.372863+0000","last_peered":"2024-09-10T15:28:31.372863+0000","last_clean":"2024-09-10T15:28:31.372863+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:28:31.372863+0000","last_undegraded":"2024-09-10T15:28:31.372863+0000","last_fullsized":"2024-09-10T15:28:31.372863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:31.372642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:31.372642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.372642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:35.032242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.398030+0000","last_change":"2024-09-10T15:28:14.398082+0000","last_active":"2024-09-10T15:28:14.398030+0000","last_peered":"2024-09-10T15:28:14.398030+0000","last_clean":"2024-09-10T15:28:14.398030+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:28:14.398030+0000","last_undegraded":"2024-09-10T15:28:14.398030+0000","last_fullsized":"2024-09-10T15:28:14.398030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.397844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.397844+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.397844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:07.538311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'24","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.313831+0000","last_change":"2024-09-10T15:28:27.313895+0000","last_active":"2024-09-10T15:28:27.313831+0000","last_peered":"2024-09-10T15:28:27.313831+0000","last_clean":"2024-09-10T15:28:27.313831+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:28:27.313831+0000","last_undegraded":"2024-09-10T15:28:27.313831+0000","last_fullsized":"2024-09-10T15:28:27.313831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:27.313614+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:27.313614+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.313614+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.496284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.587451+0000","last_change":"2024-09-10T15:28:23.587513+0000","last_active":"2024-09-10T15:28:23.587451+0000","last_peered":"2024-09-10T15:28:23.587451+0000","last_clean":"2024-09-10T15:28:23.587451+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:28:23.587451+0000","last_undegraded":"2024-09-10T15:28:23.587451+0000","last_fullsized":"2024-09-10T15:28:23.587451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.587228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.587228+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.587228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:55.582193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"94'15","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.558080+0000","last_change":"2024-09-10T15:28:33.558154+0000","last_active":"2024-09-10T15:28:33.558080+0000","last_peered":"2024-09-10T15:28:33.558080+0000","last_clean":"2024-09-10T15:28:33.558080+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:28:33.558080+0000","last_undegraded":"2024-09-10T15:28:33.558080+0000","last_fullsized":"2024-09-10T15:28:33.558080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:33.557893+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:33.557893+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.557893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.977587+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'18","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.347986+0000","last_change":"2024-09-10T15:28:18.348048+0000","last_active":"2024-09-10T15:28:18.347986+0000","last_peered":"2024-09-10T15:28:18.347986+0000","last_clean":"2024-09-10T15:28:18.347986+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:28:18.347986+0000","last_undegraded":"2024-09-10T15:28:18.347986+0000","last_fullsized":"2024-09-10T15:28:18.347986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:18.347799+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:18.347799+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.347799+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:28.999258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.464714+0000","last_change":"2024-09-10T15:28:31.464771+0000","last_active":"2024-09-10T15:28:31.464714+0000","last_peered":"2024-09-10T15:28:31.464714+0000","last_clean":"2024-09-10T15:28:31.464714+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:28:31.464714+0000","last_undegraded":"2024-09-10T15:28:31.464714+0000","last_fullsized":"2024-09-10T15:28:31.464714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:31.464528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:31.464528+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.464528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:01.916313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.369224+0000","last_change":"2024-09-10T15:28:13.369289+0000","last_active":"2024-09-10T15:28:13.369224+0000","last_peered":"2024-09-10T15:28:13.369224+0000","last_clean":"2024-09-10T15:28:13.369224+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:28:13.369224+0000","last_undegraded":"2024-09-10T15:28:13.369224+0000","last_fullsized":"2024-09-10T15:28:13.369224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'38","last_scrub_stamp":"2024-09-10T15:28:13.368985+0000","last_deep_scrub":"76'38","last_deep_scrub_stamp":"2024-09-10T15:28:13.368985+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.368985+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:52.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"94'12","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.238418+0000","last_change":"2024-09-10T15:28:23.238481+0000","last_active":"2024-09-10T15:28:23.238418+0000","last_peered":"2024-09-10T15:28:23.238418+0000","last_clean":"2024-09-10T15:28:23.238418+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:28:23.238418+0000","last_undegraded":"2024-09-10T15:28:23.238418+0000","last_fullsized":"2024-09-10T15:28:23.238418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:23.238214+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:23.238214+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.238214+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:08.496362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20492,"num_write":32,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.245145+0000","last_change":"2024-09-10T15:28:13.245270+0000","last_active":"2024-09-10T15:28:13.245145+0000","last_peered":"2024-09-10T15:28:13.245145+0000","last_clean":"2024-09-10T15:28:13.245145+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:28:13.245145+0000","last_undegraded":"2024-09-10T15:28:13.245145+0000","last_fullsized":"2024-09-10T15:28:13.245145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.244886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.244886+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.244886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:14.671072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"94'25","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.532378+0000","last_change":"2024-09-10T15:28:14.532458+0000","last_active":"2024-09-10T15:28:14.532378+0000","last_peered":"2024-09-10T15:28:14.532378+0000","last_clean":"2024-09-10T15:28:14.532378+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:28:14.532378+0000","last_undegraded":"2024-09-10T15:28:14.532378+0000","last_fullsized":"2024-09-10T15:28:14.532378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'25","last_scrub_stamp":"2024-09-10T15:28:14.532155+0000","last_deep_scrub":"94'25","last_deep_scrub_stamp":"2024-09-10T15:28:14.532155+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.532155+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:26.576906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":74,"num_write":28,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'18","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.398739+0000","last_change":"2024-09-10T15:28:06.398818+0000","last_active":"2024-09-10T15:28:06.398739+0000","last_peered":"2024-09-10T15:28:06.398739+0000","last_clean":"2024-09-10T15:28:06.398739+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:28:06.398739+0000","last_undegraded":"2024-09-10T15:28:06.398739+0000","last_fullsized":"2024-09-10T15:28:06.398739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:06.398506+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:06.398506+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.398506+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:36.743473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.325421+0000","last_change":"2024-09-10T15:28:30.325484+0000","last_active":"2024-09-10T15:28:30.325421+0000","last_peered":"2024-09-10T15:28:30.325421+0000","last_clean":"2024-09-10T15:28:30.325421+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:28:30.325421+0000","last_undegraded":"2024-09-10T15:28:30.325421+0000","last_fullsized":"2024-09-10T15:28:30.325421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'12","last_scrub_stamp":"2024-09-10T15:28:30.325216+0000","last_deep_scrub":"67'12","last_deep_scrub_stamp":"2024-09-10T15:28:30.325216+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.325216+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:39.042707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"94'10","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.298012+0000","last_change":"2024-09-10T15:28:18.298189+0000","last_active":"2024-09-10T15:28:18.298012+0000","last_peered":"2024-09-10T15:28:18.298012+0000","last_clean":"2024-09-10T15:28:18.298012+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:28:18.298012+0000","last_undegraded":"2024-09-10T15:28:18.298012+0000","last_fullsized":"2024-09-10T15:28:18.298012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:18.297682+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:18.297682+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.297682+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:56.718101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16396,"num_write":30,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.282384+0000","last_change":"2024-09-10T15:28:04.282432+0000","last_active":"2024-09-10T15:28:04.282384+0000","last_peered":"2024-09-10T15:28:04.282384+0000","last_clean":"2024-09-10T15:28:04.282384+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:28:04.282384+0000","last_undegraded":"2024-09-10T15:28:04.282384+0000","last_fullsized":"2024-09-10T15:28:04.282384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.282198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.282198+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.282198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:42.136495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'35","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.300379+0000","last_change":"2024-09-10T15:28:23.300463+0000","last_active":"2024-09-10T15:28:23.300379+0000","last_peered":"2024-09-10T15:28:23.300379+0000","last_clean":"2024-09-10T15:28:23.300379+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:28:23.300379+0000","last_undegraded":"2024-09-10T15:28:23.300379+0000","last_fullsized":"2024-09-10T15:28:23.300379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'35","last_scrub_stamp":"2024-09-10T15:28:23.300145+0000","last_deep_scrub":"94'35","last_deep_scrub_stamp":"2024-09-10T15:28:23.300145+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.300145+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:08.558293+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.349837+0000","last_change":"2024-09-10T15:28:28.349985+0000","last_active":"2024-09-10T15:28:28.349837+0000","last_peered":"2024-09-10T15:28:28.349837+0000","last_clean":"2024-09-10T15:28:28.349837+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:28:28.349837+0000","last_undegraded":"2024-09-10T15:28:28.349837+0000","last_fullsized":"2024-09-10T15:28:28.349837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.349583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.349583+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.349583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:49.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.436758+0000","last_change":"2024-09-10T15:28:30.436817+0000","last_active":"2024-09-10T15:28:30.436758+0000","last_peered":"2024-09-10T15:28:30.436758+0000","last_clean":"2024-09-10T15:28:30.436758+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:28:30.436758+0000","last_undegraded":"2024-09-10T15:28:30.436758+0000","last_fullsized":"2024-09-10T15:28:30.436758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.436527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.436527+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.436527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:34.096126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.377815+0000","last_change":"2024-09-10T15:28:13.377877+0000","last_active":"2024-09-10T15:28:13.377815+0000","last_peered":"2024-09-10T15:28:13.377815+0000","last_clean":"2024-09-10T15:28:13.377815+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:28:13.377815+0000","last_undegraded":"2024-09-10T15:28:13.377815+0000","last_fullsized":"2024-09-10T15:28:13.377815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.377606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.377606+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.377606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.424173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"94'20","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.527693+0000","last_change":"2024-09-10T15:28:22.527757+0000","last_active":"2024-09-10T15:28:22.527693+0000","last_peered":"2024-09-10T15:28:22.527693+0000","last_clean":"2024-09-10T15:28:22.527693+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:28:22.527693+0000","last_undegraded":"2024-09-10T15:28:22.527693+0000","last_fullsized":"2024-09-10T15:28:22.527693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:22.527486+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:22.527486+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.527486+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:15.667954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32786,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.262408+0000","last_change":"2024-09-10T15:28:05.262465+0000","last_active":"2024-09-10T15:28:05.262408+0000","last_peered":"2024-09-10T15:28:05.262408+0000","last_clean":"2024-09-10T15:28:05.262408+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:28:05.262408+0000","last_undegraded":"2024-09-10T15:28:05.262408+0000","last_fullsized":"2024-09-10T15:28:05.262408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.262207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.262207+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.262207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:41.417962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"94'22","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.720967+0000","last_change":"2024-09-10T15:28:05.721077+0000","last_active":"2024-09-10T15:28:05.720967+0000","last_peered":"2024-09-10T15:28:05.720967+0000","last_clean":"2024-09-10T15:28:05.720967+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:28:05.720967+0000","last_undegraded":"2024-09-10T15:28:05.720967+0000","last_fullsized":"2024-09-10T15:28:05.720967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:05.720712+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:05.720712+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.720712+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:45.822555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:37.486419+0000","last_change":"2024-09-10T15:28:37.486477+0000","last_active":"2024-09-10T15:28:37.486419+0000","last_peered":"2024-09-10T15:28:37.486419+0000","last_clean":"2024-09-10T15:28:37.486419+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:28:37.486419+0000","last_undegraded":"2024-09-10T15:28:37.486419+0000","last_fullsized":"2024-09-10T15:28:37.486419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:37.486225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:37.486225+0000","last_clean_scrub_stamp":"2024-09-10T15:28:37.486225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:11.021495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.210896+0000","last_change":"2024-09-10T15:28:31.210961+0000","last_active":"2024-09-10T15:28:31.210896+0000","last_peered":"2024-09-10T15:28:31.210896+0000","last_clean":"2024-09-10T15:28:31.210896+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:28:31.210896+0000","last_undegraded":"2024-09-10T15:28:31.210896+0000","last_fullsized":"2024-09-10T15:28:31.210896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:31.210689+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:31.210689+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.210689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:00.074070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.511472+0000","last_change":"2024-09-10T15:28:13.511528+0000","last_active":"2024-09-10T15:28:13.511472+0000","last_peered":"2024-09-10T15:28:13.511472+0000","last_clean":"2024-09-10T15:28:13.511472+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:28:13.511472+0000","last_undegraded":"2024-09-10T15:28:13.511472+0000","last_fullsized":"2024-09-10T15:28:13.511472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.511286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.511286+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.511286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.613128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"94'14","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:42.443198+0000","last_change":"2024-09-10T15:28:42.443268+0000","last_active":"2024-09-10T15:28:42.443198+0000","last_peered":"2024-09-10T15:28:42.443198+0000","last_clean":"2024-09-10T15:28:42.443198+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:28:42.443198+0000","last_undegraded":"2024-09-10T15:28:42.443198+0000","last_fullsized":"2024-09-10T15:28:42.443198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:42.442978+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:42.442978+0000","last_clean_scrub_stamp":"2024-09-10T15:28:42.442978+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:09.180385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.387828+0000","last_change":"2024-09-10T15:28:25.387933+0000","last_active":"2024-09-10T15:28:25.387828+0000","last_peered":"2024-09-10T15:28:25.387828+0000","last_clean":"2024-09-10T15:28:25.387828+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:28:25.387828+0000","last_undegraded":"2024-09-10T15:28:25.387828+0000","last_fullsized":"2024-09-10T15:28:25.387828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.387581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.387581+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.387581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:54.250961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"94'32","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.178082+0000","last_change":"2024-09-10T15:28:07.178166+0000","last_active":"2024-09-10T15:28:07.178082+0000","last_peered":"2024-09-10T15:28:07.178082+0000","last_clean":"2024-09-10T15:28:07.178082+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:28:07.178082+0000","last_undegraded":"2024-09-10T15:28:07.178082+0000","last_fullsized":"2024-09-10T15:28:07.178082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'32","last_scrub_stamp":"2024-09-10T15:28:07.177884+0000","last_deep_scrub":"94'32","last_deep_scrub_stamp":"2024-09-10T15:28:07.177884+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.177884+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:20.096846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.442390+0000","last_change":"2024-09-10T15:28:08.442555+0000","last_active":"2024-09-10T15:28:08.442390+0000","last_peered":"2024-09-10T15:28:08.442390+0000","last_clean":"2024-09-10T15:28:08.442390+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:28:08.442390+0000","last_undegraded":"2024-09-10T15:28:08.442390+0000","last_fullsized":"2024-09-10T15:28:08.442390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:08.442094+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:08.442094+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.442094+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:17.639917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.373686+0000","last_change":"2024-09-10T15:28:32.373845+0000","last_active":"2024-09-10T15:28:32.373686+0000","last_peered":"2024-09-10T15:28:32.373686+0000","last_clean":"2024-09-10T15:28:32.373686+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:28:32.373686+0000","last_undegraded":"2024-09-10T15:28:32.373686+0000","last_fullsized":"2024-09-10T15:28:32.373686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:32.373452+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:32.373452+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.373452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:02.825237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.446864+0000","last_change":"2024-09-10T15:28:17.446928+0000","last_active":"2024-09-10T15:28:17.446864+0000","last_peered":"2024-09-10T15:28:17.446864+0000","last_clean":"2024-09-10T15:28:17.446864+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:28:17.446864+0000","last_undegraded":"2024-09-10T15:28:17.446864+0000","last_fullsized":"2024-09-10T15:28:17.446864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.446652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.446652+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.446652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:02.704800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"94'20","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.326747+0000","last_change":"2024-09-10T15:28:14.326819+0000","last_active":"2024-09-10T15:28:14.326747+0000","last_peered":"2024-09-10T15:28:14.326747+0000","last_clean":"2024-09-10T15:28:14.326747+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:28:14.326747+0000","last_undegraded":"2024-09-10T15:28:14.326747+0000","last_fullsized":"2024-09-10T15:28:14.326747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:14.326557+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:14.326557+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.326557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:18.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.223347+0000","last_change":"2024-09-10T15:28:06.223397+0000","last_active":"2024-09-10T15:28:06.223347+0000","last_peered":"2024-09-10T15:28:06.223347+0000","last_clean":"2024-09-10T15:28:06.223347+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:28:06.223347+0000","last_undegraded":"2024-09-10T15:28:06.223347+0000","last_fullsized":"2024-09-10T15:28:06.223347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.223149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.223149+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.223149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:22.953621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"94'36","reported_seq":201,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.702652+0000","last_change":"2024-09-10T15:28:04.702743+0000","last_active":"2024-09-10T15:28:04.702652+0000","last_peered":"2024-09-10T15:28:04.702652+0000","last_clean":"2024-09-10T15:28:04.702652+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:28:04.702652+0000","last_undegraded":"2024-09-10T15:28:04.702652+0000","last_fullsized":"2024-09-10T15:28:04.702652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36","last_scrub_stamp":"2024-09-10T15:28:04.702463+0000","last_deep_scrub":"94'36","last_deep_scrub_stamp":"2024-09-10T15:28:04.702463+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.702463+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:56.597006+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":103,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.413946+0000","last_change":"2024-09-10T15:28:07.413998+0000","last_active":"2024-09-10T15:28:07.413946+0000","last_peered":"2024-09-10T15:28:07.413946+0000","last_clean":"2024-09-10T15:28:07.413946+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:28:07.413946+0000","last_undegraded":"2024-09-10T15:28:07.413946+0000","last_fullsized":"2024-09-10T15:28:07.413946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.413733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.413733+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.413733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:22.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.843263+0000","last_change":"2024-09-10T15:28:29.843314+0000","last_active":"2024-09-10T15:28:29.843263+0000","last_peered":"2024-09-10T15:28:29.843263+0000","last_clean":"2024-09-10T15:28:29.843263+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:28:29.843263+0000","last_undegraded":"2024-09-10T15:28:29.843263+0000","last_fullsized":"2024-09-10T15:28:29.843263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.843075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.843075+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.843075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:15.101224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.408923+0000","last_change":"2024-09-10T15:28:05.408945+0000","last_active":"2024-09-10T15:28:05.408923+0000","last_peered":"2024-09-10T15:28:05.408923+0000","last_clean":"2024-09-10T15:28:05.408923+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:28:05.408923+0000","last_undegraded":"2024-09-10T15:28:05.408923+0000","last_fullsized":"2024-09-10T15:28:05.408923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.408844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.408844+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.408844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:41.714196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.729892+0000","last_change":"2024-09-10T15:28:20.729957+0000","last_active":"2024-09-10T15:28:20.729892+0000","last_peered":"2024-09-10T15:28:20.729892+0000","last_clean":"2024-09-10T15:28:20.729892+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:28:20.729892+0000","last_undegraded":"2024-09-10T15:28:20.729892+0000","last_fullsized":"2024-09-10T15:28:20.729892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:20.729648+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:20.729648+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.729648+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:54.467440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.786279+0000","last_change":"2024-09-10T15:28:08.786333+0000","last_active":"2024-09-10T15:28:08.786279+0000","last_peered":"2024-09-10T15:28:08.786279+0000","last_clean":"2024-09-10T15:28:08.786279+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:28:08.786279+0000","last_undegraded":"2024-09-10T15:28:08.786279+0000","last_fullsized":"2024-09-10T15:28:08.786279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.786060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.786060+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.786060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:44.941815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"94'27","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.367116+0000","last_change":"2024-09-10T15:28:12.367296+0000","last_active":"2024-09-10T15:28:12.367116+0000","last_peered":"2024-09-10T15:28:12.367116+0000","last_clean":"2024-09-10T15:28:12.367116+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:28:12.367116+0000","last_undegraded":"2024-09-10T15:28:12.367116+0000","last_fullsized":"2024-09-10T15:28:12.367116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'27","last_scrub_stamp":"2024-09-10T15:28:12.366890+0000","last_deep_scrub":"94'27","last_deep_scrub_stamp":"2024-09-10T15:28:12.366890+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.366890+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:58.332432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":770,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.830921+0000","last_change":"2024-09-10T15:28:26.831081+0000","last_active":"2024-09-10T15:28:26.830921+0000","last_peered":"2024-09-10T15:28:26.830921+0000","last_clean":"2024-09-10T15:28:26.830921+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:28:26.830921+0000","last_undegraded":"2024-09-10T15:28:26.830921+0000","last_fullsized":"2024-09-10T15:28:26.830921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.830702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.830702+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.830702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:34:17.234010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:37.239867+0000","last_change":"2024-09-10T15:28:37.239928+0000","last_active":"2024-09-10T15:28:37.239867+0000","last_peered":"2024-09-10T15:28:37.239867+0000","last_clean":"2024-09-10T15:28:37.239867+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:28:37.239867+0000","last_undegraded":"2024-09-10T15:28:37.239867+0000","last_fullsized":"2024-09-10T15:28:37.239867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:37.239635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:37.239635+0000","last_clean_scrub_stamp":"2024-09-10T15:28:37.239635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:24.125918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:28.416591+0000","last_change":"2024-09-10T15:25:13.846966+0000","last_active":"2024-09-10T15:27:28.416591+0000","last_peered":"2024-09-10T15:27:28.416591+0000","last_clean":"2024-09-10T15:27:28.416591+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:27:28.416591+0000","last_undegraded":"2024-09-10T15:27:28.416591+0000","last_fullsized":"2024-09-10T15:27:28.416591+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:12.810172+0000","last_clean_scrub_stamp":"2024-09-10T15:25:12.810172+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"94'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:41.470457+0000","last_change":"2024-09-10T15:28:41.470522+0000","last_active":"2024-09-10T15:28:41.470457+0000","last_peered":"2024-09-10T15:28:41.470457+0000","last_clean":"2024-09-10T15:28:41.470457+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:28:41.470457+0000","last_undegraded":"2024-09-10T15:28:41.470457+0000","last_fullsized":"2024-09-10T15:28:41.470457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:41.470237+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:41.470237+0000","last_clean_scrub_stamp":"2024-09-10T15:28:41.470237+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:59.142785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.399412+0000","last_change":"2024-09-10T15:28:23.399464+0000","last_active":"2024-09-10T15:28:23.399412+0000","last_peered":"2024-09-10T15:28:23.399412+0000","last_clean":"2024-09-10T15:28:23.399412+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:28:23.399412+0000","last_undegraded":"2024-09-10T15:28:23.399412+0000","last_fullsized":"2024-09-10T15:28:23.399412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.399232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.399232+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.399232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:53.851017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"94'30","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:35.300832+0000","last_change":"2024-09-10T15:28:35.300919+0000","last_active":"2024-09-10T15:28:35.300832+0000","last_peered":"2024-09-10T15:28:35.300832+0000","last_clean":"2024-09-10T15:28:35.300832+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:28:35.300832+0000","last_undegraded":"2024-09-10T15:28:35.300832+0000","last_fullsized":"2024-09-10T15:28:35.300832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:35.300616+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:35.300616+0000","last_clean_scrub_stamp":"2024-09-10T15:28:35.300616+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:47.720310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'18","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.803408+0000","last_change":"2024-09-10T15:28:11.803530+0000","last_active":"2024-09-10T15:28:11.803408+0000","last_peered":"2024-09-10T15:28:11.803408+0000","last_clean":"2024-09-10T15:28:11.803408+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:28:11.803408+0000","last_undegraded":"2024-09-10T15:28:11.803408+0000","last_fullsized":"2024-09-10T15:28:11.803408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:11.803181+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:11.803181+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.803181+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:21.227153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.350984+0000","last_change":"2024-09-10T15:28:29.351035+0000","last_active":"2024-09-10T15:28:29.350984+0000","last_peered":"2024-09-10T15:28:29.350984+0000","last_clean":"2024-09-10T15:28:29.350984+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:28:29.350984+0000","last_undegraded":"2024-09-10T15:28:29.350984+0000","last_fullsized":"2024-09-10T15:28:29.350984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.350781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.350781+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.350781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:30.069480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.520715+0000","last_change":"2024-09-10T15:28:23.520777+0000","last_active":"2024-09-10T15:28:23.520715+0000","last_peered":"2024-09-10T15:28:23.520715+0000","last_clean":"2024-09-10T15:28:23.520715+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:28:23.520715+0000","last_undegraded":"2024-09-10T15:28:23.520715+0000","last_fullsized":"2024-09-10T15:28:23.520715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:23.520518+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:23.520518+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.520518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:51.851954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"94'16","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.325330+0000","last_change":"2024-09-10T15:28:29.325471+0000","last_active":"2024-09-10T15:28:29.325330+0000","last_peered":"2024-09-10T15:28:29.325330+0000","last_clean":"2024-09-10T15:28:29.325330+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:28:29.325330+0000","last_undegraded":"2024-09-10T15:28:29.325330+0000","last_fullsized":"2024-09-10T15:28:29.325330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:29.325094+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:29.325094+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.325094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.144262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"94'4","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:03.323045+0000","last_change":"2024-09-10T15:28:03.323110+0000","last_active":"2024-09-10T15:28:03.323045+0000","last_peered":"2024-09-10T15:28:03.323045+0000","last_clean":"2024-09-10T15:28:03.323045+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:28:03.323045+0000","last_undegraded":"2024-09-10T15:28:03.323045+0000","last_fullsized":"2024-09-10T15:28:03.323045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T15:28:03.322854+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T15:28:03.322854+0000","last_clean_scrub_stamp":"2024-09-10T15:28:03.322854+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:40.200094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"94'15","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.368827+0000","last_change":"2024-09-10T15:28:27.368984+0000","last_active":"2024-09-10T15:28:27.368827+0000","last_peered":"2024-09-10T15:28:27.368827+0000","last_clean":"2024-09-10T15:28:27.368827+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:28:27.368827+0000","last_undegraded":"2024-09-10T15:28:27.368827+0000","last_fullsized":"2024-09-10T15:28:27.368827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:27.368585+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:27.368585+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.368585+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:36.047840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'18","reported_seq":204,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.290994+0000","last_change":"2024-09-10T15:28:16.291073+0000","last_active":"2024-09-10T15:28:16.290994+0000","last_peered":"2024-09-10T15:28:16.290994+0000","last_clean":"2024-09-10T15:28:16.290994+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:28:16.290994+0000","last_undegraded":"2024-09-10T15:28:16.290994+0000","last_fullsized":"2024-09-10T15:28:16.290994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:16.290798+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:16.290798+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.290798+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:17.833998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.444818+0000","last_change":"2024-09-10T15:28:29.444872+0000","last_active":"2024-09-10T15:28:29.444818+0000","last_peered":"2024-09-10T15:28:29.444818+0000","last_clean":"2024-09-10T15:28:29.444818+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:28:29.444818+0000","last_undegraded":"2024-09-10T15:28:29.444818+0000","last_fullsized":"2024-09-10T15:28:29.444818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.444618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.444618+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.444618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:42.363580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.769058+0000","last_change":"2024-09-10T15:28:12.769114+0000","last_active":"2024-09-10T15:28:12.769058+0000","last_peered":"2024-09-10T15:28:12.769058+0000","last_clean":"2024-09-10T15:28:12.769058+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:28:12.769058+0000","last_undegraded":"2024-09-10T15:28:12.769058+0000","last_fullsized":"2024-09-10T15:28:12.769058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.768855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.768855+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.768855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:19.846162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"94'18","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.633312+0000","last_change":"2024-09-10T15:28:30.633377+0000","last_active":"2024-09-10T15:28:30.633312+0000","last_peered":"2024-09-10T15:28:30.633312+0000","last_clean":"2024-09-10T15:28:30.633312+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:28:30.633312+0000","last_undegraded":"2024-09-10T15:28:30.633312+0000","last_fullsized":"2024-09-10T15:28:30.633312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:30.633105+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:30.633105+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.633105+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:23.901509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.228044+0000","last_change":"2024-09-10T15:28:12.228102+0000","last_active":"2024-09-10T15:28:12.228044+0000","last_peered":"2024-09-10T15:28:12.228044+0000","last_clean":"2024-09-10T15:28:12.228044+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:28:12.228044+0000","last_undegraded":"2024-09-10T15:28:12.228044+0000","last_fullsized":"2024-09-10T15:28:12.228044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.227843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.227843+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.227843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:05.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"94'32","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.364433+0000","last_change":"2024-09-10T15:28:14.364535+0000","last_active":"2024-09-10T15:28:14.364433+0000","last_peered":"2024-09-10T15:28:14.364433+0000","last_clean":"2024-09-10T15:28:14.364433+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:28:14.364433+0000","last_undegraded":"2024-09-10T15:28:14.364433+0000","last_fullsized":"2024-09-10T15:28:14.364433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'32","last_scrub_stamp":"2024-09-10T15:28:14.364256+0000","last_deep_scrub":"94'32","last_deep_scrub_stamp":"2024-09-10T15:28:14.364256+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.364256+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:48.102048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.479498+0000","last_change":"2024-09-10T15:28:25.479550+0000","last_active":"2024-09-10T15:28:25.479498+0000","last_peered":"2024-09-10T15:28:25.479498+0000","last_clean":"2024-09-10T15:28:25.479498+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:28:25.479498+0000","last_undegraded":"2024-09-10T15:28:25.479498+0000","last_fullsized":"2024-09-10T15:28:25.479498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.479308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.479308+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.479308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:10.737457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.880847+0000","last_change":"2024-09-10T15:28:27.880909+0000","last_active":"2024-09-10T15:28:27.880847+0000","last_peered":"2024-09-10T15:28:27.880847+0000","last_clean":"2024-09-10T15:28:27.880847+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:28:27.880847+0000","last_undegraded":"2024-09-10T15:28:27.880847+0000","last_fullsized":"2024-09-10T15:28:27.880847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:27.880642+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:27.880642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.880642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:56.212079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:34.406358+0000","last_change":"2024-09-10T15:28:34.406414+0000","last_active":"2024-09-10T15:28:34.406358+0000","last_peered":"2024-09-10T15:28:34.406358+0000","last_clean":"2024-09-10T15:28:34.406358+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:28:34.406358+0000","last_undegraded":"2024-09-10T15:28:34.406358+0000","last_fullsized":"2024-09-10T15:28:34.406358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:34.406160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:34.406160+0000","last_clean_scrub_stamp":"2024-09-10T15:28:34.406160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:13.416311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"94'119","reported_seq":326,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.301754+0000","last_change":"2024-09-10T15:28:18.301835+0000","last_active":"2024-09-10T15:28:18.301754+0000","last_peered":"2024-09-10T15:28:18.301754+0000","last_clean":"2024-09-10T15:28:18.301754+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:28:18.301754+0000","last_undegraded":"2024-09-10T15:28:18.301754+0000","last_fullsized":"2024-09-10T15:28:18.301754+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'119","last_scrub_stamp":"2024-09-10T15:28:18.301551+0000","last_deep_scrub":"94'119","last_deep_scrub_stamp":"2024-09-10T15:28:18.301551+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.301551+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:58.514533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"94'2","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:39.421689+0000","last_change":"2024-09-10T15:28:39.421758+0000","last_active":"2024-09-10T15:28:39.421689+0000","last_peered":"2024-09-10T15:28:39.421689+0000","last_clean":"2024-09-10T15:28:39.421689+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:28:39.421689+0000","last_undegraded":"2024-09-10T15:28:39.421689+0000","last_fullsized":"2024-09-10T15:28:39.421689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:39.421502+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:39.421502+0000","last_clean_scrub_stamp":"2024-09-10T15:28:39.421502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:52.010748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"94'24","reported_seq":198,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.617824+0000","last_change":"2024-09-10T15:28:27.617959+0000","last_active":"2024-09-10T15:28:27.617824+0000","last_peered":"2024-09-10T15:28:27.617824+0000","last_clean":"2024-09-10T15:28:27.617824+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:28:27.617824+0000","last_undegraded":"2024-09-10T15:28:27.617824+0000","last_fullsized":"2024-09-10T15:28:27.617824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:27.617612+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:27.617612+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.617612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:00:11.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":49176,"num_write":64,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.363824+0000","last_change":"2024-09-10T15:28:06.363895+0000","last_active":"2024-09-10T15:28:06.363824+0000","last_peered":"2024-09-10T15:28:06.363824+0000","last_clean":"2024-09-10T15:28:06.363824+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:28:06.363824+0000","last_undegraded":"2024-09-10T15:28:06.363824+0000","last_fullsized":"2024-09-10T15:28:06.363824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.363643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.363643+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.363643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:11.269225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'44","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.195215+0000","last_change":"2024-09-10T15:28:05.195290+0000","last_active":"2024-09-10T15:28:05.195215+0000","last_peered":"2024-09-10T15:28:05.195215+0000","last_clean":"2024-09-10T15:28:05.195215+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:28:05.195215+0000","last_undegraded":"2024-09-10T15:28:05.195215+0000","last_fullsized":"2024-09-10T15:28:05.195215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'44","last_scrub_stamp":"2024-09-10T15:28:05.194997+0000","last_deep_scrub":"94'44","last_deep_scrub_stamp":"2024-09-10T15:28:05.194997+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.194997+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:19.948133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":140,"num_write":50,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.459354+0000","last_change":"2024-09-10T15:28:09.459405+0000","last_active":"2024-09-10T15:28:09.459354+0000","last_peered":"2024-09-10T15:28:09.459354+0000","last_clean":"2024-09-10T15:28:09.459354+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:28:09.459354+0000","last_undegraded":"2024-09-10T15:28:09.459354+0000","last_fullsized":"2024-09-10T15:28:09.459354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.459158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.459158+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.459158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.804839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.278047+0000","last_change":"2024-09-10T15:28:26.278092+0000","last_active":"2024-09-10T15:28:26.278047+0000","last_peered":"2024-09-10T15:28:26.278047+0000","last_clean":"2024-09-10T15:28:26.278047+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:28:26.278047+0000","last_undegraded":"2024-09-10T15:28:26.278047+0000","last_fullsized":"2024-09-10T15:28:26.278047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.277915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.277915+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.277915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:26.996613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.399187+0000","last_change":"2024-09-10T15:28:16.399239+0000","last_active":"2024-09-10T15:28:16.399187+0000","last_peered":"2024-09-10T15:28:16.399187+0000","last_clean":"2024-09-10T15:28:16.399187+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:28:16.399187+0000","last_undegraded":"2024-09-10T15:28:16.399187+0000","last_fullsized":"2024-09-10T15:28:16.399187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.399000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.399000+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.399000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:08.912626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:38.403433+0000","last_change":"2024-09-10T15:28:38.403495+0000","last_active":"2024-09-10T15:28:38.403433+0000","last_peered":"2024-09-10T15:28:38.403433+0000","last_clean":"2024-09-10T15:28:38.403433+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:28:38.403433+0000","last_undegraded":"2024-09-10T15:28:38.403433+0000","last_fullsized":"2024-09-10T15:28:38.403433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:38.403235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:38.403235+0000","last_clean_scrub_stamp":"2024-09-10T15:28:38.403235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:24.821902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"94'28","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.296195+0000","last_change":"2024-09-10T15:28:22.296324+0000","last_active":"2024-09-10T15:28:22.296195+0000","last_peered":"2024-09-10T15:28:22.296195+0000","last_clean":"2024-09-10T15:28:22.296195+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:28:22.296195+0000","last_undegraded":"2024-09-10T15:28:22.296195+0000","last_fullsized":"2024-09-10T15:28:22.296195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'28","last_scrub_stamp":"2024-09-10T15:28:22.295934+0000","last_deep_scrub":"94'28","last_deep_scrub_stamp":"2024-09-10T15:28:22.295934+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.295934+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:05.621936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49164,"num_write":48,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.300687+0000","last_change":"2024-09-10T15:28:16.300738+0000","last_active":"2024-09-10T15:28:16.300687+0000","last_peered":"2024-09-10T15:28:16.300687+0000","last_clean":"2024-09-10T15:28:16.300687+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:28:16.300687+0000","last_undegraded":"2024-09-10T15:28:16.300687+0000","last_fullsized":"2024-09-10T15:28:16.300687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.300492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.300492+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.300492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:09.568897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'69","reported_seq":274,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.839095+0000","last_change":"2024-09-10T15:28:09.839178+0000","last_active":"2024-09-10T15:28:09.839095+0000","last_peered":"2024-09-10T15:28:09.839095+0000","last_clean":"2024-09-10T15:28:09.839095+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:28:09.839095+0000","last_undegraded":"2024-09-10T15:28:09.839095+0000","last_fullsized":"2024-09-10T15:28:09.839095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69","last_scrub_stamp":"2024-09-10T15:28:09.838913+0000","last_deep_scrub":"94'69","last_deep_scrub_stamp":"2024-09-10T15:28:09.838913+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.838913+0000","objects_scrubbed":10,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:46.716153+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":106,"num_read_kb":151,"num_write":60,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.255889+0000","last_change":"2024-09-10T15:28:14.255942+0000","last_active":"2024-09-10T15:28:14.255889+0000","last_peered":"2024-09-10T15:28:14.255889+0000","last_clean":"2024-09-10T15:28:14.255889+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:28:14.255889+0000","last_undegraded":"2024-09-10T15:28:14.255889+0000","last_fullsized":"2024-09-10T15:28:14.255889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.255662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.255662+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.255662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:33.232191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:41.209588+0000","last_change":"2024-09-10T15:28:41.209645+0000","last_active":"2024-09-10T15:28:41.209588+0000","last_peered":"2024-09-10T15:28:41.209588+0000","last_clean":"2024-09-10T15:28:41.209588+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:28:41.209588+0000","last_undegraded":"2024-09-10T15:28:41.209588+0000","last_fullsized":"2024-09-10T15:28:41.209588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:41.209389+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:41.209389+0000","last_clean_scrub_stamp":"2024-09-10T15:28:41.209389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:04.247385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.193090+0000","last_change":"2024-09-10T15:28:14.193148+0000","last_active":"2024-09-10T15:28:14.193090+0000","last_peered":"2024-09-10T15:28:14.193090+0000","last_clean":"2024-09-10T15:28:14.193090+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:28:14.193090+0000","last_undegraded":"2024-09-10T15:28:14.193090+0000","last_fullsized":"2024-09-10T15:28:14.193090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.192901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.192901+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.192901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:26.237652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.810225+0000","last_change":"2024-09-10T15:28:17.810281+0000","last_active":"2024-09-10T15:28:17.810225+0000","last_peered":"2024-09-10T15:28:17.810225+0000","last_clean":"2024-09-10T15:28:17.810225+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:28:17.810225+0000","last_undegraded":"2024-09-10T15:28:17.810225+0000","last_fullsized":"2024-09-10T15:28:17.810225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.810031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.810031+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.810031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:29.854782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"94'14","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.290933+0000","last_change":"2024-09-10T15:28:33.291014+0000","last_active":"2024-09-10T15:28:33.290933+0000","last_peered":"2024-09-10T15:28:33.290933+0000","last_clean":"2024-09-10T15:28:33.290933+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:28:33.290933+0000","last_undegraded":"2024-09-10T15:28:33.290933+0000","last_fullsized":"2024-09-10T15:28:33.290933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:33.290710+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:33.290710+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.290710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:43.942169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"94'2","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.818229+0000","last_change":"2024-09-10T15:28:10.818300+0000","last_active":"2024-09-10T15:28:10.818229+0000","last_peered":"2024-09-10T15:28:10.818229+0000","last_clean":"2024-09-10T15:28:10.818229+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:28:10.818229+0000","last_undegraded":"2024-09-10T15:28:10.818229+0000","last_fullsized":"2024-09-10T15:28:10.818229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:10.818023+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:10.818023+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.818023+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:48.672320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'24","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.328453+0000","last_change":"2024-09-10T15:28:22.328538+0000","last_active":"2024-09-10T15:28:22.328453+0000","last_peered":"2024-09-10T15:28:22.328453+0000","last_clean":"2024-09-10T15:28:22.328453+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:28:22.328453+0000","last_undegraded":"2024-09-10T15:28:22.328453+0000","last_fullsized":"2024-09-10T15:28:22.328453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:22.328241+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:22.328241+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.328241+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:14.841866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:35.515859+0000","last_change":"2024-09-10T15:28:35.515920+0000","last_active":"2024-09-10T15:28:35.515859+0000","last_peered":"2024-09-10T15:28:35.515859+0000","last_clean":"2024-09-10T15:28:35.515859+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:28:35.515859+0000","last_undegraded":"2024-09-10T15:28:35.515859+0000","last_fullsized":"2024-09-10T15:28:35.515859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:35.515640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:35.515640+0000","last_clean_scrub_stamp":"2024-09-10T15:28:35.515640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:22.401922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:40.597064+0000","last_change":"2024-09-10T15:28:40.597116+0000","last_active":"2024-09-10T15:28:40.597064+0000","last_peered":"2024-09-10T15:28:40.597064+0000","last_clean":"2024-09-10T15:28:40.597064+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:28:40.597064+0000","last_undegraded":"2024-09-10T15:28:40.597064+0000","last_fullsized":"2024-09-10T15:28:40.597064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:40.596868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:40.596868+0000","last_clean_scrub_stamp":"2024-09-10T15:28:40.596868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:47.779538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.333298+0000","last_change":"2024-09-10T15:28:24.333358+0000","last_active":"2024-09-10T15:28:24.333298+0000","last_peered":"2024-09-10T15:28:24.333298+0000","last_clean":"2024-09-10T15:28:24.333298+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:28:24.333298+0000","last_undegraded":"2024-09-10T15:28:24.333298+0000","last_fullsized":"2024-09-10T15:28:24.333298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:24.333067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:24.333067+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.333067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.664504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"94'3","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:40.471437+0000","last_change":"2024-09-10T15:28:40.471507+0000","last_active":"2024-09-10T15:28:40.471437+0000","last_peered":"2024-09-10T15:28:40.471437+0000","last_clean":"2024-09-10T15:28:40.471437+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:28:40.471437+0000","last_undegraded":"2024-09-10T15:28:40.471437+0000","last_fullsized":"2024-09-10T15:28:40.471437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'3","last_scrub_stamp":"2024-09-10T15:28:40.471244+0000","last_deep_scrub":"94'3","last_deep_scrub_stamp":"2024-09-10T15:28:40.471244+0000","last_clean_scrub_stamp":"2024-09-10T15:28:40.471244+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:32.929614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"94'14","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.905405+0000","last_change":"2024-09-10T15:28:32.905527+0000","last_active":"2024-09-10T15:28:32.905405+0000","last_peered":"2024-09-10T15:28:32.905405+0000","last_clean":"2024-09-10T15:28:32.905405+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:28:32.905405+0000","last_undegraded":"2024-09-10T15:28:32.905405+0000","last_fullsized":"2024-09-10T15:28:32.905405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:32.905102+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:32.905102+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.905102+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:33.623800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.767883+0000","last_change":"2024-09-10T15:28:06.767943+0000","last_active":"2024-09-10T15:28:06.767883+0000","last_peered":"2024-09-10T15:28:06.767883+0000","last_clean":"2024-09-10T15:28:06.767883+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:28:06.767883+0000","last_undegraded":"2024-09-10T15:28:06.767883+0000","last_fullsized":"2024-09-10T15:28:06.767883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.767689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.767689+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.767689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:04.259990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"94'18","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.504780+0000","last_change":"2024-09-10T15:28:10.504864+0000","last_active":"2024-09-10T15:28:10.504780+0000","last_peered":"2024-09-10T15:28:10.504780+0000","last_clean":"2024-09-10T15:28:10.504780+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:28:10.504780+0000","last_undegraded":"2024-09-10T15:28:10.504780+0000","last_fullsized":"2024-09-10T15:28:10.504780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:10.504568+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:10.504568+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.504568+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:35.891993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:33.187165+0000","last_change":"2024-09-10T15:25:19.889682+0000","last_active":"2024-09-10T15:27:33.187165+0000","last_peered":"2024-09-10T15:27:33.187165+0000","last_clean":"2024-09-10T15:27:33.187165+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:27:33.187165+0000","last_undegraded":"2024-09-10T15:27:33.187165+0000","last_fullsized":"2024-09-10T15:27:33.187165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.222825+0000","last_change":"2024-09-10T15:28:30.222892+0000","last_active":"2024-09-10T15:28:30.222825+0000","last_peered":"2024-09-10T15:28:30.222825+0000","last_clean":"2024-09-10T15:28:30.222825+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:28:30.222825+0000","last_undegraded":"2024-09-10T15:28:30.222825+0000","last_fullsized":"2024-09-10T15:28:30.222825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.222544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.222544+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.222544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:02.217508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.344728+0000","last_change":"2024-09-10T15:28:23.344780+0000","last_active":"2024-09-10T15:28:23.344728+0000","last_peered":"2024-09-10T15:28:23.344728+0000","last_clean":"2024-09-10T15:28:23.344728+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:28:23.344728+0000","last_undegraded":"2024-09-10T15:28:23.344728+0000","last_fullsized":"2024-09-10T15:28:23.344728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.344531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.344531+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.344531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:16.484999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.531208+0000","last_change":"2024-09-10T15:28:21.531275+0000","last_active":"2024-09-10T15:28:21.531208+0000","last_peered":"2024-09-10T15:28:21.531208+0000","last_clean":"2024-09-10T15:28:21.531208+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:28:21.531208+0000","last_undegraded":"2024-09-10T15:28:21.531208+0000","last_fullsized":"2024-09-10T15:28:21.531208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:21.531004+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:21.531004+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.531004+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:04.857005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.327810+0000","last_change":"2024-09-10T15:28:27.327864+0000","last_active":"2024-09-10T15:28:27.327810+0000","last_peered":"2024-09-10T15:28:27.327810+0000","last_clean":"2024-09-10T15:28:27.327810+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:28:27.327810+0000","last_undegraded":"2024-09-10T15:28:27.327810+0000","last_fullsized":"2024-09-10T15:28:27.327810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:27.327624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:27.327624+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.327624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:21.069009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.555470+0000","last_change":"2024-09-10T15:28:19.555531+0000","last_active":"2024-09-10T15:28:19.555470+0000","last_peered":"2024-09-10T15:28:19.555470+0000","last_clean":"2024-09-10T15:28:19.555470+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:28:19.555470+0000","last_undegraded":"2024-09-10T15:28:19.555470+0000","last_fullsized":"2024-09-10T15:28:19.555470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.555260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.555260+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.555260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.279245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"94'42","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.825700+0000","last_change":"2024-09-10T15:28:07.825818+0000","last_active":"2024-09-10T15:28:07.825700+0000","last_peered":"2024-09-10T15:28:07.825700+0000","last_clean":"2024-09-10T15:28:07.825700+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:28:07.825700+0000","last_undegraded":"2024-09-10T15:28:07.825700+0000","last_fullsized":"2024-09-10T15:28:07.825700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42","last_scrub_stamp":"2024-09-10T15:28:07.825515+0000","last_deep_scrub":"94'42","last_deep_scrub_stamp":"2024-09-10T15:28:07.825515+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.825515+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:25.897632+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":90,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.479570+0000","last_change":"2024-09-10T15:28:26.479628+0000","last_active":"2024-09-10T15:28:26.479570+0000","last_peered":"2024-09-10T15:28:26.479570+0000","last_clean":"2024-09-10T15:28:26.479570+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:28:26.479570+0000","last_undegraded":"2024-09-10T15:28:26.479570+0000","last_fullsized":"2024-09-10T15:28:26.479570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.479384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.479384+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.479384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:35.158638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:39.263233+0000","last_change":"2024-09-10T15:28:39.263296+0000","last_active":"2024-09-10T15:28:39.263233+0000","last_peered":"2024-09-10T15:28:39.263233+0000","last_clean":"2024-09-10T15:28:39.263233+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:28:39.263233+0000","last_undegraded":"2024-09-10T15:28:39.263233+0000","last_fullsized":"2024-09-10T15:28:39.263233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T15:28:39.263022+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T15:28:39.263022+0000","last_clean_scrub_stamp":"2024-09-10T15:28:39.263022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:12.798293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.267721+0000","last_change":"2024-09-10T15:28:16.267802+0000","last_active":"2024-09-10T15:28:16.267721+0000","last_peered":"2024-09-10T15:28:16.267721+0000","last_clean":"2024-09-10T15:28:16.267721+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:28:16.267721+0000","last_undegraded":"2024-09-10T15:28:16.267721+0000","last_fullsized":"2024-09-10T15:28:16.267721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.267507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.267507+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.267507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:48.314073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.288935+0000","last_change":"2024-09-10T15:28:21.288996+0000","last_active":"2024-09-10T15:28:21.288935+0000","last_peered":"2024-09-10T15:28:21.288935+0000","last_clean":"2024-09-10T15:28:21.288935+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:28:21.288935+0000","last_undegraded":"2024-09-10T15:28:21.288935+0000","last_fullsized":"2024-09-10T15:28:21.288935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:21.288727+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:21.288727+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.288727+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:01.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:37.361620+0000","last_change":"2024-09-10T15:28:37.361680+0000","last_active":"2024-09-10T15:28:37.361620+0000","last_peered":"2024-09-10T15:28:37.361620+0000","last_clean":"2024-09-10T15:28:37.361620+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:28:37.361620+0000","last_undegraded":"2024-09-10T15:28:37.361620+0000","last_fullsized":"2024-09-10T15:28:37.361620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:37.361424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:37.361424+0000","last_clean_scrub_stamp":"2024-09-10T15:28:37.361424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:24.458148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.317978+0000","last_change":"2024-09-10T15:28:08.318036+0000","last_active":"2024-09-10T15:28:08.317978+0000","last_peered":"2024-09-10T15:28:08.317978+0000","last_clean":"2024-09-10T15:28:08.317978+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:28:08.317978+0000","last_undegraded":"2024-09-10T15:28:08.317978+0000","last_fullsized":"2024-09-10T15:28:08.317978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.317783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.317783+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.317783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:43.508772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"94'21","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.336137+0000","last_change":"2024-09-10T15:28:26.336233+0000","last_active":"2024-09-10T15:28:26.336137+0000","last_peered":"2024-09-10T15:28:26.336137+0000","last_clean":"2024-09-10T15:28:26.336137+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:28:26.336137+0000","last_undegraded":"2024-09-10T15:28:26.336137+0000","last_fullsized":"2024-09-10T15:28:26.336137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'21","last_scrub_stamp":"2024-09-10T15:28:26.335919+0000","last_deep_scrub":"94'21","last_deep_scrub_stamp":"2024-09-10T15:28:26.335919+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.335919+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:11.594067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'18","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.256042+0000","last_change":"2024-09-10T15:28:28.256105+0000","last_active":"2024-09-10T15:28:28.256042+0000","last_peered":"2024-09-10T15:28:28.256042+0000","last_clean":"2024-09-10T15:28:28.256042+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:28:28.256042+0000","last_undegraded":"2024-09-10T15:28:28.256042+0000","last_fullsized":"2024-09-10T15:28:28.256042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:28.255859+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:28.255859+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.255859+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:31.915459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.879894+0000","last_change":"2024-09-10T15:28:28.879949+0000","last_active":"2024-09-10T15:28:28.879894+0000","last_peered":"2024-09-10T15:28:28.879894+0000","last_clean":"2024-09-10T15:28:28.879894+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:28:28.879894+0000","last_undegraded":"2024-09-10T15:28:28.879894+0000","last_fullsized":"2024-09-10T15:28:28.879894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.879705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.879705+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.879705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:21.393330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.614619+0000","last_change":"2024-09-10T15:28:14.614677+0000","last_active":"2024-09-10T15:28:14.614619+0000","last_peered":"2024-09-10T15:28:14.614619+0000","last_clean":"2024-09-10T15:28:14.614619+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:28:14.614619+0000","last_undegraded":"2024-09-10T15:28:14.614619+0000","last_fullsized":"2024-09-10T15:28:14.614619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.614427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.614427+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.614427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:07.754895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"94'20","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.599534+0000","last_change":"2024-09-10T15:28:32.599603+0000","last_active":"2024-09-10T15:28:32.599534+0000","last_peered":"2024-09-10T15:28:32.599534+0000","last_clean":"2024-09-10T15:28:32.599534+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:28:32.599534+0000","last_undegraded":"2024-09-10T15:28:32.599534+0000","last_fullsized":"2024-09-10T15:28:32.599534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:32.599347+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:32.599347+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.599347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:32.100098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.596651+0000","last_change":"2024-09-10T15:28:25.596703+0000","last_active":"2024-09-10T15:28:25.596651+0000","last_peered":"2024-09-10T15:28:25.596651+0000","last_clean":"2024-09-10T15:28:25.596651+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:28:25.596651+0000","last_undegraded":"2024-09-10T15:28:25.596651+0000","last_fullsized":"2024-09-10T15:28:25.596651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.596466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.596466+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.596466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:33.882185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.281806+0000","last_change":"2024-09-10T15:28:15.281864+0000","last_active":"2024-09-10T15:28:15.281806+0000","last_peered":"2024-09-10T15:28:15.281806+0000","last_clean":"2024-09-10T15:28:15.281806+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:28:15.281806+0000","last_undegraded":"2024-09-10T15:28:15.281806+0000","last_fullsized":"2024-09-10T15:28:15.281806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.281594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.281594+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.281594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:23.291851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"94'15","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.158065+0000","last_change":"2024-09-10T15:28:08.158142+0000","last_active":"2024-09-10T15:28:08.158065+0000","last_peered":"2024-09-10T15:28:08.158065+0000","last_clean":"2024-09-10T15:28:08.158065+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:28:08.158065+0000","last_undegraded":"2024-09-10T15:28:08.158065+0000","last_fullsized":"2024-09-10T15:28:08.158065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:08.157860+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:08.157860+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.157860+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:11.817460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.446335+0000","last_change":"2024-09-10T15:28:05.446396+0000","last_active":"2024-09-10T15:28:05.446335+0000","last_peered":"2024-09-10T15:28:05.446335+0000","last_clean":"2024-09-10T15:28:05.446335+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:28:05.446335+0000","last_undegraded":"2024-09-10T15:28:05.446335+0000","last_fullsized":"2024-09-10T15:28:05.446335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:05.446121+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:05.446121+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.446121+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:08.178983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:38.279013+0000","last_change":"2024-09-10T15:28:38.279069+0000","last_active":"2024-09-10T15:28:38.279013+0000","last_peered":"2024-09-10T15:28:38.279013+0000","last_clean":"2024-09-10T15:28:38.279013+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:28:38.279013+0000","last_undegraded":"2024-09-10T15:28:38.279013+0000","last_fullsized":"2024-09-10T15:28:38.279013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:38.278769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:38.278769+0000","last_clean_scrub_stamp":"2024-09-10T15:28:38.278769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:00.451633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":237,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.489609+0000","last_change":"2024-09-10T15:28:11.489721+0000","last_active":"2024-09-10T15:28:11.489609+0000","last_peered":"2024-09-10T15:28:11.489609+0000","last_clean":"2024-09-10T15:28:11.489609+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:28:11.489609+0000","last_undegraded":"2024-09-10T15:28:11.489609+0000","last_fullsized":"2024-09-10T15:28:11.489609+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'80","last_scrub_stamp":"2024-09-10T15:28:11.489305+0000","last_deep_scrub":"76'80","last_deep_scrub_stamp":"2024-09-10T15:28:11.489305+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.489305+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:14.253517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"94'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.633994+0000","last_change":"2024-09-10T15:28:29.634052+0000","last_active":"2024-09-10T15:28:29.633994+0000","last_peered":"2024-09-10T15:28:29.633994+0000","last_clean":"2024-09-10T15:28:29.633994+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:28:29.633994+0000","last_undegraded":"2024-09-10T15:28:29.633994+0000","last_fullsized":"2024-09-10T15:28:29.633994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:29.633771+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:29.633771+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.633771+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:41.123925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:36.393414+0000","last_change":"2024-09-10T15:28:36.393551+0000","last_active":"2024-09-10T15:28:36.393414+0000","last_peered":"2024-09-10T15:28:36.393414+0000","last_clean":"2024-09-10T15:28:36.393414+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:28:36.393414+0000","last_undegraded":"2024-09-10T15:28:36.393414+0000","last_fullsized":"2024-09-10T15:28:36.393414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:36.393126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:36.393126+0000","last_clean_scrub_stamp":"2024-09-10T15:28:36.393126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:32.453605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.570445+0000","last_change":"2024-09-10T15:28:15.570501+0000","last_active":"2024-09-10T15:28:15.570445+0000","last_peered":"2024-09-10T15:28:15.570445+0000","last_clean":"2024-09-10T15:28:15.570445+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:28:15.570445+0000","last_undegraded":"2024-09-10T15:28:15.570445+0000","last_fullsized":"2024-09-10T15:28:15.570445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.570257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.570257+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.570257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:05.319691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"94'46","reported_seq":220,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.298198+0000","last_change":"2024-09-10T15:28:24.298277+0000","last_active":"2024-09-10T15:28:24.298198+0000","last_peered":"2024-09-10T15:28:24.298198+0000","last_clean":"2024-09-10T15:28:24.298198+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:28:24.298198+0000","last_undegraded":"2024-09-10T15:28:24.298198+0000","last_fullsized":"2024-09-10T15:28:24.298198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'46","last_scrub_stamp":"2024-09-10T15:28:24.297998+0000","last_deep_scrub":"94'46","last_deep_scrub_stamp":"2024-09-10T15:28:24.297998+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.297998+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:32.977252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:38.534520+0000","last_change":"2024-09-10T15:28:38.534574+0000","last_active":"2024-09-10T15:28:38.534520+0000","last_peered":"2024-09-10T15:28:38.534520+0000","last_clean":"2024-09-10T15:28:38.534520+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:28:38.534520+0000","last_undegraded":"2024-09-10T15:28:38.534520+0000","last_fullsized":"2024-09-10T15:28:38.534520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:38.534306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:38.534306+0000","last_clean_scrub_stamp":"2024-09-10T15:28:38.534306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:51.659697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.433622+0000","last_change":"2024-09-10T15:28:28.433677+0000","last_active":"2024-09-10T15:28:28.433622+0000","last_peered":"2024-09-10T15:28:28.433622+0000","last_clean":"2024-09-10T15:28:28.433622+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:28:28.433622+0000","last_undegraded":"2024-09-10T15:28:28.433622+0000","last_fullsized":"2024-09-10T15:28:28.433622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.433429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.433429+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.433429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:29.152128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:39.582482+0000","last_change":"2024-09-10T15:28:39.582542+0000","last_active":"2024-09-10T15:28:39.582482+0000","last_peered":"2024-09-10T15:28:39.582482+0000","last_clean":"2024-09-10T15:28:39.582482+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:28:39.582482+0000","last_undegraded":"2024-09-10T15:28:39.582482+0000","last_fullsized":"2024-09-10T15:28:39.582482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:39.582288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:39.582288+0000","last_clean_scrub_stamp":"2024-09-10T15:28:39.582288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:02.620284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.527560+0000","last_change":"2024-09-10T15:28:15.527614+0000","last_active":"2024-09-10T15:28:15.527560+0000","last_peered":"2024-09-10T15:28:15.527560+0000","last_clean":"2024-09-10T15:28:15.527560+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:28:15.527560+0000","last_undegraded":"2024-09-10T15:28:15.527560+0000","last_fullsized":"2024-09-10T15:28:15.527560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.527362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.527362+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.527362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:47.573929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.301220+0000","last_change":"2024-09-10T15:28:21.301351+0000","last_active":"2024-09-10T15:28:21.301220+0000","last_peered":"2024-09-10T15:28:21.301220+0000","last_clean":"2024-09-10T15:28:21.301220+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:28:21.301220+0000","last_undegraded":"2024-09-10T15:28:21.301220+0000","last_fullsized":"2024-09-10T15:28:21.301220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:21.300929+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:21.300929+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.300929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.989573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":45068,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.208606+0000","last_change":"2024-09-10T15:28:07.208661+0000","last_active":"2024-09-10T15:28:07.208606+0000","last_peered":"2024-09-10T15:28:07.208606+0000","last_clean":"2024-09-10T15:28:07.208606+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:28:07.208606+0000","last_undegraded":"2024-09-10T15:28:07.208606+0000","last_fullsized":"2024-09-10T15:28:07.208606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.208393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.208393+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.208393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:45.062690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"94'26","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.200051+0000","last_change":"2024-09-10T15:28:13.200199+0000","last_active":"2024-09-10T15:28:13.200051+0000","last_peered":"2024-09-10T15:28:13.200051+0000","last_clean":"2024-09-10T15:28:13.200051+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:28:13.200051+0000","last_undegraded":"2024-09-10T15:28:13.200051+0000","last_fullsized":"2024-09-10T15:28:13.200051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:13.199820+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:13.199820+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.199820+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.301663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.799437+0000","last_change":"2024-09-10T15:28:15.799494+0000","last_active":"2024-09-10T15:28:15.799437+0000","last_peered":"2024-09-10T15:28:15.799437+0000","last_clean":"2024-09-10T15:28:15.799437+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:28:15.799437+0000","last_undegraded":"2024-09-10T15:28:15.799437+0000","last_fullsized":"2024-09-10T15:28:15.799437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.799245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.799245+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.799245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:07.693788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.811454+0000","last_change":"2024-09-10T15:28:30.811507+0000","last_active":"2024-09-10T15:28:30.811454+0000","last_peered":"2024-09-10T15:28:30.811454+0000","last_clean":"2024-09-10T15:28:30.811454+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:28:30.811454+0000","last_undegraded":"2024-09-10T15:28:30.811454+0000","last_fullsized":"2024-09-10T15:28:30.811454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.811262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.811262+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.811262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:39.490517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.599277+0000","last_change":"2024-09-10T15:28:24.599336+0000","last_active":"2024-09-10T15:28:24.599277+0000","last_peered":"2024-09-10T15:28:24.599277+0000","last_clean":"2024-09-10T15:28:24.599277+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:28:24.599277+0000","last_undegraded":"2024-09-10T15:28:24.599277+0000","last_fullsized":"2024-09-10T15:28:24.599277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'34","last_scrub_stamp":"2024-09-10T15:28:24.599078+0000","last_deep_scrub":"76'34","last_deep_scrub_stamp":"2024-09-10T15:28:24.599078+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.599078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:53.462459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.373604+0000","last_change":"2024-09-10T15:28:13.373663+0000","last_active":"2024-09-10T15:28:13.373604+0000","last_peered":"2024-09-10T15:28:13.373604+0000","last_clean":"2024-09-10T15:28:13.373604+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:28:13.373604+0000","last_undegraded":"2024-09-10T15:28:13.373604+0000","last_fullsized":"2024-09-10T15:28:13.373604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:13.373405+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:13.373405+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.373405+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:59.338948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.524187+0000","last_change":"2024-09-10T15:28:17.524250+0000","last_active":"2024-09-10T15:28:17.524187+0000","last_peered":"2024-09-10T15:28:17.524187+0000","last_clean":"2024-09-10T15:28:17.524187+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:28:17.524187+0000","last_undegraded":"2024-09-10T15:28:17.524187+0000","last_fullsized":"2024-09-10T15:28:17.524187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.523948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.523948+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.523948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:02.782096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"94'8","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.700601+0000","last_change":"2024-09-10T15:28:08.700669+0000","last_active":"2024-09-10T15:28:08.700601+0000","last_peered":"2024-09-10T15:28:08.700601+0000","last_clean":"2024-09-10T15:28:08.700601+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:28:08.700601+0000","last_undegraded":"2024-09-10T15:28:08.700601+0000","last_fullsized":"2024-09-10T15:28:08.700601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:08.700414+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:08.700414+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.700414+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.046095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.469901+0000","last_change":"2024-09-10T15:28:27.469954+0000","last_active":"2024-09-10T15:28:27.469901+0000","last_peered":"2024-09-10T15:28:27.469901+0000","last_clean":"2024-09-10T15:28:27.469901+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:28:27.469901+0000","last_undegraded":"2024-09-10T15:28:27.469901+0000","last_fullsized":"2024-09-10T15:28:27.469901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:27.469707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:27.469707+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.469707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:48.193692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.397496+0000","last_change":"2024-09-10T15:28:30.397615+0000","last_active":"2024-09-10T15:28:30.397496+0000","last_peered":"2024-09-10T15:28:30.397496+0000","last_clean":"2024-09-10T15:28:30.397496+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:28:30.397496+0000","last_undegraded":"2024-09-10T15:28:30.397496+0000","last_fullsized":"2024-09-10T15:28:30.397496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.397248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.397248+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.397248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:43.316210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.554589+0000","last_change":"2024-09-10T15:28:20.554641+0000","last_active":"2024-09-10T15:28:20.554589+0000","last_peered":"2024-09-10T15:28:20.554589+0000","last_clean":"2024-09-10T15:28:20.554589+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:28:20.554589+0000","last_undegraded":"2024-09-10T15:28:20.554589+0000","last_fullsized":"2024-09-10T15:28:20.554589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:20.554354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:20.554354+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.554354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:50.476162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.522414+0000","last_change":"2024-09-10T15:28:18.522472+0000","last_active":"2024-09-10T15:28:18.522414+0000","last_peered":"2024-09-10T15:28:18.522414+0000","last_clean":"2024-09-10T15:28:18.522414+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:28:18.522414+0000","last_undegraded":"2024-09-10T15:28:18.522414+0000","last_fullsized":"2024-09-10T15:28:18.522414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:18.522230+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:18.522230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.522230+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:20.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.407551+0000","last_change":"2024-09-10T15:28:06.407609+0000","last_active":"2024-09-10T15:28:06.407551+0000","last_peered":"2024-09-10T15:28:06.407551+0000","last_clean":"2024-09-10T15:28:06.407551+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:28:06.407551+0000","last_undegraded":"2024-09-10T15:28:06.407551+0000","last_fullsized":"2024-09-10T15:28:06.407551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.407347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.407347+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.407347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:23.137819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"94'22","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.742879+0000","last_change":"2024-09-10T15:28:05.742964+0000","last_active":"2024-09-10T15:28:05.742879+0000","last_peered":"2024-09-10T15:28:05.742879+0000","last_clean":"2024-09-10T15:28:05.742879+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:28:05.742879+0000","last_undegraded":"2024-09-10T15:28:05.742879+0000","last_fullsized":"2024-09-10T15:28:05.742879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:05.742670+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:05.742670+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.742670+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:02.895762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.206736+0000","last_change":"2024-09-10T15:28:27.206795+0000","last_active":"2024-09-10T15:28:27.206736+0000","last_peered":"2024-09-10T15:28:27.206736+0000","last_clean":"2024-09-10T15:28:27.206736+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:28:27.206736+0000","last_undegraded":"2024-09-10T15:28:27.206736+0000","last_fullsized":"2024-09-10T15:28:27.206736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:27.206515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:27.206515+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.206515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:40.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:53.191110+0000","last_change":"2024-09-10T15:25:21.885955+0000","last_active":"2024-09-10T15:27:53.191110+0000","last_peered":"2024-09-10T15:27:53.191110+0000","last_clean":"2024-09-10T15:27:53.191110+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:27:53.191110+0000","last_undegraded":"2024-09-10T15:27:53.191110+0000","last_fullsized":"2024-09-10T15:27:53.191110+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.711513+0000","last_change":"2024-09-10T15:28:21.711566+0000","last_active":"2024-09-10T15:28:21.711513+0000","last_peered":"2024-09-10T15:28:21.711513+0000","last_clean":"2024-09-10T15:28:21.711513+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:28:21.711513+0000","last_undegraded":"2024-09-10T15:28:21.711513+0000","last_fullsized":"2024-09-10T15:28:21.711513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:21.711321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:21.711321+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.711321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:13.521229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"94'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.318795+0000","last_change":"2024-09-10T15:28:30.318855+0000","last_active":"2024-09-10T15:28:30.318795+0000","last_peered":"2024-09-10T15:28:30.318795+0000","last_clean":"2024-09-10T15:28:30.318795+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:28:30.318795+0000","last_undegraded":"2024-09-10T15:28:30.318795+0000","last_fullsized":"2024-09-10T15:28:30.318795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:30.318614+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:30.318614+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.318614+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:38.328870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.332560+0000","last_change":"2024-09-10T15:28:17.332613+0000","last_active":"2024-09-10T15:28:17.332560+0000","last_peered":"2024-09-10T15:28:17.332560+0000","last_clean":"2024-09-10T15:28:17.332560+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:28:17.332560+0000","last_undegraded":"2024-09-10T15:28:17.332560+0000","last_fullsized":"2024-09-10T15:28:17.332560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.332339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.332339+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.332339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:01.715610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"94'23","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.344733+0000","last_change":"2024-09-10T15:28:10.344885+0000","last_active":"2024-09-10T15:28:10.344733+0000","last_peered":"2024-09-10T15:28:10.344733+0000","last_clean":"2024-09-10T15:28:10.344733+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:28:10.344733+0000","last_undegraded":"2024-09-10T15:28:10.344733+0000","last_fullsized":"2024-09-10T15:28:10.344733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'23","last_scrub_stamp":"2024-09-10T15:28:10.344514+0000","last_deep_scrub":"94'23","last_deep_scrub_stamp":"2024-09-10T15:28:10.344514+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.344514+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:31.737059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.782014+0000","last_change":"2024-09-10T15:28:13.782073+0000","last_active":"2024-09-10T15:28:13.782014+0000","last_peered":"2024-09-10T15:28:13.782014+0000","last_clean":"2024-09-10T15:28:13.782014+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:28:13.782014+0000","last_undegraded":"2024-09-10T15:28:13.782014+0000","last_fullsized":"2024-09-10T15:28:13.782014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.781760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.781760+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.781760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:48.972749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.308004+0000","last_change":"2024-09-10T15:28:19.308056+0000","last_active":"2024-09-10T15:28:19.308004+0000","last_peered":"2024-09-10T15:28:19.308004+0000","last_clean":"2024-09-10T15:28:19.308004+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:28:19.308004+0000","last_undegraded":"2024-09-10T15:28:19.308004+0000","last_fullsized":"2024-09-10T15:28:19.308004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.307814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.307814+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.307814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:18.808566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"94'22","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.412069+0000","last_change":"2024-09-10T15:28:18.412131+0000","last_active":"2024-09-10T15:28:18.412069+0000","last_peered":"2024-09-10T15:28:18.412069+0000","last_clean":"2024-09-10T15:28:18.412069+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:28:18.412069+0000","last_undegraded":"2024-09-10T15:28:18.412069+0000","last_fullsized":"2024-09-10T15:28:18.412069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:18.411860+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:18.411860+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.411860+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:27.091115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.302559+0000","last_change":"2024-09-10T15:28:09.302610+0000","last_active":"2024-09-10T15:28:09.302559+0000","last_peered":"2024-09-10T15:28:09.302559+0000","last_clean":"2024-09-10T15:28:09.302559+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:28:09.302559+0000","last_undegraded":"2024-09-10T15:28:09.302559+0000","last_fullsized":"2024-09-10T15:28:09.302559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.302345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.302345+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.302345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:16.379652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"94'33","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.298898+0000","last_change":"2024-09-10T15:28:25.298972+0000","last_active":"2024-09-10T15:28:25.298898+0000","last_peered":"2024-09-10T15:28:25.298898+0000","last_clean":"2024-09-10T15:28:25.298898+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:28:25.298898+0000","last_undegraded":"2024-09-10T15:28:25.298898+0000","last_fullsized":"2024-09-10T15:28:25.298898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'33","last_scrub_stamp":"2024-09-10T15:28:25.298717+0000","last_deep_scrub":"94'33","last_deep_scrub_stamp":"2024-09-10T15:28:25.298717+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.298717+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:17.812343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":76,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.523425+0000","last_change":"2024-09-10T15:28:24.523530+0000","last_active":"2024-09-10T15:28:24.523425+0000","last_peered":"2024-09-10T15:28:24.523425+0000","last_clean":"2024-09-10T15:28:24.523425+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:28:24.523425+0000","last_undegraded":"2024-09-10T15:28:24.523425+0000","last_fullsized":"2024-09-10T15:28:24.523425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:24.523204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:24.523204+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.523204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:17.036830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:40.246594+0000","last_change":"2024-09-10T15:28:40.246649+0000","last_active":"2024-09-10T15:28:40.246594+0000","last_peered":"2024-09-10T15:28:40.246594+0000","last_clean":"2024-09-10T15:28:40.246594+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:28:40.246594+0000","last_undegraded":"2024-09-10T15:28:40.246594+0000","last_fullsized":"2024-09-10T15:28:40.246594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:40.246363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:40.246363+0000","last_clean_scrub_stamp":"2024-09-10T15:28:40.246363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:53.371754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.570731+0000","last_change":"2024-09-10T15:28:16.570782+0000","last_active":"2024-09-10T15:28:16.570731+0000","last_peered":"2024-09-10T15:28:16.570731+0000","last_clean":"2024-09-10T15:28:16.570731+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:28:16.570731+0000","last_undegraded":"2024-09-10T15:28:16.570731+0000","last_fullsized":"2024-09-10T15:28:16.570731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.570520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.570520+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.570520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:40.436103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"94'22","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.602420+0000","last_change":"2024-09-10T15:28:31.602481+0000","last_active":"2024-09-10T15:28:31.602420+0000","last_peered":"2024-09-10T15:28:31.602420+0000","last_clean":"2024-09-10T15:28:31.602420+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:28:31.602420+0000","last_undegraded":"2024-09-10T15:28:31.602420+0000","last_fullsized":"2024-09-10T15:28:31.602420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:31.602233+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:31.602233+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.602233+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.230609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.533155+0000","last_change":"2024-09-10T15:28:12.533208+0000","last_active":"2024-09-10T15:28:12.533155+0000","last_peered":"2024-09-10T15:28:12.533155+0000","last_clean":"2024-09-10T15:28:12.533155+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:28:12.533155+0000","last_undegraded":"2024-09-10T15:28:12.533155+0000","last_fullsized":"2024-09-10T15:28:12.533155+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.532916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.532916+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.532916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:33.925461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"94'30","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.226795+0000","last_change":"2024-09-10T15:28:06.226877+0000","last_active":"2024-09-10T15:28:06.226795+0000","last_peered":"2024-09-10T15:28:06.226795+0000","last_clean":"2024-09-10T15:28:06.226795+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:28:06.226795+0000","last_undegraded":"2024-09-10T15:28:06.226795+0000","last_fullsized":"2024-09-10T15:28:06.226795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:06.226556+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:06.226556+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.226556+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:06.945254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:36.262359+0000","last_change":"2024-09-10T15:28:36.262415+0000","last_active":"2024-09-10T15:28:36.262359+0000","last_peered":"2024-09-10T15:28:36.262359+0000","last_clean":"2024-09-10T15:28:36.262359+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:28:36.262359+0000","last_undegraded":"2024-09-10T15:28:36.262359+0000","last_fullsized":"2024-09-10T15:28:36.262359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:36.262165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:36.262165+0000","last_clean_scrub_stamp":"2024-09-10T15:28:36.262165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:14.950810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188992+0000","last_change":"2024-09-10T15:25:21.895570+0000","last_active":"2024-09-10T15:27:43.188992+0000","last_peered":"2024-09-10T15:27:43.188992+0000","last_clean":"2024-09-10T15:27:43.188992+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:27:43.188992+0000","last_undegraded":"2024-09-10T15:27:43.188992+0000","last_fullsized":"2024-09-10T15:27:43.188992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.791411+0000","last_change":"2024-09-10T15:28:16.791472+0000","last_active":"2024-09-10T15:28:16.791411+0000","last_peered":"2024-09-10T15:28:16.791411+0000","last_clean":"2024-09-10T15:28:16.791411+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:28:16.791411+0000","last_undegraded":"2024-09-10T15:28:16.791411+0000","last_fullsized":"2024-09-10T15:28:16.791411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:16.791219+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:16.791219+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.791219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:56.893061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"94'12","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.207900+0000","last_change":"2024-09-10T15:28:22.207965+0000","last_active":"2024-09-10T15:28:22.207900+0000","last_peered":"2024-09-10T15:28:22.207900+0000","last_clean":"2024-09-10T15:28:22.207900+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:28:22.207900+0000","last_undegraded":"2024-09-10T15:28:22.207900+0000","last_fullsized":"2024-09-10T15:28:22.207900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:22.207680+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:22.207680+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.207680+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:14.721305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.527746+0000","last_change":"2024-09-10T15:28:10.527798+0000","last_active":"2024-09-10T15:28:10.527746+0000","last_peered":"2024-09-10T15:28:10.527746+0000","last_clean":"2024-09-10T15:28:10.527746+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:28:10.527746+0000","last_undegraded":"2024-09-10T15:28:10.527746+0000","last_fullsized":"2024-09-10T15:28:10.527746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.527550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.527550+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.527550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:45.718539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"94'22","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.223025+0000","last_change":"2024-09-10T15:28:15.223094+0000","last_active":"2024-09-10T15:28:15.223025+0000","last_peered":"2024-09-10T15:28:15.223025+0000","last_clean":"2024-09-10T15:28:15.223025+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:28:15.223025+0000","last_undegraded":"2024-09-10T15:28:15.223025+0000","last_fullsized":"2024-09-10T15:28:15.223025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:15.222819+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:15.222819+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.222819+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:01.188362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.797589+0000","last_change":"2024-09-10T15:28:25.797643+0000","last_active":"2024-09-10T15:28:25.797589+0000","last_peered":"2024-09-10T15:28:25.797589+0000","last_clean":"2024-09-10T15:28:25.797589+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:28:25.797589+0000","last_undegraded":"2024-09-10T15:28:25.797589+0000","last_fullsized":"2024-09-10T15:28:25.797589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.797392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.797392+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.797392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:09.123393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188896+0000","last_change":"2024-09-10T15:25:21.897448+0000","last_active":"2024-09-10T15:27:43.188896+0000","last_peered":"2024-09-10T15:27:43.188896+0000","last_clean":"2024-09-10T15:27:43.188896+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:27:43.188896+0000","last_undegraded":"2024-09-10T15:27:43.188896+0000","last_fullsized":"2024-09-10T15:27:43.188896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.606650+0000","last_change":"2024-09-10T15:28:12.606711+0000","last_active":"2024-09-10T15:28:12.606650+0000","last_peered":"2024-09-10T15:28:12.606650+0000","last_clean":"2024-09-10T15:28:12.606650+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:28:12.606650+0000","last_undegraded":"2024-09-10T15:28:12.606650+0000","last_fullsized":"2024-09-10T15:28:12.606650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:12.606456+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:12.606456+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.606456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:52.819438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"94'26","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.632163+0000","last_change":"2024-09-10T15:28:28.632226+0000","last_active":"2024-09-10T15:28:28.632163+0000","last_peered":"2024-09-10T15:28:28.632163+0000","last_clean":"2024-09-10T15:28:28.632163+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:28:28.632163+0000","last_undegraded":"2024-09-10T15:28:28.632163+0000","last_fullsized":"2024-09-10T15:28:28.632163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:28.631967+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:28.631967+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.631967+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:58.389610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47122,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"94'2","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.609951+0000","last_change":"2024-09-10T15:28:11.610023+0000","last_active":"2024-09-10T15:28:11.609951+0000","last_peered":"2024-09-10T15:28:11.609951+0000","last_clean":"2024-09-10T15:28:11.609951+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:28:11.609951+0000","last_undegraded":"2024-09-10T15:28:11.609951+0000","last_fullsized":"2024-09-10T15:28:11.609951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:11.609746+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:11.609746+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.609746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:15.517396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"94'18","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.194858+0000","last_change":"2024-09-10T15:28:04.194896+0000","last_active":"2024-09-10T15:28:04.194858+0000","last_peered":"2024-09-10T15:28:04.194858+0000","last_clean":"2024-09-10T15:28:04.194858+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:28:04.194858+0000","last_undegraded":"2024-09-10T15:28:04.194858+0000","last_fullsized":"2024-09-10T15:28:04.194858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:04.194769+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:04.194769+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.194769+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.602958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":770,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'18","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.270843+0000","last_change":"2024-09-10T15:28:25.271006+0000","last_active":"2024-09-10T15:28:25.270843+0000","last_peered":"2024-09-10T15:28:25.270843+0000","last_clean":"2024-09-10T15:28:25.270843+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:28:25.270843+0000","last_undegraded":"2024-09-10T15:28:25.270843+0000","last_fullsized":"2024-09-10T15:28:25.270843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:25.270614+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:25.270614+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.270614+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:40.023750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:43.188839+0000","last_change":"2024-09-10T15:25:21.895356+0000","last_active":"2024-09-10T15:27:43.188839+0000","last_peered":"2024-09-10T15:27:43.188839+0000","last_clean":"2024-09-10T15:27:43.188839+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:27:43.188839+0000","last_undegraded":"2024-09-10T15:27:43.188839+0000","last_fullsized":"2024-09-10T15:27:43.188839+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.345798+0000","last_change":"2024-09-10T15:28:04.345846+0000","last_active":"2024-09-10T15:28:04.345798+0000","last_peered":"2024-09-10T15:28:04.345798+0000","last_clean":"2024-09-10T15:28:04.345798+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:28:04.345798+0000","last_undegraded":"2024-09-10T15:28:04.345798+0000","last_fullsized":"2024-09-10T15:28:04.345798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.345669+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:22.417786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.292588+0000","last_change":"2024-09-10T15:28:20.292654+0000","last_active":"2024-09-10T15:28:20.292588+0000","last_peered":"2024-09-10T15:28:20.292588+0000","last_clean":"2024-09-10T15:28:20.292588+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:28:20.292588+0000","last_undegraded":"2024-09-10T15:28:20.292588+0000","last_fullsized":"2024-09-10T15:28:20.292588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:20.292391+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:20.292391+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.292391+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:34:10.695700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.341356+0000","last_change":"2024-09-10T15:28:08.341408+0000","last_active":"2024-09-10T15:28:08.341356+0000","last_peered":"2024-09-10T15:28:08.341356+0000","last_clean":"2024-09-10T15:28:08.341356+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:28:08.341356+0000","last_undegraded":"2024-09-10T15:28:08.341356+0000","last_fullsized":"2024-09-10T15:28:08.341356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.341166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.341166+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.341166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:11.105377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"94'30","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.349890+0000","last_change":"2024-09-10T15:28:12.349970+0000","last_active":"2024-09-10T15:28:12.349890+0000","last_peered":"2024-09-10T15:28:12.349890+0000","last_clean":"2024-09-10T15:28:12.349890+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:28:12.349890+0000","last_undegraded":"2024-09-10T15:28:12.349890+0000","last_fullsized":"2024-09-10T15:28:12.349890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:12.349697+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:12.349697+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.349697+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:24.394448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:34.539504+0000","last_change":"2024-09-10T15:28:34.539558+0000","last_active":"2024-09-10T15:28:34.539504+0000","last_peered":"2024-09-10T15:28:34.539504+0000","last_clean":"2024-09-10T15:28:34.539504+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:28:34.539504+0000","last_undegraded":"2024-09-10T15:28:34.539504+0000","last_fullsized":"2024-09-10T15:28:34.539504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:34.539306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:34.539306+0000","last_clean_scrub_stamp":"2024-09-10T15:28:34.539306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:13.227951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.192762+0000","last_change":"2024-09-10T15:28:33.192908+0000","last_active":"2024-09-10T15:28:33.192762+0000","last_peered":"2024-09-10T15:28:33.192762+0000","last_clean":"2024-09-10T15:28:33.192762+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:28:33.192762+0000","last_undegraded":"2024-09-10T15:28:33.192762+0000","last_fullsized":"2024-09-10T15:28:33.192762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:33.192546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:33.192546+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.192546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:02.419640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.384920+0000","last_change":"2024-09-10T15:28:05.384942+0000","last_active":"2024-09-10T15:28:05.384920+0000","last_peered":"2024-09-10T15:28:05.384920+0000","last_clean":"2024-09-10T15:28:05.384920+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:28:05.384920+0000","last_undegraded":"2024-09-10T15:28:05.384920+0000","last_fullsized":"2024-09-10T15:28:05.384920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.384839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.384839+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.384839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:41.540594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"94'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:35.358109+0000","last_change":"2024-09-10T15:28:35.358170+0000","last_active":"2024-09-10T15:28:35.358109+0000","last_peered":"2024-09-10T15:28:35.358109+0000","last_clean":"2024-09-10T15:28:35.358109+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:28:35.358109+0000","last_undegraded":"2024-09-10T15:28:35.358109+0000","last_fullsized":"2024-09-10T15:28:35.358109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:35.357917+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:35.357917+0000","last_clean_scrub_stamp":"2024-09-10T15:28:35.357917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:09.245552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":24594,"num_write":44,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.470384+0000","last_change":"2024-09-10T15:28:08.470502+0000","last_active":"2024-09-10T15:28:08.470384+0000","last_peered":"2024-09-10T15:28:08.470384+0000","last_clean":"2024-09-10T15:28:08.470384+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:28:08.470384+0000","last_undegraded":"2024-09-10T15:28:08.470384+0000","last_fullsized":"2024-09-10T15:28:08.470384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.470147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.470147+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.470147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:17.894119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"94'22","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.726092+0000","last_change":"2024-09-10T15:28:06.726180+0000","last_active":"2024-09-10T15:28:06.726092+0000","last_peered":"2024-09-10T15:28:06.726092+0000","last_clean":"2024-09-10T15:28:06.726092+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:28:06.726092+0000","last_undegraded":"2024-09-10T15:28:06.726092+0000","last_fullsized":"2024-09-10T15:28:06.726092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:06.725874+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:06.725874+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.725874+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:18.770624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.189996+0000","last_change":"2024-09-10T15:25:19.887625+0000","last_active":"2024-09-10T15:27:48.189996+0000","last_peered":"2024-09-10T15:27:48.189996+0000","last_clean":"2024-09-10T15:27:48.189996+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:27:48.189996+0000","last_undegraded":"2024-09-10T15:27:48.189996+0000","last_fullsized":"2024-09-10T15:27:48.189996+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:18.835136+0000","last_clean_scrub_stamp":"2024-09-10T15:25:18.835136+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:42.167087+0000","last_change":"2024-09-10T15:28:42.167148+0000","last_active":"2024-09-10T15:28:42.167087+0000","last_peered":"2024-09-10T15:28:42.167087+0000","last_clean":"2024-09-10T15:28:42.167087+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:28:42.167087+0000","last_undegraded":"2024-09-10T15:28:42.167087+0000","last_fullsized":"2024-09-10T15:28:42.167087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:42.166888+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:42.166888+0000","last_clean_scrub_stamp":"2024-09-10T15:28:42.166888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:49.349557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.711119+0000","last_change":"2024-09-10T15:28:22.711182+0000","last_active":"2024-09-10T15:28:22.711119+0000","last_peered":"2024-09-10T15:28:22.711119+0000","last_clean":"2024-09-10T15:28:22.711119+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:28:22.711119+0000","last_undegraded":"2024-09-10T15:28:22.711119+0000","last_fullsized":"2024-09-10T15:28:22.711119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:22.710926+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:22.710926+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.710926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:24.254126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"94'12","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.327375+0000","last_change":"2024-09-10T15:28:31.327432+0000","last_active":"2024-09-10T15:28:31.327375+0000","last_peered":"2024-09-10T15:28:31.327375+0000","last_clean":"2024-09-10T15:28:31.327375+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:28:31.327375+0000","last_undegraded":"2024-09-10T15:28:31.327375+0000","last_fullsized":"2024-09-10T15:28:31.327375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:31.327190+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:31.327190+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.327190+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:24.595594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"94'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.362550+0000","last_change":"2024-09-10T15:28:06.362631+0000","last_active":"2024-09-10T15:28:06.362550+0000","last_peered":"2024-09-10T15:28:06.362550+0000","last_clean":"2024-09-10T15:28:06.362550+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:28:06.362550+0000","last_undegraded":"2024-09-10T15:28:06.362550+0000","last_fullsized":"2024-09-10T15:28:06.362550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:06.362369+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:06.362369+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.362369+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:13.439676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"94'18","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.255748+0000","last_change":"2024-09-10T15:28:11.255817+0000","last_active":"2024-09-10T15:28:11.255748+0000","last_peered":"2024-09-10T15:28:11.255748+0000","last_clean":"2024-09-10T15:28:11.255748+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:28:11.255748+0000","last_undegraded":"2024-09-10T15:28:11.255748+0000","last_fullsized":"2024-09-10T15:28:11.255748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:11.255531+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:11.255531+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.255531+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:14.019743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":65,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.171492+0000","last_change":"2024-09-10T15:28:10.171544+0000","last_active":"2024-09-10T15:28:10.171492+0000","last_peered":"2024-09-10T15:28:10.171492+0000","last_clean":"2024-09-10T15:28:10.171492+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:28:10.171492+0000","last_undegraded":"2024-09-10T15:28:10.171492+0000","last_fullsized":"2024-09-10T15:28:10.171492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.171291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.171291+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.171291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:42.166255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":128,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:48.190158+0000","last_change":"2024-09-10T15:25:21.886403+0000","last_active":"2024-09-10T15:27:48.190158+0000","last_peered":"2024-09-10T15:27:48.190158+0000","last_clean":"2024-09-10T15:27:48.190158+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:27:48.190158+0000","last_undegraded":"2024-09-10T15:27:48.190158+0000","last_fullsized":"2024-09-10T15:27:48.190158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:20.849449+0000","last_clean_scrub_stamp":"2024-09-10T15:25:20.849449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.457308+0000","last_change":"2024-09-10T15:28:07.457361+0000","last_active":"2024-09-10T15:28:07.457308+0000","last_peered":"2024-09-10T15:28:07.457308+0000","last_clean":"2024-09-10T15:28:07.457308+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:28:07.457308+0000","last_undegraded":"2024-09-10T15:28:07.457308+0000","last_fullsized":"2024-09-10T15:28:07.457308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.457108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.457108+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.457108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:45.311405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"94'14","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.278582+0000","last_change":"2024-09-10T15:28:32.278639+0000","last_active":"2024-09-10T15:28:32.278582+0000","last_peered":"2024-09-10T15:28:32.278582+0000","last_clean":"2024-09-10T15:28:32.278582+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:28:32.278582+0000","last_undegraded":"2024-09-10T15:28:32.278582+0000","last_fullsized":"2024-09-10T15:28:32.278582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:32.278389+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:32.278389+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.278389+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:16.661660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"94'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.567698+0000","last_change":"2024-09-10T15:28:21.567764+0000","last_active":"2024-09-10T15:28:21.567698+0000","last_peered":"2024-09-10T15:28:21.567698+0000","last_clean":"2024-09-10T15:28:21.567698+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:28:21.567698+0000","last_undegraded":"2024-09-10T15:28:21.567698+0000","last_fullsized":"2024-09-10T15:28:21.567698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:21.567500+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:21.567500+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.567500+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:25.227099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"94'20","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.185943+0000","last_change":"2024-09-10T15:28:09.186040+0000","last_active":"2024-09-10T15:28:09.185943+0000","last_peered":"2024-09-10T15:28:09.185943+0000","last_clean":"2024-09-10T15:28:09.185943+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:28:09.185943+0000","last_undegraded":"2024-09-10T15:28:09.185943+0000","last_fullsized":"2024-09-10T15:28:09.185943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:09.185740+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:09.185740+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.185740+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:04.655249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:36.493632+0000","last_change":"2024-09-10T15:28:36.493685+0000","last_active":"2024-09-10T15:28:36.493632+0000","last_peered":"2024-09-10T15:28:36.493632+0000","last_clean":"2024-09-10T15:28:36.493632+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:28:36.493632+0000","last_undegraded":"2024-09-10T15:28:36.493632+0000","last_fullsized":"2024-09-10T15:28:36.493632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:36.493428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:36.493428+0000","last_clean_scrub_stamp":"2024-09-10T15:28:36.493428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:58.666292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.280925+0000","last_change":"2024-09-10T15:28:27.280991+0000","last_active":"2024-09-10T15:28:27.280925+0000","last_peered":"2024-09-10T15:28:27.280925+0000","last_clean":"2024-09-10T15:28:27.280925+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:28:27.280925+0000","last_undegraded":"2024-09-10T15:28:27.280925+0000","last_fullsized":"2024-09-10T15:28:27.280925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:27.280695+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:27.280695+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.280695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:40.199658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.556659+0000","last_change":"2024-09-10T15:28:22.556714+0000","last_active":"2024-09-10T15:28:22.556659+0000","last_peered":"2024-09-10T15:28:22.556659+0000","last_clean":"2024-09-10T15:28:22.556659+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:28:22.556659+0000","last_undegraded":"2024-09-10T15:28:22.556659+0000","last_fullsized":"2024-09-10T15:28:22.556659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:22.556457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:22.556457+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.556457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:53.008242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"94'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.480197+0000","last_change":"2024-09-10T15:28:20.480255+0000","last_active":"2024-09-10T15:28:20.480197+0000","last_peered":"2024-09-10T15:28:20.480197+0000","last_clean":"2024-09-10T15:28:20.480197+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:28:20.480197+0000","last_undegraded":"2024-09-10T15:28:20.480197+0000","last_fullsized":"2024-09-10T15:28:20.480197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:20.480004+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:20.480004+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.480004+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:00.692986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.830048+0000","last_change":"2024-09-10T15:28:14.830105+0000","last_active":"2024-09-10T15:28:14.830048+0000","last_peered":"2024-09-10T15:28:14.830048+0000","last_clean":"2024-09-10T15:28:14.830048+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:28:14.830048+0000","last_undegraded":"2024-09-10T15:28:14.830048+0000","last_fullsized":"2024-09-10T15:28:14.830048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.829829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.829829+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.829829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:17.594040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"94'6","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.787268+0000","last_change":"2024-09-10T15:28:18.787333+0000","last_active":"2024-09-10T15:28:18.787268+0000","last_peered":"2024-09-10T15:28:18.787268+0000","last_clean":"2024-09-10T15:28:18.787268+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:28:18.787268+0000","last_undegraded":"2024-09-10T15:28:18.787268+0000","last_fullsized":"2024-09-10T15:28:18.787268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T15:28:18.787079+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T15:28:18.787079+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.787079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:04.752621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.398023+0000","last_change":"2024-09-10T15:28:32.398078+0000","last_active":"2024-09-10T15:28:32.398023+0000","last_peered":"2024-09-10T15:28:32.398023+0000","last_clean":"2024-09-10T15:28:32.398023+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:28:32.398023+0000","last_undegraded":"2024-09-10T15:28:32.398023+0000","last_fullsized":"2024-09-10T15:28:32.398023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:32.397824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:32.397824+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.397824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:28.098101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.322946+0000","last_change":"2024-09-10T15:28:25.323089+0000","last_active":"2024-09-10T15:28:25.322946+0000","last_peered":"2024-09-10T15:28:25.322946+0000","last_clean":"2024-09-10T15:28:25.322946+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:28:25.322946+0000","last_undegraded":"2024-09-10T15:28:25.322946+0000","last_fullsized":"2024-09-10T15:28:25.322946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:25.322723+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:25.322723+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.322723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:38.448114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.404835+0000","last_change":"2024-09-10T15:28:19.404885+0000","last_active":"2024-09-10T15:28:19.404835+0000","last_peered":"2024-09-10T15:28:19.404835+0000","last_clean":"2024-09-10T15:28:19.404835+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:28:19.404835+0000","last_undegraded":"2024-09-10T15:28:19.404835+0000","last_fullsized":"2024-09-10T15:28:19.404835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.404642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.404642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.404642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.128627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"94'26","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.343029+0000","last_change":"2024-09-10T15:28:28.343087+0000","last_active":"2024-09-10T15:28:28.343029+0000","last_peered":"2024-09-10T15:28:28.343029+0000","last_clean":"2024-09-10T15:28:28.343029+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:28:28.343029+0000","last_undegraded":"2024-09-10T15:28:28.343029+0000","last_fullsized":"2024-09-10T15:28:28.343029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:28.342849+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:28.342849+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.342849+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:29.769035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":51212,"num_write":46,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.462630+0000","last_change":"2024-09-10T15:28:11.462804+0000","last_active":"2024-09-10T15:28:11.462630+0000","last_peered":"2024-09-10T15:28:11.462630+0000","last_clean":"2024-09-10T15:28:11.462630+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:28:11.462630+0000","last_undegraded":"2024-09-10T15:28:11.462630+0000","last_fullsized":"2024-09-10T15:28:11.462630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:11.462398+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:11.462398+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.462398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:13.005598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"94'24","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.248422+0000","last_change":"2024-09-10T15:28:19.248484+0000","last_active":"2024-09-10T15:28:19.248422+0000","last_peered":"2024-09-10T15:28:19.248422+0000","last_clean":"2024-09-10T15:28:19.248422+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:28:19.248422+0000","last_undegraded":"2024-09-10T15:28:19.248422+0000","last_fullsized":"2024-09-10T15:28:19.248422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:19.248230+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:19.248230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.248230+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:20.791430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.340347+0000","last_change":"2024-09-10T15:28:11.340454+0000","last_active":"2024-09-10T15:28:11.340347+0000","last_peered":"2024-09-10T15:28:11.340347+0000","last_clean":"2024-09-10T15:28:11.340347+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:28:11.340347+0000","last_undegraded":"2024-09-10T15:28:11.340347+0000","last_fullsized":"2024-09-10T15:28:11.340347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.340123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.340123+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.340123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:14.072984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"94'16","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.230865+0000","last_change":"2024-09-10T15:28:18.230923+0000","last_active":"2024-09-10T15:28:18.230865+0000","last_peered":"2024-09-10T15:28:18.230865+0000","last_clean":"2024-09-10T15:28:18.230865+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:28:18.230865+0000","last_undegraded":"2024-09-10T15:28:18.230865+0000","last_fullsized":"2024-09-10T15:28:18.230865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:18.230663+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:18.230663+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.230663+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.040571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.257991+0000","last_change":"2024-09-10T15:28:10.258058+0000","last_active":"2024-09-10T15:28:10.257991+0000","last_peered":"2024-09-10T15:28:10.257991+0000","last_clean":"2024-09-10T15:28:10.257991+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:28:10.257991+0000","last_undegraded":"2024-09-10T15:28:10.257991+0000","last_fullsized":"2024-09-10T15:28:10.257991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T15:28:10.257770+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T15:28:10.257770+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.257770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:45.448759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"94'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.494825+0000","last_change":"2024-09-10T15:28:19.494885+0000","last_active":"2024-09-10T15:28:19.494825+0000","last_peered":"2024-09-10T15:28:19.494825+0000","last_clean":"2024-09-10T15:28:19.494825+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:28:19.494825+0000","last_undegraded":"2024-09-10T15:28:19.494825+0000","last_fullsized":"2024-09-10T15:28:19.494825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:19.494637+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:19.494637+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.494637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:21.062678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.332629+0000","last_change":"2024-09-10T15:28:05.332688+0000","last_active":"2024-09-10T15:28:05.332629+0000","last_peered":"2024-09-10T15:28:05.332629+0000","last_clean":"2024-09-10T15:28:05.332629+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:28:05.332629+0000","last_undegraded":"2024-09-10T15:28:05.332629+0000","last_fullsized":"2024-09-10T15:28:05.332629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'34","last_scrub_stamp":"2024-09-10T15:28:05.332434+0000","last_deep_scrub":"76'34","last_deep_scrub_stamp":"2024-09-10T15:28:05.332434+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.332434+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:14.756406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"94'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.397335+0000","last_change":"2024-09-10T15:28:22.397393+0000","last_active":"2024-09-10T15:28:22.397335+0000","last_peered":"2024-09-10T15:28:22.397335+0000","last_clean":"2024-09-10T15:28:22.397335+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:28:22.397335+0000","last_undegraded":"2024-09-10T15:28:22.397335+0000","last_fullsized":"2024-09-10T15:28:22.397335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:22.397138+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:22.397138+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.397138+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:26.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28684,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.741685+0000","last_change":"2024-09-10T15:28:23.741820+0000","last_active":"2024-09-10T15:28:23.741685+0000","last_peered":"2024-09-10T15:28:23.741685+0000","last_clean":"2024-09-10T15:28:23.741685+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:28:23.741685+0000","last_undegraded":"2024-09-10T15:28:23.741685+0000","last_fullsized":"2024-09-10T15:28:23.741685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.741458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.741458+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.741458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:25.309499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"94'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.315200+0000","last_change":"2024-09-10T15:28:20.315261+0000","last_active":"2024-09-10T15:28:20.315200+0000","last_peered":"2024-09-10T15:28:20.315200+0000","last_clean":"2024-09-10T15:28:20.315200+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:28:20.315200+0000","last_undegraded":"2024-09-10T15:28:20.315200+0000","last_fullsized":"2024-09-10T15:28:20.315200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:20.314984+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:20.314984+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.314984+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:32.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.329904+0000","last_change":"2024-09-10T15:28:07.329963+0000","last_active":"2024-09-10T15:28:07.329904+0000","last_peered":"2024-09-10T15:28:07.329904+0000","last_clean":"2024-09-10T15:28:07.329904+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:28:07.329904+0000","last_undegraded":"2024-09-10T15:28:07.329904+0000","last_fullsized":"2024-09-10T15:28:07.329904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.329679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.329679+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.329679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:14.406986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.377612+0000","last_change":"2024-09-10T15:28:26.377724+0000","last_active":"2024-09-10T15:28:26.377612+0000","last_peered":"2024-09-10T15:28:26.377612+0000","last_clean":"2024-09-10T15:28:26.377612+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:28:26.377612+0000","last_undegraded":"2024-09-10T15:28:26.377612+0000","last_fullsized":"2024-09-10T15:28:26.377612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:26.377309+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:26.377309+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.377309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:05.967429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.417169+0000","last_change":"2024-09-10T15:28:12.417229+0000","last_active":"2024-09-10T15:28:12.417169+0000","last_peered":"2024-09-10T15:28:12.417169+0000","last_clean":"2024-09-10T15:28:12.417169+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:28:12.417169+0000","last_undegraded":"2024-09-10T15:28:12.417169+0000","last_fullsized":"2024-09-10T15:28:12.417169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:12.416983+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:12.416983+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.416983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:13.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"94'12","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.252318+0000","last_change":"2024-09-10T15:28:19.252386+0000","last_active":"2024-09-10T15:28:19.252318+0000","last_peered":"2024-09-10T15:28:19.252318+0000","last_clean":"2024-09-10T15:28:19.252318+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:28:19.252318+0000","last_undegraded":"2024-09-10T15:28:19.252318+0000","last_fullsized":"2024-09-10T15:28:19.252318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:19.252120+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:19.252120+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.252120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:02.578122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.333085+0000","last_change":"2024-09-10T15:28:15.333145+0000","last_active":"2024-09-10T15:28:15.333085+0000","last_peered":"2024-09-10T15:28:15.333085+0000","last_clean":"2024-09-10T15:28:15.333085+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:28:15.333085+0000","last_undegraded":"2024-09-10T15:28:15.333085+0000","last_fullsized":"2024-09-10T15:28:15.333085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.332891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.332891+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.332891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:07.142799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'30","reported_seq":204,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.611710+0000","last_change":"2024-09-10T15:28:26.611782+0000","last_active":"2024-09-10T15:28:26.611710+0000","last_peered":"2024-09-10T15:28:26.611710+0000","last_clean":"2024-09-10T15:28:26.611710+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:28:26.611710+0000","last_undegraded":"2024-09-10T15:28:26.611710+0000","last_fullsized":"2024-09-10T15:28:26.611710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:26.611481+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:26.611481+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.611481+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:55.838575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":53254,"num_write":40,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.374584+0000","last_change":"2024-09-10T15:28:09.374751+0000","last_active":"2024-09-10T15:28:09.374584+0000","last_peered":"2024-09-10T15:28:09.374584+0000","last_clean":"2024-09-10T15:28:09.374584+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:28:09.374584+0000","last_undegraded":"2024-09-10T15:28:09.374584+0000","last_fullsized":"2024-09-10T15:28:09.374584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.374359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.374359+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.374359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"94'20","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.308768+0000","last_change":"2024-09-10T15:28:16.308828+0000","last_active":"2024-09-10T15:28:16.308768+0000","last_peered":"2024-09-10T15:28:16.308768+0000","last_clean":"2024-09-10T15:28:16.308768+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:28:16.308768+0000","last_undegraded":"2024-09-10T15:28:16.308768+0000","last_fullsized":"2024-09-10T15:28:16.308768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:16.308571+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:16.308571+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.308571+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:08.118479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":225,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.764778+0000","last_change":"2024-09-10T15:28:24.764843+0000","last_active":"2024-09-10T15:28:24.764778+0000","last_peered":"2024-09-10T15:28:24.764778+0000","last_clean":"2024-09-10T15:28:24.764778+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:28:24.764778+0000","last_undegraded":"2024-09-10T15:28:24.764778+0000","last_fullsized":"2024-09-10T15:28:24.764778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'68","last_scrub_stamp":"2024-09-10T15:28:24.764577+0000","last_deep_scrub":"76'68","last_deep_scrub_stamp":"2024-09-10T15:28:24.764577+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.764577+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:04.977559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"94'14","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:27:59.283747+0000","last_change":"2024-09-10T15:25:11.843945+0000","last_active":"2024-09-10T15:27:59.283747+0000","last_peered":"2024-09-10T15:27:59.283747+0000","last_clean":"2024-09-10T15:27:59.283747+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:27:59.283747+0000","last_undegraded":"2024-09-10T15:27:59.283747+0000","last_fullsized":"2024-09-10T15:27:59.283747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:25:10.791402+0000","last_clean_scrub_stamp":"2024-09-10T15:25:10.791402+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.653228+0000","last_change":"2024-09-10T15:28:10.653280+0000","last_active":"2024-09-10T15:28:10.653228+0000","last_peered":"2024-09-10T15:28:10.653228+0000","last_clean":"2024-09-10T15:28:10.653228+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:28:10.653228+0000","last_undegraded":"2024-09-10T15:28:10.653228+0000","last_fullsized":"2024-09-10T15:28:10.653228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.653043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.653043+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.653043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:55.490592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"94'18","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.741569+0000","last_change":"2024-09-10T15:28:19.741689+0000","last_active":"2024-09-10T15:28:19.741569+0000","last_peered":"2024-09-10T15:28:19.741569+0000","last_clean":"2024-09-10T15:28:19.741569+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:28:19.741569+0000","last_undegraded":"2024-09-10T15:28:19.741569+0000","last_fullsized":"2024-09-10T15:28:19.741569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:19.741288+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:19.741288+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.741288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:51.787854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.333833+0000","last_change":"2024-09-10T15:28:07.333882+0000","last_active":"2024-09-10T15:28:07.333833+0000","last_peered":"2024-09-10T15:28:07.333833+0000","last_clean":"2024-09-10T15:28:07.333833+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:28:07.333833+0000","last_undegraded":"2024-09-10T15:28:07.333833+0000","last_fullsized":"2024-09-10T15:28:07.333833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.333654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.333654+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.333654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:42.524643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"94'24","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.367992+0000","last_change":"2024-09-10T15:28:31.368051+0000","last_active":"2024-09-10T15:28:31.367992+0000","last_peered":"2024-09-10T15:28:31.367992+0000","last_clean":"2024-09-10T15:28:31.367992+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:28:31.367992+0000","last_undegraded":"2024-09-10T15:28:31.367992+0000","last_fullsized":"2024-09-10T15:28:31.367992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:31.367789+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:31.367789+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.367789+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:58.457495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"94'14","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.320905+0000","last_change":"2024-09-10T15:28:23.320968+0000","last_active":"2024-09-10T15:28:23.320905+0000","last_peered":"2024-09-10T15:28:23.320905+0000","last_clean":"2024-09-10T15:28:23.320905+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:28:23.320905+0000","last_undegraded":"2024-09-10T15:28:23.320905+0000","last_fullsized":"2024-09-10T15:28:23.320905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:23.320714+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:23.320714+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.320714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:45.493578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":28672,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.659962+0000","last_change":"2024-09-10T15:28:09.660026+0000","last_active":"2024-09-10T15:28:09.659962+0000","last_peered":"2024-09-10T15:28:09.659962+0000","last_clean":"2024-09-10T15:28:09.659962+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:28:09.659962+0000","last_undegraded":"2024-09-10T15:28:09.659962+0000","last_fullsized":"2024-09-10T15:28:09.659962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'46","last_scrub_stamp":"2024-09-10T15:28:09.659764+0000","last_deep_scrub":"76'46","last_deep_scrub_stamp":"2024-09-10T15:28:09.659764+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.659764+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:39.198632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"94'8","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.362495+0000","last_change":"2024-09-10T15:28:29.362552+0000","last_active":"2024-09-10T15:28:29.362495+0000","last_peered":"2024-09-10T15:28:29.362495+0000","last_clean":"2024-09-10T15:28:29.362495+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:28:29.362495+0000","last_undegraded":"2024-09-10T15:28:29.362495+0000","last_fullsized":"2024-09-10T15:28:29.362495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:29.362312+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:29.362312+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.362312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:48.338840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.300150+0000","last_change":"2024-09-10T15:28:17.300207+0000","last_active":"2024-09-10T15:28:17.300150+0000","last_peered":"2024-09-10T15:28:17.300150+0000","last_clean":"2024-09-10T15:28:17.300150+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:28:17.300150+0000","last_undegraded":"2024-09-10T15:28:17.300150+0000","last_fullsized":"2024-09-10T15:28:17.300150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.299957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.299957+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.299957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:18.867998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1215,"num_read_kb":1591,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":629940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":630988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1744896,"data_stored":1220454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574897,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1159168,"data_stored":631125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574898,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":629821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":629426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1773568,"data_stored":1221384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1179648,"data_stored":631034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:28:46.929 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-10T15:25:12.810172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.930 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.930 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.931 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.931 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.931 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.931 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-10T15:25:18.835136+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=18, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.931 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-10T15:25:20.849449+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=20, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.932 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-10T15:25:10.791402+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=25, tm_sec=10, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=15, tm_min=28, tm_sec=1, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T15:28:46.932 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T15:29:06.933 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T15:29:07.290 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-09-10T15:29:07.297 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-09-10T15:29:07.313 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":212,"stamp":"2024-09-10T15:29:07.018446+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":4613,"num_read_kb":2051672,"num_write":3896,"num_write_kb":2051115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2743,"ondisk_log_size":2743,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259664,"kb_used_data":10192,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715056,"statfs":{"total":773094113280,"available":772828217344,"internally_reserved":0,"allocated":10436608,"data_stored":6224172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":255315508},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007376"},"pg_stats":[{"pgid":"3.3f","version":"94'12","reported_seq":124,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.859236+0000","last_change":"2024-09-10T15:28:31.859361+0000","last_active":"2024-09-10T15:28:31.859236+0000","last_peered":"2024-09-10T15:28:31.859236+0000","last_clean":"2024-09-10T15:28:31.859236+0000","last_became_active":"2024-09-10T15:25:51.165102+0000","last_became_peered":"2024-09-10T15:25:51.165102+0000","last_unstale":"2024-09-10T15:28:31.859236+0000","last_undegraded":"2024-09-10T15:28:31.859236+0000","last_fullsized":"2024-09-10T15:28:31.859236+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:31.858968+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:31.858968+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.858968+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:46.612105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"76'42","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.191539+0000","last_change":"2024-09-10T15:28:24.191708+0000","last_active":"2024-09-10T15:28:24.191539+0000","last_peered":"2024-09-10T15:28:24.191539+0000","last_clean":"2024-09-10T15:28:24.191539+0000","last_became_active":"2024-09-10T15:25:13.843482+0000","last_became_peered":"2024-09-10T15:25:13.843482+0000","last_unstale":"2024-09-10T15:28:24.191539+0000","last_undegraded":"2024-09-10T15:28:24.191539+0000","last_fullsized":"2024-09-10T15:28:24.191539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'42","last_scrub_stamp":"2024-09-10T15:28:24.191286+0000","last_deep_scrub":"76'42","last_deep_scrub_stamp":"2024-09-10T15:28:24.191286+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.191286+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:32.870541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"94'14","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.434327+0000","last_change":"2024-09-10T15:28:20.434391+0000","last_active":"2024-09-10T15:28:20.434327+0000","last_peered":"2024-09-10T15:28:20.434327+0000","last_clean":"2024-09-10T15:28:20.434327+0000","last_became_active":"2024-09-10T15:25:11.857580+0000","last_became_peered":"2024-09-10T15:25:11.857580+0000","last_unstale":"2024-09-10T15:28:20.434327+0000","last_undegraded":"2024-09-10T15:28:20.434327+0000","last_fullsized":"2024-09-10T15:28:20.434327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:20.434136+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:20.434136+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.434136+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:21.152835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.334457+0000","last_change":"2024-09-10T15:28:28.334516+0000","last_active":"2024-09-10T15:28:28.334457+0000","last_peered":"2024-09-10T15:28:28.334457+0000","last_clean":"2024-09-10T15:28:28.334457+0000","last_became_active":"2024-09-10T15:25:13.843682+0000","last_became_peered":"2024-09-10T15:25:13.843682+0000","last_unstale":"2024-09-10T15:28:28.334457+0000","last_undegraded":"2024-09-10T15:28:28.334457+0000","last_fullsized":"2024-09-10T15:28:28.334457+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.334254+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.334254+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.334254+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:52:58.840006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"94'24","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.359674+0000","last_change":"2024-09-10T15:28:24.359734+0000","last_active":"2024-09-10T15:28:24.359674+0000","last_peered":"2024-09-10T15:28:24.359674+0000","last_clean":"2024-09-10T15:28:24.359674+0000","last_became_active":"2024-09-10T15:25:11.853022+0000","last_became_peered":"2024-09-10T15:25:11.853022+0000","last_unstale":"2024-09-10T15:28:24.359674+0000","last_undegraded":"2024-09-10T15:28:24.359674+0000","last_fullsized":"2024-09-10T15:28:24.359674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:24.359496+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:24.359496+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.359496+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:09:51.654856+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":45080,"num_write":64,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.273907+0000","last_change":"2024-09-10T15:28:22.273961+0000","last_active":"2024-09-10T15:28:22.273907+0000","last_peered":"2024-09-10T15:28:22.273907+0000","last_clean":"2024-09-10T15:28:22.273907+0000","last_became_active":"2024-09-10T15:25:13.835597+0000","last_became_peered":"2024-09-10T15:25:13.835597+0000","last_unstale":"2024-09-10T15:28:22.273907+0000","last_undegraded":"2024-09-10T15:28:22.273907+0000","last_fullsized":"2024-09-10T15:28:22.273907+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:22.273680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:22.273680+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.273680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:09.159963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"94'4","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.502181+0000","last_change":"2024-09-10T15:28:17.502242+0000","last_active":"2024-09-10T15:28:17.502181+0000","last_peered":"2024-09-10T15:28:17.502181+0000","last_clean":"2024-09-10T15:28:17.502181+0000","last_became_active":"2024-09-10T15:25:11.821788+0000","last_became_peered":"2024-09-10T15:25:11.821788+0000","last_unstale":"2024-09-10T15:28:17.502181+0000","last_undegraded":"2024-09-10T15:28:17.502181+0000","last_fullsized":"2024-09-10T15:28:17.502181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T15:28:17.501983+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T15:28:17.501983+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.501983+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:09.311891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.561094+0000","last_change":"2024-09-10T15:28:18.561151+0000","last_active":"2024-09-10T15:28:18.561094+0000","last_peered":"2024-09-10T15:28:18.561094+0000","last_clean":"2024-09-10T15:28:18.561094+0000","last_became_active":"2024-09-10T15:25:13.842245+0000","last_became_peered":"2024-09-10T15:25:13.842245+0000","last_unstale":"2024-09-10T15:28:18.561094+0000","last_undegraded":"2024-09-10T15:28:18.561094+0000","last_fullsized":"2024-09-10T15:28:18.561094+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:18.560887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:18.560887+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.560887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:54:43.920879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"94'24","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.354603+0000","last_change":"2024-09-10T15:28:20.354666+0000","last_active":"2024-09-10T15:28:20.354603+0000","last_peered":"2024-09-10T15:28:20.354603+0000","last_clean":"2024-09-10T15:28:20.354603+0000","last_became_active":"2024-09-10T15:25:11.848253+0000","last_became_peered":"2024-09-10T15:25:11.848253+0000","last_unstale":"2024-09-10T15:28:20.354603+0000","last_undegraded":"2024-09-10T15:28:20.354603+0000","last_fullsized":"2024-09-10T15:28:20.354603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:20.354411+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:20.354411+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.354411+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:13.494879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":45074,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.350584+0000","last_change":"2024-09-10T15:28:09.350640+0000","last_active":"2024-09-10T15:28:09.350584+0000","last_peered":"2024-09-10T15:28:09.350584+0000","last_clean":"2024-09-10T15:28:09.350584+0000","last_became_active":"2024-09-10T15:25:13.847361+0000","last_became_peered":"2024-09-10T15:25:13.847361+0000","last_unstale":"2024-09-10T15:28:09.350584+0000","last_undegraded":"2024-09-10T15:28:09.350584+0000","last_fullsized":"2024-09-10T15:28:09.350584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.350386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.350386+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.350386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:12.114598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.541413+0000","last_change":"2024-09-10T15:28:16.541475+0000","last_active":"2024-09-10T15:28:16.541413+0000","last_peered":"2024-09-10T15:28:16.541413+0000","last_clean":"2024-09-10T15:28:16.541413+0000","last_became_active":"2024-09-10T15:25:11.821670+0000","last_became_peered":"2024-09-10T15:25:11.821670+0000","last_unstale":"2024-09-10T15:28:16.541413+0000","last_undegraded":"2024-09-10T15:28:16.541413+0000","last_fullsized":"2024-09-10T15:28:16.541413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:16.541230+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:16.541230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.541230+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:50.279022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.384778+0000","last_change":"2024-09-10T15:28:04.384862+0000","last_active":"2024-09-10T15:28:04.384778+0000","last_peered":"2024-09-10T15:28:04.384778+0000","last_clean":"2024-09-10T15:28:04.384778+0000","last_became_active":"2024-09-10T15:25:13.873856+0000","last_became_peered":"2024-09-10T15:25:13.873856+0000","last_unstale":"2024-09-10T15:28:04.384778+0000","last_undegraded":"2024-09-10T15:28:04.384778+0000","last_fullsized":"2024-09-10T15:28:04.384778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.384654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.384654+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.384654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:30:16.482396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"94'12","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.351301+0000","last_change":"2024-09-10T15:28:15.351367+0000","last_active":"2024-09-10T15:28:15.351301+0000","last_peered":"2024-09-10T15:28:15.351301+0000","last_clean":"2024-09-10T15:28:15.351301+0000","last_became_active":"2024-09-10T15:25:11.834366+0000","last_became_peered":"2024-09-10T15:25:11.834366+0000","last_unstale":"2024-09-10T15:28:15.351301+0000","last_undegraded":"2024-09-10T15:28:15.351301+0000","last_fullsized":"2024-09-10T15:28:15.351301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:15.351108+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:15.351108+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.351108+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:44.889976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24588,"num_write":32,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.494819+0000","last_change":"2024-09-10T15:28:09.494877+0000","last_active":"2024-09-10T15:28:09.494819+0000","last_peered":"2024-09-10T15:28:09.494819+0000","last_clean":"2024-09-10T15:28:09.494819+0000","last_became_active":"2024-09-10T15:25:13.842360+0000","last_became_peered":"2024-09-10T15:25:13.842360+0000","last_unstale":"2024-09-10T15:28:09.494819+0000","last_undegraded":"2024-09-10T15:28:09.494819+0000","last_fullsized":"2024-09-10T15:28:09.494819+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:09.494606+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:09.494606+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.494606+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:16.571912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:34.259301+0000","last_change":"2024-09-10T15:28:34.259364+0000","last_active":"2024-09-10T15:28:34.259301+0000","last_peered":"2024-09-10T15:28:34.259301+0000","last_clean":"2024-09-10T15:28:34.259301+0000","last_became_active":"2024-09-10T15:25:11.847541+0000","last_became_peered":"2024-09-10T15:25:11.847541+0000","last_unstale":"2024-09-10T15:28:34.259301+0000","last_undegraded":"2024-09-10T15:28:34.259301+0000","last_fullsized":"2024-09-10T15:28:34.259301+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:34.259104+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:34.259104+0000","last_clean_scrub_stamp":"2024-09-10T15:28:34.259104+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:33.759855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32786,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.398276+0000","last_change":"2024-09-10T15:28:21.398329+0000","last_active":"2024-09-10T15:28:21.398276+0000","last_peered":"2024-09-10T15:28:21.398276+0000","last_clean":"2024-09-10T15:28:21.398276+0000","last_became_active":"2024-09-10T15:25:13.877241+0000","last_became_peered":"2024-09-10T15:25:13.877241+0000","last_unstale":"2024-09-10T15:28:21.398276+0000","last_undegraded":"2024-09-10T15:28:21.398276+0000","last_fullsized":"2024-09-10T15:28:21.398276+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:21.398068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:21.398068+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.398068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:34.317030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"76'42","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.303221+0000","last_change":"2024-09-10T15:28:26.303269+0000","last_active":"2024-09-10T15:28:26.303221+0000","last_peered":"2024-09-10T15:28:26.303221+0000","last_clean":"2024-09-10T15:28:26.303221+0000","last_became_active":"2024-09-10T15:25:13.842119+0000","last_became_peered":"2024-09-10T15:25:13.842119+0000","last_unstale":"2024-09-10T15:28:26.303221+0000","last_undegraded":"2024-09-10T15:28:26.303221+0000","last_fullsized":"2024-09-10T15:28:26.303221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'42","last_scrub_stamp":"2024-09-10T15:28:26.303089+0000","last_deep_scrub":"76'42","last_deep_scrub_stamp":"2024-09-10T15:28:26.303089+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.303089+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:49.341085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":145,"num_read_kb":107,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.255624+0000","last_change":"2024-09-10T15:28:21.255693+0000","last_active":"2024-09-10T15:28:21.255624+0000","last_peered":"2024-09-10T15:28:21.255624+0000","last_clean":"2024-09-10T15:28:21.255624+0000","last_became_active":"2024-09-10T15:25:11.836616+0000","last_became_peered":"2024-09-10T15:25:11.836616+0000","last_unstale":"2024-09-10T15:28:21.255624+0000","last_undegraded":"2024-09-10T15:28:21.255624+0000","last_fullsized":"2024-09-10T15:28:21.255624+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:21.255422+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:21.255422+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.255422+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:49.586859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:03.431539+0000","last_change":"2024-09-10T15:28:03.431569+0000","last_active":"2024-09-10T15:28:03.431539+0000","last_peered":"2024-09-10T15:28:03.431539+0000","last_clean":"2024-09-10T15:28:03.431539+0000","last_became_active":"2024-09-10T15:25:13.858650+0000","last_became_peered":"2024-09-10T15:25:13.858650+0000","last_unstale":"2024-09-10T15:28:03.431539+0000","last_undegraded":"2024-09-10T15:28:03.431539+0000","last_fullsized":"2024-09-10T15:28:03.431539+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:03.431437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:03.431437+0000","last_clean_scrub_stamp":"2024-09-10T15:28:03.431437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:31:18.730138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"94'16","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.359533+0000","last_change":"2024-09-10T15:28:21.359594+0000","last_active":"2024-09-10T15:28:21.359533+0000","last_peered":"2024-09-10T15:28:21.359533+0000","last_clean":"2024-09-10T15:28:21.359533+0000","last_became_active":"2024-09-10T15:25:11.849290+0000","last_became_peered":"2024-09-10T15:25:11.849290+0000","last_unstale":"2024-09-10T15:28:21.359533+0000","last_undegraded":"2024-09-10T15:28:21.359533+0000","last_fullsized":"2024-09-10T15:28:21.359533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:21.359342+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:21.359342+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.359342+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:49.690779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32786,"num_write":46,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.390476+0000","last_change":"2024-09-10T15:28:11.390530+0000","last_active":"2024-09-10T15:28:11.390476+0000","last_peered":"2024-09-10T15:28:11.390476+0000","last_clean":"2024-09-10T15:28:11.390476+0000","last_became_active":"2024-09-10T15:25:13.869915+0000","last_became_peered":"2024-09-10T15:25:13.869915+0000","last_unstale":"2024-09-10T15:28:11.390476+0000","last_undegraded":"2024-09-10T15:28:11.390476+0000","last_fullsized":"2024-09-10T15:28:11.390476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.390292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.390292+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.390292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:23.435043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"94'20","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.345867+0000","last_change":"2024-09-10T15:28:19.346020+0000","last_active":"2024-09-10T15:28:19.345867+0000","last_peered":"2024-09-10T15:28:19.345867+0000","last_clean":"2024-09-10T15:28:19.345867+0000","last_became_active":"2024-09-10T15:25:11.842432+0000","last_became_peered":"2024-09-10T15:25:11.842432+0000","last_unstale":"2024-09-10T15:28:19.345867+0000","last_undegraded":"2024-09-10T15:28:19.345867+0000","last_fullsized":"2024-09-10T15:28:19.345867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:19.345604+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:19.345604+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.345604+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:58.767942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":34816,"num_write":20,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"76'38","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.255213+0000","last_change":"2024-09-10T15:28:08.255274+0000","last_active":"2024-09-10T15:28:08.255213+0000","last_peered":"2024-09-10T15:28:08.255213+0000","last_clean":"2024-09-10T15:28:08.255213+0000","last_became_active":"2024-09-10T15:25:13.866235+0000","last_became_peered":"2024-09-10T15:25:13.866235+0000","last_unstale":"2024-09-10T15:28:08.255213+0000","last_undegraded":"2024-09-10T15:28:08.255213+0000","last_fullsized":"2024-09-10T15:28:08.255213+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'38","last_scrub_stamp":"2024-09-10T15:28:08.255025+0000","last_deep_scrub":"76'38","last_deep_scrub_stamp":"2024-09-10T15:28:08.255025+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.255025+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:17.678997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"94'22","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.311639+0000","last_change":"2024-09-10T15:28:17.311699+0000","last_active":"2024-09-10T15:28:17.311639+0000","last_peered":"2024-09-10T15:28:17.311639+0000","last_clean":"2024-09-10T15:28:17.311639+0000","last_became_active":"2024-09-10T15:25:11.837693+0000","last_became_peered":"2024-09-10T15:25:11.837693+0000","last_unstale":"2024-09-10T15:28:17.311639+0000","last_undegraded":"2024-09-10T15:28:17.311639+0000","last_fullsized":"2024-09-10T15:28:17.311639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:17.311443+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:17.311443+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.311443+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:21.219093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40972,"num_write":42,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.358366+0000","last_change":"2024-09-10T15:28:15.358417+0000","last_active":"2024-09-10T15:28:15.358366+0000","last_peered":"2024-09-10T15:28:15.358366+0000","last_clean":"2024-09-10T15:28:15.358366+0000","last_became_active":"2024-09-10T15:25:13.866903+0000","last_became_peered":"2024-09-10T15:25:13.866903+0000","last_unstale":"2024-09-10T15:28:15.358366+0000","last_undegraded":"2024-09-10T15:28:15.358366+0000","last_fullsized":"2024-09-10T15:28:15.358366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.358133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.358133+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.358133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:43.689569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.295185+0000","last_change":"2024-09-10T15:28:20.295252+0000","last_active":"2024-09-10T15:28:20.295185+0000","last_peered":"2024-09-10T15:28:20.295185+0000","last_clean":"2024-09-10T15:28:20.295185+0000","last_became_active":"2024-09-10T15:25:11.843604+0000","last_became_peered":"2024-09-10T15:25:11.843604+0000","last_unstale":"2024-09-10T15:28:20.295185+0000","last_undegraded":"2024-09-10T15:28:20.295185+0000","last_fullsized":"2024-09-10T15:28:20.295185+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:20.294987+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:20.294987+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.294987+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:21.863028+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.235587+0000","last_change":"2024-09-10T15:28:25.235648+0000","last_active":"2024-09-10T15:28:25.235587+0000","last_peered":"2024-09-10T15:28:25.235587+0000","last_clean":"2024-09-10T15:28:25.235587+0000","last_became_active":"2024-09-10T15:25:13.843732+0000","last_became_peered":"2024-09-10T15:25:13.843732+0000","last_unstale":"2024-09-10T15:28:25.235587+0000","last_undegraded":"2024-09-10T15:28:25.235587+0000","last_fullsized":"2024-09-10T15:28:25.235587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.235382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.235382+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.235382+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:39.988519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"94'22","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.319405+0000","last_change":"2024-09-10T15:28:29.319469+0000","last_active":"2024-09-10T15:28:29.319405+0000","last_peered":"2024-09-10T15:28:29.319405+0000","last_clean":"2024-09-10T15:28:29.319405+0000","last_became_active":"2024-09-10T15:25:44.110079+0000","last_became_peered":"2024-09-10T15:25:44.110079+0000","last_unstale":"2024-09-10T15:28:29.319405+0000","last_undegraded":"2024-09-10T15:28:29.319405+0000","last_fullsized":"2024-09-10T15:28:29.319405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:29.319203+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:29.319203+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.319203+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:24.788712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"67'4","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.287784+0000","last_change":"2024-09-10T15:28:28.287938+0000","last_active":"2024-09-10T15:28:28.287784+0000","last_peered":"2024-09-10T15:28:28.287784+0000","last_clean":"2024-09-10T15:28:28.287784+0000","last_became_active":"2024-09-10T15:25:21.899373+0000","last_became_peered":"2024-09-10T15:25:21.899373+0000","last_unstale":"2024-09-10T15:28:28.287784+0000","last_undegraded":"2024-09-10T15:28:28.287784+0000","last_fullsized":"2024-09-10T15:28:28.287784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'4","last_scrub_stamp":"2024-09-10T15:28:28.287548+0000","last_deep_scrub":"67'4","last_deep_scrub_stamp":"2024-09-10T15:28:28.287548+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.287548+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:16:10.745358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.219088+0000","last_change":"2024-09-10T15:28:12.219204+0000","last_active":"2024-09-10T15:28:12.219088+0000","last_peered":"2024-09-10T15:28:12.219088+0000","last_clean":"2024-09-10T15:28:12.219088+0000","last_became_active":"2024-09-10T15:25:13.859309+0000","last_became_peered":"2024-09-10T15:25:13.859309+0000","last_unstale":"2024-09-10T15:28:12.219088+0000","last_undegraded":"2024-09-10T15:28:12.219088+0000","last_fullsized":"2024-09-10T15:28:12.219088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.218854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.218854+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.218854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:04.113397+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"94'22","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.428511+0000","last_change":"2024-09-10T15:28:33.428580+0000","last_active":"2024-09-10T15:28:33.428511+0000","last_peered":"2024-09-10T15:28:33.428511+0000","last_clean":"2024-09-10T15:28:33.428511+0000","last_became_active":"2024-09-10T15:25:11.843529+0000","last_became_peered":"2024-09-10T15:25:11.843529+0000","last_unstale":"2024-09-10T15:28:33.428511+0000","last_undegraded":"2024-09-10T15:28:33.428511+0000","last_fullsized":"2024-09-10T15:28:33.428511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:33.428276+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:33.428276+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.428276+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:56:04.167364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.212186+0000","last_change":"2024-09-10T15:28:11.212245+0000","last_active":"2024-09-10T15:28:11.212186+0000","last_peered":"2024-09-10T15:28:11.212186+0000","last_clean":"2024-09-10T15:28:11.212186+0000","last_became_active":"2024-09-10T15:25:15.869123+0000","last_became_peered":"2024-09-10T15:25:15.869123+0000","last_unstale":"2024-09-10T15:28:11.212186+0000","last_undegraded":"2024-09-10T15:28:11.212186+0000","last_fullsized":"2024-09-10T15:28:11.212186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.211987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.211987+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.211987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:58:50.802107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"94'26","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.746574+0000","last_change":"2024-09-10T15:28:07.746675+0000","last_active":"2024-09-10T15:28:07.746574+0000","last_peered":"2024-09-10T15:28:07.746574+0000","last_clean":"2024-09-10T15:28:07.746574+0000","last_became_active":"2024-09-10T15:25:17.870781+0000","last_became_peered":"2024-09-10T15:25:17.870781+0000","last_unstale":"2024-09-10T15:28:07.746574+0000","last_undegraded":"2024-09-10T15:28:07.746574+0000","last_fullsized":"2024-09-10T15:28:07.746574+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:07.746369+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:07.746369+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.746369+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:53.711912+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":42,"num_read_kb":71,"num_write":30,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.216719+0000","last_change":"2024-09-10T15:28:29.216770+0000","last_active":"2024-09-10T15:28:29.216719+0000","last_peered":"2024-09-10T15:28:29.216719+0000","last_clean":"2024-09-10T15:28:29.216719+0000","last_became_active":"2024-09-10T15:25:19.891215+0000","last_became_peered":"2024-09-10T15:25:19.891215+0000","last_unstale":"2024-09-10T15:28:29.216719+0000","last_undegraded":"2024-09-10T15:28:29.216719+0000","last_fullsized":"2024-09-10T15:28:29.216719+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.216532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.216532+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.216532+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:24.686040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"76'2","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.203564+0000","last_change":"2024-09-10T15:28:32.203702+0000","last_active":"2024-09-10T15:28:32.203564+0000","last_peered":"2024-09-10T15:28:32.203564+0000","last_clean":"2024-09-10T15:28:32.203564+0000","last_became_active":"2024-09-10T15:25:21.903765+0000","last_became_peered":"2024-09-10T15:25:21.903765+0000","last_unstale":"2024-09-10T15:28:32.203564+0000","last_undegraded":"2024-09-10T15:28:32.203564+0000","last_fullsized":"2024-09-10T15:28:32.203564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:32.203297+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:32.203297+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.203297+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:40.489016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.285402+0000","last_change":"2024-09-10T15:28:24.285458+0000","last_active":"2024-09-10T15:28:24.285402+0000","last_peered":"2024-09-10T15:28:24.285402+0000","last_clean":"2024-09-10T15:28:24.285402+0000","last_became_active":"2024-09-10T15:25:13.838402+0000","last_became_peered":"2024-09-10T15:25:13.838402+0000","last_unstale":"2024-09-10T15:28:24.285402+0000","last_undegraded":"2024-09-10T15:28:24.285402+0000","last_fullsized":"2024-09-10T15:28:24.285402+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:24.285214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:24.285214+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.285214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:17:57.820484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"94'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.245428+0000","last_change":"2024-09-10T15:28:17.245601+0000","last_active":"2024-09-10T15:28:17.245428+0000","last_peered":"2024-09-10T15:28:17.245428+0000","last_clean":"2024-09-10T15:28:17.245428+0000","last_became_active":"2024-09-10T15:25:11.834025+0000","last_became_peered":"2024-09-10T15:25:11.834025+0000","last_unstale":"2024-09-10T15:28:17.245428+0000","last_undegraded":"2024-09-10T15:28:17.245428+0000","last_fullsized":"2024-09-10T15:28:17.245428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:17.245196+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:17.245196+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.245196+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:50.982987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.655880+0000","last_change":"2024-09-10T15:28:13.656024+0000","last_active":"2024-09-10T15:28:13.655880+0000","last_peered":"2024-09-10T15:28:13.655880+0000","last_clean":"2024-09-10T15:28:13.655880+0000","last_became_active":"2024-09-10T15:25:15.850414+0000","last_became_peered":"2024-09-10T15:25:15.850414+0000","last_unstale":"2024-09-10T15:28:13.655880+0000","last_undegraded":"2024-09-10T15:28:13.655880+0000","last_fullsized":"2024-09-10T15:28:13.655880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.655658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.655658+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.655658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:07:56.981659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"94'9","reported_seq":159,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.407907+0000","last_change":"2024-09-10T15:28:10.407979+0000","last_active":"2024-09-10T15:28:10.407907+0000","last_peered":"2024-09-10T15:28:10.407907+0000","last_clean":"2024-09-10T15:28:10.407907+0000","last_became_active":"2024-09-10T15:25:17.866275+0000","last_became_peered":"2024-09-10T15:25:17.866275+0000","last_unstale":"2024-09-10T15:28:10.407907+0000","last_undegraded":"2024-09-10T15:28:10.407907+0000","last_fullsized":"2024-09-10T15:28:10.407907+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'9","last_scrub_stamp":"2024-09-10T15:28:10.407730+0000","last_deep_scrub":"94'9","last_deep_scrub_stamp":"2024-09-10T15:28:10.407730+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.407730+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:50.509573+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.197587+0000","last_change":"2024-09-10T15:28:26.197612+0000","last_active":"2024-09-10T15:28:26.197587+0000","last_peered":"2024-09-10T15:28:26.197587+0000","last_clean":"2024-09-10T15:28:26.197587+0000","last_became_active":"2024-09-10T15:25:19.881005+0000","last_became_peered":"2024-09-10T15:25:19.881005+0000","last_unstale":"2024-09-10T15:28:26.197587+0000","last_undegraded":"2024-09-10T15:28:26.197587+0000","last_fullsized":"2024-09-10T15:28:26.197587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.197508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.197508+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.197508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:26.916206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.372863+0000","last_change":"2024-09-10T15:28:31.372997+0000","last_active":"2024-09-10T15:28:31.372863+0000","last_peered":"2024-09-10T15:28:31.372863+0000","last_clean":"2024-09-10T15:28:31.372863+0000","last_became_active":"2024-09-10T15:25:21.884276+0000","last_became_peered":"2024-09-10T15:25:21.884276+0000","last_unstale":"2024-09-10T15:28:31.372863+0000","last_undegraded":"2024-09-10T15:28:31.372863+0000","last_fullsized":"2024-09-10T15:28:31.372863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:31.372642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:31.372642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.372642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:35.032242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.398030+0000","last_change":"2024-09-10T15:28:14.398082+0000","last_active":"2024-09-10T15:28:14.398030+0000","last_peered":"2024-09-10T15:28:14.398030+0000","last_clean":"2024-09-10T15:28:14.398030+0000","last_became_active":"2024-09-10T15:25:13.861362+0000","last_became_peered":"2024-09-10T15:25:13.861362+0000","last_unstale":"2024-09-10T15:28:14.398030+0000","last_undegraded":"2024-09-10T15:28:14.398030+0000","last_fullsized":"2024-09-10T15:28:14.398030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.397844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.397844+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.397844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:07.538311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"94'24","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.313831+0000","last_change":"2024-09-10T15:28:27.313895+0000","last_active":"2024-09-10T15:28:27.313831+0000","last_peered":"2024-09-10T15:28:27.313831+0000","last_clean":"2024-09-10T15:28:27.313831+0000","last_became_active":"2024-09-10T15:25:11.846283+0000","last_became_peered":"2024-09-10T15:25:11.846283+0000","last_unstale":"2024-09-10T15:28:27.313831+0000","last_undegraded":"2024-09-10T15:28:27.313831+0000","last_fullsized":"2024-09-10T15:28:27.313831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:27.313614+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:27.313614+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.313614+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:34.496284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.587451+0000","last_change":"2024-09-10T15:28:23.587513+0000","last_active":"2024-09-10T15:28:23.587451+0000","last_peered":"2024-09-10T15:28:23.587451+0000","last_clean":"2024-09-10T15:28:23.587451+0000","last_became_active":"2024-09-10T15:25:15.858902+0000","last_became_peered":"2024-09-10T15:25:15.858902+0000","last_unstale":"2024-09-10T15:28:23.587451+0000","last_undegraded":"2024-09-10T15:28:23.587451+0000","last_fullsized":"2024-09-10T15:28:23.587451+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.587228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.587228+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.587228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:55.582193+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"94'15","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.558080+0000","last_change":"2024-09-10T15:28:33.558154+0000","last_active":"2024-09-10T15:28:33.558080+0000","last_peered":"2024-09-10T15:28:33.558080+0000","last_clean":"2024-09-10T15:28:33.558080+0000","last_became_active":"2024-09-10T15:25:17.859801+0000","last_became_peered":"2024-09-10T15:25:17.859801+0000","last_unstale":"2024-09-10T15:28:33.558080+0000","last_undegraded":"2024-09-10T15:28:33.558080+0000","last_fullsized":"2024-09-10T15:28:33.558080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:33.557893+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:33.557893+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.557893+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:45.977587+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"94'18","reported_seq":197,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.347986+0000","last_change":"2024-09-10T15:28:18.348048+0000","last_active":"2024-09-10T15:28:18.347986+0000","last_peered":"2024-09-10T15:28:18.347986+0000","last_clean":"2024-09-10T15:28:18.347986+0000","last_became_active":"2024-09-10T15:25:19.885477+0000","last_became_peered":"2024-09-10T15:25:19.885477+0000","last_unstale":"2024-09-10T15:28:18.347986+0000","last_undegraded":"2024-09-10T15:28:18.347986+0000","last_fullsized":"2024-09-10T15:28:18.347986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:18.347799+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:18.347799+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.347799+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:28.999258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.464714+0000","last_change":"2024-09-10T15:28:31.464771+0000","last_active":"2024-09-10T15:28:31.464714+0000","last_peered":"2024-09-10T15:28:31.464714+0000","last_clean":"2024-09-10T15:28:31.464714+0000","last_became_active":"2024-09-10T15:25:21.898686+0000","last_became_peered":"2024-09-10T15:25:21.898686+0000","last_unstale":"2024-09-10T15:28:31.464714+0000","last_undegraded":"2024-09-10T15:28:31.464714+0000","last_fullsized":"2024-09-10T15:28:31.464714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:31.464528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:31.464528+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.464528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:01.916313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"76'38","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.369224+0000","last_change":"2024-09-10T15:28:13.369289+0000","last_active":"2024-09-10T15:28:13.369224+0000","last_peered":"2024-09-10T15:28:13.369224+0000","last_clean":"2024-09-10T15:28:13.369224+0000","last_became_active":"2024-09-10T15:25:13.865652+0000","last_became_peered":"2024-09-10T15:25:13.865652+0000","last_unstale":"2024-09-10T15:28:13.369224+0000","last_undegraded":"2024-09-10T15:28:13.369224+0000","last_fullsized":"2024-09-10T15:28:13.369224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'38","last_scrub_stamp":"2024-09-10T15:28:13.368985+0000","last_deep_scrub":"76'38","last_deep_scrub_stamp":"2024-09-10T15:28:13.368985+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.368985+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:57:52.791323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":97,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"94'12","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.238418+0000","last_change":"2024-09-10T15:28:23.238481+0000","last_active":"2024-09-10T15:28:23.238418+0000","last_peered":"2024-09-10T15:28:23.238418+0000","last_clean":"2024-09-10T15:28:23.238418+0000","last_became_active":"2024-09-10T15:25:11.851168+0000","last_became_peered":"2024-09-10T15:25:11.851168+0000","last_unstale":"2024-09-10T15:28:23.238418+0000","last_undegraded":"2024-09-10T15:28:23.238418+0000","last_fullsized":"2024-09-10T15:28:23.238418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:23.238214+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:23.238214+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.238214+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:08.496362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20492,"num_write":32,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.245145+0000","last_change":"2024-09-10T15:28:13.245270+0000","last_active":"2024-09-10T15:28:13.245145+0000","last_peered":"2024-09-10T15:28:13.245145+0000","last_clean":"2024-09-10T15:28:13.245145+0000","last_became_active":"2024-09-10T15:25:15.864387+0000","last_became_peered":"2024-09-10T15:25:15.864387+0000","last_unstale":"2024-09-10T15:28:13.245145+0000","last_undegraded":"2024-09-10T15:28:13.245145+0000","last_fullsized":"2024-09-10T15:28:13.245145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.244886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.244886+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.244886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:14.671072+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"94'25","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.532378+0000","last_change":"2024-09-10T15:28:14.532458+0000","last_active":"2024-09-10T15:28:14.532378+0000","last_peered":"2024-09-10T15:28:14.532378+0000","last_clean":"2024-09-10T15:28:14.532378+0000","last_became_active":"2024-09-10T15:25:17.864511+0000","last_became_peered":"2024-09-10T15:25:17.864511+0000","last_unstale":"2024-09-10T15:28:14.532378+0000","last_undegraded":"2024-09-10T15:28:14.532378+0000","last_fullsized":"2024-09-10T15:28:14.532378+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'25","last_scrub_stamp":"2024-09-10T15:28:14.532155+0000","last_deep_scrub":"94'25","last_deep_scrub_stamp":"2024-09-10T15:28:14.532155+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.532155+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:26.576906+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":74,"num_write":28,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"94'18","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.398739+0000","last_change":"2024-09-10T15:28:06.398818+0000","last_active":"2024-09-10T15:28:06.398739+0000","last_peered":"2024-09-10T15:28:06.398739+0000","last_clean":"2024-09-10T15:28:06.398739+0000","last_became_active":"2024-09-10T15:25:19.886456+0000","last_became_peered":"2024-09-10T15:25:19.886456+0000","last_unstale":"2024-09-10T15:28:06.398739+0000","last_undegraded":"2024-09-10T15:28:06.398739+0000","last_fullsized":"2024-09-10T15:28:06.398739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:06.398506+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:06.398506+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.398506+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:36.743473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"67'12","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.325421+0000","last_change":"2024-09-10T15:28:30.325484+0000","last_active":"2024-09-10T15:28:30.325421+0000","last_peered":"2024-09-10T15:28:30.325421+0000","last_clean":"2024-09-10T15:28:30.325421+0000","last_became_active":"2024-09-10T15:25:13.845280+0000","last_became_peered":"2024-09-10T15:25:13.845280+0000","last_unstale":"2024-09-10T15:28:30.325421+0000","last_undegraded":"2024-09-10T15:28:30.325421+0000","last_fullsized":"2024-09-10T15:28:30.325421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'12","last_scrub_stamp":"2024-09-10T15:28:30.325216+0000","last_deep_scrub":"67'12","last_deep_scrub_stamp":"2024-09-10T15:28:30.325216+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.325216+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:22:39.042707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":30,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"94'10","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.298012+0000","last_change":"2024-09-10T15:28:18.298189+0000","last_active":"2024-09-10T15:28:18.298012+0000","last_peered":"2024-09-10T15:28:18.298012+0000","last_clean":"2024-09-10T15:28:18.298012+0000","last_became_active":"2024-09-10T15:25:11.841334+0000","last_became_peered":"2024-09-10T15:25:11.841334+0000","last_unstale":"2024-09-10T15:28:18.298012+0000","last_undegraded":"2024-09-10T15:28:18.298012+0000","last_fullsized":"2024-09-10T15:28:18.298012+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:18.297682+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:18.297682+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.297682+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:36:56.718101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16396,"num_write":30,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.282384+0000","last_change":"2024-09-10T15:28:04.282432+0000","last_active":"2024-09-10T15:28:04.282384+0000","last_peered":"2024-09-10T15:28:04.282384+0000","last_clean":"2024-09-10T15:28:04.282384+0000","last_became_active":"2024-09-10T15:25:15.851106+0000","last_became_peered":"2024-09-10T15:25:15.851106+0000","last_unstale":"2024-09-10T15:28:04.282384+0000","last_undegraded":"2024-09-10T15:28:04.282384+0000","last_fullsized":"2024-09-10T15:28:04.282384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.282198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.282198+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.282198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:42.136495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"94'35","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.300379+0000","last_change":"2024-09-10T15:28:23.300463+0000","last_active":"2024-09-10T15:28:23.300379+0000","last_peered":"2024-09-10T15:28:23.300379+0000","last_clean":"2024-09-10T15:28:23.300379+0000","last_became_active":"2024-09-10T15:25:17.867155+0000","last_became_peered":"2024-09-10T15:25:17.867155+0000","last_unstale":"2024-09-10T15:28:23.300379+0000","last_undegraded":"2024-09-10T15:28:23.300379+0000","last_fullsized":"2024-09-10T15:28:23.300379+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'35","last_scrub_stamp":"2024-09-10T15:28:23.300145+0000","last_deep_scrub":"94'35","last_deep_scrub_stamp":"2024-09-10T15:28:23.300145+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.300145+0000","objects_scrubbed":9,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:08.558293+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":28,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.349837+0000","last_change":"2024-09-10T15:28:28.349985+0000","last_active":"2024-09-10T15:28:28.349837+0000","last_peered":"2024-09-10T15:28:28.349837+0000","last_clean":"2024-09-10T15:28:28.349837+0000","last_became_active":"2024-09-10T15:25:19.885843+0000","last_became_peered":"2024-09-10T15:25:19.885843+0000","last_unstale":"2024-09-10T15:28:28.349837+0000","last_undegraded":"2024-09-10T15:28:28.349837+0000","last_fullsized":"2024-09-10T15:28:28.349837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.349583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.349583+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.349583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:49.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.436758+0000","last_change":"2024-09-10T15:28:30.436817+0000","last_active":"2024-09-10T15:28:30.436758+0000","last_peered":"2024-09-10T15:28:30.436758+0000","last_clean":"2024-09-10T15:28:30.436758+0000","last_became_active":"2024-09-10T15:25:21.895959+0000","last_became_peered":"2024-09-10T15:25:21.895959+0000","last_unstale":"2024-09-10T15:28:30.436758+0000","last_undegraded":"2024-09-10T15:28:30.436758+0000","last_fullsized":"2024-09-10T15:28:30.436758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.436527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.436527+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.436527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:34.096126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.377815+0000","last_change":"2024-09-10T15:28:13.377877+0000","last_active":"2024-09-10T15:28:13.377815+0000","last_peered":"2024-09-10T15:28:13.377815+0000","last_clean":"2024-09-10T15:28:13.377815+0000","last_became_active":"2024-09-10T15:25:13.866615+0000","last_became_peered":"2024-09-10T15:25:13.866615+0000","last_unstale":"2024-09-10T15:28:13.377815+0000","last_undegraded":"2024-09-10T15:28:13.377815+0000","last_fullsized":"2024-09-10T15:28:13.377815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.377606+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.377606+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.377606+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:45.424173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"94'20","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.527693+0000","last_change":"2024-09-10T15:28:22.527757+0000","last_active":"2024-09-10T15:28:22.527693+0000","last_peered":"2024-09-10T15:28:22.527693+0000","last_clean":"2024-09-10T15:28:22.527693+0000","last_became_active":"2024-09-10T15:25:11.844122+0000","last_became_peered":"2024-09-10T15:25:11.844122+0000","last_unstale":"2024-09-10T15:28:22.527693+0000","last_undegraded":"2024-09-10T15:28:22.527693+0000","last_fullsized":"2024-09-10T15:28:22.527693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:22.527486+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:22.527486+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.527486+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:15.667954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32786,"num_write":50,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.262408+0000","last_change":"2024-09-10T15:28:05.262465+0000","last_active":"2024-09-10T15:28:05.262408+0000","last_peered":"2024-09-10T15:28:05.262408+0000","last_clean":"2024-09-10T15:28:05.262408+0000","last_became_active":"2024-09-10T15:25:15.853020+0000","last_became_peered":"2024-09-10T15:25:15.853020+0000","last_unstale":"2024-09-10T15:28:05.262408+0000","last_undegraded":"2024-09-10T15:28:05.262408+0000","last_fullsized":"2024-09-10T15:28:05.262408+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.262207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.262207+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.262207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:41.417962+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"94'22","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.720967+0000","last_change":"2024-09-10T15:28:05.721077+0000","last_active":"2024-09-10T15:28:05.720967+0000","last_peered":"2024-09-10T15:28:05.720967+0000","last_clean":"2024-09-10T15:28:05.720967+0000","last_became_active":"2024-09-10T15:25:17.869045+0000","last_became_peered":"2024-09-10T15:25:17.869045+0000","last_unstale":"2024-09-10T15:28:05.720967+0000","last_undegraded":"2024-09-10T15:28:05.720967+0000","last_fullsized":"2024-09-10T15:28:05.720967+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:05.720712+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:05.720712+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.720712+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:45.822555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":57,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:37.486419+0000","last_change":"2024-09-10T15:28:37.486477+0000","last_active":"2024-09-10T15:28:37.486419+0000","last_peered":"2024-09-10T15:28:37.486419+0000","last_clean":"2024-09-10T15:28:37.486419+0000","last_became_active":"2024-09-10T15:25:19.886754+0000","last_became_peered":"2024-09-10T15:25:19.886754+0000","last_unstale":"2024-09-10T15:28:37.486419+0000","last_undegraded":"2024-09-10T15:28:37.486419+0000","last_fullsized":"2024-09-10T15:28:37.486419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:37.486225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:37.486225+0000","last_clean_scrub_stamp":"2024-09-10T15:28:37.486225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:11.021495+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"76'2","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.210896+0000","last_change":"2024-09-10T15:28:31.210961+0000","last_active":"2024-09-10T15:28:31.210896+0000","last_peered":"2024-09-10T15:28:31.210896+0000","last_clean":"2024-09-10T15:28:31.210896+0000","last_became_active":"2024-09-10T15:25:21.898474+0000","last_became_peered":"2024-09-10T15:25:21.898474+0000","last_unstale":"2024-09-10T15:28:31.210896+0000","last_undegraded":"2024-09-10T15:28:31.210896+0000","last_fullsized":"2024-09-10T15:28:31.210896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:31.210689+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:31.210689+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.210689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:19:00.074070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.511472+0000","last_change":"2024-09-10T15:28:13.511528+0000","last_active":"2024-09-10T15:28:13.511472+0000","last_peered":"2024-09-10T15:28:13.511472+0000","last_clean":"2024-09-10T15:28:13.511472+0000","last_became_active":"2024-09-10T15:25:13.841346+0000","last_became_peered":"2024-09-10T15:25:13.841346+0000","last_unstale":"2024-09-10T15:28:13.511472+0000","last_undegraded":"2024-09-10T15:28:13.511472+0000","last_fullsized":"2024-09-10T15:28:13.511472+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.511286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.511286+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.511286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.613128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"94'14","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:42.443198+0000","last_change":"2024-09-10T15:28:42.443268+0000","last_active":"2024-09-10T15:28:42.443198+0000","last_peered":"2024-09-10T15:28:42.443198+0000","last_clean":"2024-09-10T15:28:42.443198+0000","last_became_active":"2024-09-10T15:25:11.836545+0000","last_became_peered":"2024-09-10T15:25:11.836545+0000","last_unstale":"2024-09-10T15:28:42.443198+0000","last_undegraded":"2024-09-10T15:28:42.443198+0000","last_fullsized":"2024-09-10T15:28:42.443198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:42.442978+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:42.442978+0000","last_clean_scrub_stamp":"2024-09-10T15:28:42.442978+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:53:09.180385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":26624,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.387828+0000","last_change":"2024-09-10T15:28:25.387933+0000","last_active":"2024-09-10T15:28:25.387828+0000","last_peered":"2024-09-10T15:28:25.387828+0000","last_clean":"2024-09-10T15:28:25.387828+0000","last_became_active":"2024-09-10T15:25:15.860000+0000","last_became_peered":"2024-09-10T15:25:15.860000+0000","last_unstale":"2024-09-10T15:28:25.387828+0000","last_undegraded":"2024-09-10T15:28:25.387828+0000","last_fullsized":"2024-09-10T15:28:25.387828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.387581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.387581+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.387581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:54.250961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"94'32","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.178082+0000","last_change":"2024-09-10T15:28:07.178166+0000","last_active":"2024-09-10T15:28:07.178082+0000","last_peered":"2024-09-10T15:28:07.178082+0000","last_clean":"2024-09-10T15:28:07.178082+0000","last_became_active":"2024-09-10T15:25:17.862470+0000","last_became_peered":"2024-09-10T15:25:17.862470+0000","last_unstale":"2024-09-10T15:28:07.178082+0000","last_undegraded":"2024-09-10T15:28:07.178082+0000","last_fullsized":"2024-09-10T15:28:07.178082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'32","last_scrub_stamp":"2024-09-10T15:28:07.177884+0000","last_deep_scrub":"94'32","last_deep_scrub_stamp":"2024-09-10T15:28:07.177884+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.177884+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:20.096846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":45,"num_read_kb":58,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.442390+0000","last_change":"2024-09-10T15:28:08.442555+0000","last_active":"2024-09-10T15:28:08.442390+0000","last_peered":"2024-09-10T15:28:08.442390+0000","last_clean":"2024-09-10T15:28:08.442390+0000","last_became_active":"2024-09-10T15:25:19.880774+0000","last_became_peered":"2024-09-10T15:25:19.880774+0000","last_unstale":"2024-09-10T15:28:08.442390+0000","last_undegraded":"2024-09-10T15:28:08.442390+0000","last_fullsized":"2024-09-10T15:28:08.442390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:08.442094+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:08.442094+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.442094+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:09:17.639917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"67'2","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.373686+0000","last_change":"2024-09-10T15:28:32.373845+0000","last_active":"2024-09-10T15:28:32.373686+0000","last_peered":"2024-09-10T15:28:32.373686+0000","last_clean":"2024-09-10T15:28:32.373686+0000","last_became_active":"2024-09-10T15:25:21.896006+0000","last_became_peered":"2024-09-10T15:25:21.896006+0000","last_unstale":"2024-09-10T15:28:32.373686+0000","last_undegraded":"2024-09-10T15:28:32.373686+0000","last_fullsized":"2024-09-10T15:28:32.373686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:32.373452+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:32.373452+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.373452+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:45:02.825237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.446864+0000","last_change":"2024-09-10T15:28:17.446928+0000","last_active":"2024-09-10T15:28:17.446864+0000","last_peered":"2024-09-10T15:28:17.446864+0000","last_clean":"2024-09-10T15:28:17.446864+0000","last_became_active":"2024-09-10T15:25:13.867935+0000","last_became_peered":"2024-09-10T15:25:13.867935+0000","last_unstale":"2024-09-10T15:28:17.446864+0000","last_undegraded":"2024-09-10T15:28:17.446864+0000","last_fullsized":"2024-09-10T15:28:17.446864+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.446652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.446652+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.446652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:02.704800+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"94'20","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.326747+0000","last_change":"2024-09-10T15:28:14.326819+0000","last_active":"2024-09-10T15:28:14.326747+0000","last_peered":"2024-09-10T15:28:14.326747+0000","last_clean":"2024-09-10T15:28:14.326747+0000","last_became_active":"2024-09-10T15:25:11.834197+0000","last_became_peered":"2024-09-10T15:25:11.834197+0000","last_unstale":"2024-09-10T15:28:14.326747+0000","last_undegraded":"2024-09-10T15:28:14.326747+0000","last_fullsized":"2024-09-10T15:28:14.326747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:14.326557+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:14.326557+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.326557+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:18.672238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.223347+0000","last_change":"2024-09-10T15:28:06.223397+0000","last_active":"2024-09-10T15:28:06.223347+0000","last_peered":"2024-09-10T15:28:06.223347+0000","last_clean":"2024-09-10T15:28:06.223347+0000","last_became_active":"2024-09-10T15:25:15.851032+0000","last_became_peered":"2024-09-10T15:25:15.851032+0000","last_unstale":"2024-09-10T15:28:06.223347+0000","last_undegraded":"2024-09-10T15:28:06.223347+0000","last_fullsized":"2024-09-10T15:28:06.223347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.223149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.223149+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.223149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:22.953621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"94'36","reported_seq":201,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.702652+0000","last_change":"2024-09-10T15:28:04.702743+0000","last_active":"2024-09-10T15:28:04.702652+0000","last_peered":"2024-09-10T15:28:04.702652+0000","last_clean":"2024-09-10T15:28:04.702652+0000","last_became_active":"2024-09-10T15:25:17.869134+0000","last_became_peered":"2024-09-10T15:25:17.869134+0000","last_unstale":"2024-09-10T15:28:04.702652+0000","last_undegraded":"2024-09-10T15:28:04.702652+0000","last_fullsized":"2024-09-10T15:28:04.702652+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'36","last_scrub_stamp":"2024-09-10T15:28:04.702463+0000","last_deep_scrub":"94'36","last_deep_scrub_stamp":"2024-09-10T15:28:04.702463+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.702463+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:39:56.597006+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":103,"num_write":40,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.413946+0000","last_change":"2024-09-10T15:28:07.413998+0000","last_active":"2024-09-10T15:28:07.413946+0000","last_peered":"2024-09-10T15:28:07.413946+0000","last_clean":"2024-09-10T15:28:07.413946+0000","last_became_active":"2024-09-10T15:25:19.883323+0000","last_became_peered":"2024-09-10T15:25:19.883323+0000","last_unstale":"2024-09-10T15:28:07.413946+0000","last_undegraded":"2024-09-10T15:28:07.413946+0000","last_fullsized":"2024-09-10T15:28:07.413946+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.413733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.413733+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.413733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:39:22.926158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.843263+0000","last_change":"2024-09-10T15:28:29.843314+0000","last_active":"2024-09-10T15:28:29.843263+0000","last_peered":"2024-09-10T15:28:29.843263+0000","last_clean":"2024-09-10T15:28:29.843263+0000","last_became_active":"2024-09-10T15:25:21.894496+0000","last_became_peered":"2024-09-10T15:25:21.894496+0000","last_unstale":"2024-09-10T15:28:29.843263+0000","last_undegraded":"2024-09-10T15:28:29.843263+0000","last_fullsized":"2024-09-10T15:28:29.843263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.843075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.843075+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.843075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:15.101224+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.408923+0000","last_change":"2024-09-10T15:28:05.408945+0000","last_active":"2024-09-10T15:28:05.408923+0000","last_peered":"2024-09-10T15:28:05.408923+0000","last_clean":"2024-09-10T15:28:05.408923+0000","last_became_active":"2024-09-10T15:25:13.858550+0000","last_became_peered":"2024-09-10T15:25:13.858550+0000","last_unstale":"2024-09-10T15:28:05.408923+0000","last_undegraded":"2024-09-10T15:28:05.408923+0000","last_fullsized":"2024-09-10T15:28:05.408923+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.408844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.408844+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.408844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:17:41.714196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.729892+0000","last_change":"2024-09-10T15:28:20.729957+0000","last_active":"2024-09-10T15:28:20.729892+0000","last_peered":"2024-09-10T15:28:20.729892+0000","last_clean":"2024-09-10T15:28:20.729892+0000","last_became_active":"2024-09-10T15:25:11.857919+0000","last_became_peered":"2024-09-10T15:25:11.857919+0000","last_unstale":"2024-09-10T15:28:20.729892+0000","last_undegraded":"2024-09-10T15:28:20.729892+0000","last_fullsized":"2024-09-10T15:28:20.729892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:20.729648+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:20.729648+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.729648+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:54.467440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":43026,"num_write":52,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.786279+0000","last_change":"2024-09-10T15:28:08.786333+0000","last_active":"2024-09-10T15:28:08.786279+0000","last_peered":"2024-09-10T15:28:08.786279+0000","last_clean":"2024-09-10T15:28:08.786279+0000","last_became_active":"2024-09-10T15:25:15.859548+0000","last_became_peered":"2024-09-10T15:25:15.859548+0000","last_unstale":"2024-09-10T15:28:08.786279+0000","last_undegraded":"2024-09-10T15:28:08.786279+0000","last_fullsized":"2024-09-10T15:28:08.786279+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.786060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.786060+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.786060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:44.941815+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"94'27","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.367116+0000","last_change":"2024-09-10T15:28:12.367296+0000","last_active":"2024-09-10T15:28:12.367116+0000","last_peered":"2024-09-10T15:28:12.367116+0000","last_clean":"2024-09-10T15:28:12.367116+0000","last_became_active":"2024-09-10T15:25:17.867882+0000","last_became_peered":"2024-09-10T15:25:17.867882+0000","last_unstale":"2024-09-10T15:28:12.367116+0000","last_undegraded":"2024-09-10T15:28:12.367116+0000","last_fullsized":"2024-09-10T15:28:12.367116+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'27","last_scrub_stamp":"2024-09-10T15:28:12.366890+0000","last_deep_scrub":"94'27","last_deep_scrub_stamp":"2024-09-10T15:28:12.366890+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.366890+0000","objects_scrubbed":6,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:58.332432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":44,"num_write":26,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":770,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.830921+0000","last_change":"2024-09-10T15:28:26.831081+0000","last_active":"2024-09-10T15:28:26.830921+0000","last_peered":"2024-09-10T15:28:26.830921+0000","last_clean":"2024-09-10T15:28:26.830921+0000","last_became_active":"2024-09-10T15:25:19.893257+0000","last_became_peered":"2024-09-10T15:25:19.893257+0000","last_unstale":"2024-09-10T15:28:26.830921+0000","last_undegraded":"2024-09-10T15:28:26.830921+0000","last_fullsized":"2024-09-10T15:28:26.830921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.830702+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.830702+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.830702+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:34:17.234010+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:37.239867+0000","last_change":"2024-09-10T15:28:37.239928+0000","last_active":"2024-09-10T15:28:37.239867+0000","last_peered":"2024-09-10T15:28:37.239867+0000","last_clean":"2024-09-10T15:28:37.239867+0000","last_became_active":"2024-09-10T15:25:21.894196+0000","last_became_peered":"2024-09-10T15:25:21.894196+0000","last_unstale":"2024-09-10T15:28:37.239867+0000","last_undegraded":"2024-09-10T15:28:37.239867+0000","last_fullsized":"2024-09-10T15:28:37.239867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:37.239635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:37.239635+0000","last_clean_scrub_stamp":"2024-09-10T15:28:37.239635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:24.125918+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"67'6","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:44.382081+0000","last_change":"2024-09-10T15:28:44.382143+0000","last_active":"2024-09-10T15:28:44.382081+0000","last_peered":"2024-09-10T15:28:44.382081+0000","last_clean":"2024-09-10T15:28:44.382081+0000","last_became_active":"2024-09-10T15:25:13.846035+0000","last_became_peered":"2024-09-10T15:25:13.846035+0000","last_unstale":"2024-09-10T15:28:44.382081+0000","last_undegraded":"2024-09-10T15:28:44.382081+0000","last_fullsized":"2024-09-10T15:28:44.382081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:44.381858+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:44.381858+0000","last_clean_scrub_stamp":"2024-09-10T15:28:44.381858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:38:27.584190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"94'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:41.470457+0000","last_change":"2024-09-10T15:28:41.470522+0000","last_active":"2024-09-10T15:28:41.470457+0000","last_peered":"2024-09-10T15:28:41.470457+0000","last_clean":"2024-09-10T15:28:41.470457+0000","last_became_active":"2024-09-10T15:25:11.832637+0000","last_became_peered":"2024-09-10T15:25:11.832637+0000","last_unstale":"2024-09-10T15:28:41.470457+0000","last_undegraded":"2024-09-10T15:28:41.470457+0000","last_fullsized":"2024-09-10T15:28:41.470457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:41.470237+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:41.470237+0000","last_clean_scrub_stamp":"2024-09-10T15:28:41.470237+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:54:59.142785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18438,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.399412+0000","last_change":"2024-09-10T15:28:23.399464+0000","last_active":"2024-09-10T15:28:23.399412+0000","last_peered":"2024-09-10T15:28:23.399412+0000","last_clean":"2024-09-10T15:28:23.399412+0000","last_became_active":"2024-09-10T15:25:15.855486+0000","last_became_peered":"2024-09-10T15:25:15.855486+0000","last_unstale":"2024-09-10T15:28:23.399412+0000","last_undegraded":"2024-09-10T15:28:23.399412+0000","last_fullsized":"2024-09-10T15:28:23.399412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.399232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.399232+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.399232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:53.851017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"94'30","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:35.300832+0000","last_change":"2024-09-10T15:28:35.300919+0000","last_active":"2024-09-10T15:28:35.300832+0000","last_peered":"2024-09-10T15:28:35.300832+0000","last_clean":"2024-09-10T15:28:35.300832+0000","last_became_active":"2024-09-10T15:25:17.865570+0000","last_became_peered":"2024-09-10T15:25:17.865570+0000","last_unstale":"2024-09-10T15:28:35.300832+0000","last_undegraded":"2024-09-10T15:28:35.300832+0000","last_fullsized":"2024-09-10T15:28:35.300832+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:35.300616+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:35.300616+0000","last_clean_scrub_stamp":"2024-09-10T15:28:35.300616+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:47.720310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"94'18","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.803408+0000","last_change":"2024-09-10T15:28:11.803530+0000","last_active":"2024-09-10T15:28:11.803408+0000","last_peered":"2024-09-10T15:28:11.803408+0000","last_clean":"2024-09-10T15:28:11.803408+0000","last_became_active":"2024-09-10T15:25:19.884277+0000","last_became_peered":"2024-09-10T15:25:19.884277+0000","last_unstale":"2024-09-10T15:28:11.803408+0000","last_undegraded":"2024-09-10T15:28:11.803408+0000","last_fullsized":"2024-09-10T15:28:11.803408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:11.803181+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:11.803181+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.803181+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:21.227153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.350984+0000","last_change":"2024-09-10T15:28:29.351035+0000","last_active":"2024-09-10T15:28:29.350984+0000","last_peered":"2024-09-10T15:28:29.350984+0000","last_clean":"2024-09-10T15:28:29.350984+0000","last_became_active":"2024-09-10T15:25:21.880072+0000","last_became_peered":"2024-09-10T15:25:21.880072+0000","last_unstale":"2024-09-10T15:28:29.350984+0000","last_undegraded":"2024-09-10T15:28:29.350984+0000","last_fullsized":"2024-09-10T15:28:29.350984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.350781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.350781+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.350781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:30.069480+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.520715+0000","last_change":"2024-09-10T15:28:23.520777+0000","last_active":"2024-09-10T15:28:23.520715+0000","last_peered":"2024-09-10T15:28:23.520715+0000","last_clean":"2024-09-10T15:28:23.520715+0000","last_became_active":"2024-09-10T15:25:13.840974+0000","last_became_peered":"2024-09-10T15:25:13.840974+0000","last_unstale":"2024-09-10T15:28:23.520715+0000","last_undegraded":"2024-09-10T15:28:23.520715+0000","last_fullsized":"2024-09-10T15:28:23.520715+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:23.520518+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:23.520518+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.520518+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:51.851954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"94'16","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.325330+0000","last_change":"2024-09-10T15:28:29.325471+0000","last_active":"2024-09-10T15:28:29.325330+0000","last_peered":"2024-09-10T15:28:29.325330+0000","last_clean":"2024-09-10T15:28:29.325330+0000","last_became_active":"2024-09-10T15:25:11.843755+0000","last_became_peered":"2024-09-10T15:25:11.843755+0000","last_unstale":"2024-09-10T15:28:29.325330+0000","last_undegraded":"2024-09-10T15:28:29.325330+0000","last_fullsized":"2024-09-10T15:28:29.325330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:29.325094+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:29.325094+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.325094+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:08:42.144262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"94'4","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:03.323045+0000","last_change":"2024-09-10T15:28:03.323110+0000","last_active":"2024-09-10T15:28:03.323045+0000","last_peered":"2024-09-10T15:28:03.323045+0000","last_clean":"2024-09-10T15:28:03.323045+0000","last_became_active":"2024-09-10T15:25:15.850252+0000","last_became_peered":"2024-09-10T15:25:15.850252+0000","last_unstale":"2024-09-10T15:28:03.323045+0000","last_undegraded":"2024-09-10T15:28:03.323045+0000","last_fullsized":"2024-09-10T15:28:03.323045+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'4","last_scrub_stamp":"2024-09-10T15:28:03.322854+0000","last_deep_scrub":"94'4","last_deep_scrub_stamp":"2024-09-10T15:28:03.322854+0000","last_clean_scrub_stamp":"2024-09-10T15:28:03.322854+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:40.200094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"94'15","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.368827+0000","last_change":"2024-09-10T15:28:27.368984+0000","last_active":"2024-09-10T15:28:27.368827+0000","last_peered":"2024-09-10T15:28:27.368827+0000","last_clean":"2024-09-10T15:28:27.368827+0000","last_became_active":"2024-09-10T15:25:17.872396+0000","last_became_peered":"2024-09-10T15:25:17.872396+0000","last_unstale":"2024-09-10T15:28:27.368827+0000","last_undegraded":"2024-09-10T15:28:27.368827+0000","last_fullsized":"2024-09-10T15:28:27.368827+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:27.368585+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:27.368585+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.368585+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:36.047840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"94'18","reported_seq":204,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.290994+0000","last_change":"2024-09-10T15:28:16.291073+0000","last_active":"2024-09-10T15:28:16.290994+0000","last_peered":"2024-09-10T15:28:16.290994+0000","last_clean":"2024-09-10T15:28:16.290994+0000","last_became_active":"2024-09-10T15:25:19.875905+0000","last_became_peered":"2024-09-10T15:25:19.875905+0000","last_unstale":"2024-09-10T15:28:16.290994+0000","last_undegraded":"2024-09-10T15:28:16.290994+0000","last_fullsized":"2024-09-10T15:28:16.290994+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:16.290798+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:16.290798+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.290798+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:17.833998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.444818+0000","last_change":"2024-09-10T15:28:29.444872+0000","last_active":"2024-09-10T15:28:29.444818+0000","last_peered":"2024-09-10T15:28:29.444818+0000","last_clean":"2024-09-10T15:28:29.444818+0000","last_became_active":"2024-09-10T15:25:21.886165+0000","last_became_peered":"2024-09-10T15:25:21.886165+0000","last_unstale":"2024-09-10T15:28:29.444818+0000","last_undegraded":"2024-09-10T15:28:29.444818+0000","last_fullsized":"2024-09-10T15:28:29.444818+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:29.444618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:29.444618+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.444618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:42.363580+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.769058+0000","last_change":"2024-09-10T15:28:12.769114+0000","last_active":"2024-09-10T15:28:12.769058+0000","last_peered":"2024-09-10T15:28:12.769058+0000","last_clean":"2024-09-10T15:28:12.769058+0000","last_became_active":"2024-09-10T15:25:13.868684+0000","last_became_peered":"2024-09-10T15:25:13.868684+0000","last_unstale":"2024-09-10T15:28:12.769058+0000","last_undegraded":"2024-09-10T15:28:12.769058+0000","last_fullsized":"2024-09-10T15:28:12.769058+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.768855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.768855+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.768855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:19.846162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"94'18","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.633312+0000","last_change":"2024-09-10T15:28:30.633377+0000","last_active":"2024-09-10T15:28:30.633312+0000","last_peered":"2024-09-10T15:28:30.633312+0000","last_clean":"2024-09-10T15:28:30.633312+0000","last_became_active":"2024-09-10T15:25:11.838055+0000","last_became_peered":"2024-09-10T15:25:11.838055+0000","last_unstale":"2024-09-10T15:28:30.633312+0000","last_undegraded":"2024-09-10T15:28:30.633312+0000","last_fullsized":"2024-09-10T15:28:30.633312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:30.633105+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:30.633105+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.633105+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:23.901509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.228044+0000","last_change":"2024-09-10T15:28:12.228102+0000","last_active":"2024-09-10T15:28:12.228044+0000","last_peered":"2024-09-10T15:28:12.228044+0000","last_clean":"2024-09-10T15:28:12.228044+0000","last_became_active":"2024-09-10T15:25:15.869084+0000","last_became_peered":"2024-09-10T15:25:15.869084+0000","last_unstale":"2024-09-10T15:28:12.228044+0000","last_undegraded":"2024-09-10T15:28:12.228044+0000","last_fullsized":"2024-09-10T15:28:12.228044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.227843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.227843+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.227843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:05.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"94'32","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.364433+0000","last_change":"2024-09-10T15:28:14.364535+0000","last_active":"2024-09-10T15:28:14.364433+0000","last_peered":"2024-09-10T15:28:14.364433+0000","last_clean":"2024-09-10T15:28:14.364433+0000","last_became_active":"2024-09-10T15:25:17.869447+0000","last_became_peered":"2024-09-10T15:25:17.869447+0000","last_unstale":"2024-09-10T15:28:14.364433+0000","last_undegraded":"2024-09-10T15:28:14.364433+0000","last_fullsized":"2024-09-10T15:28:14.364433+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'32","last_scrub_stamp":"2024-09-10T15:28:14.364256+0000","last_deep_scrub":"94'32","last_deep_scrub_stamp":"2024-09-10T15:28:14.364256+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.364256+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:06:48.102048+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.479498+0000","last_change":"2024-09-10T15:28:25.479550+0000","last_active":"2024-09-10T15:28:25.479498+0000","last_peered":"2024-09-10T15:28:25.479498+0000","last_clean":"2024-09-10T15:28:25.479498+0000","last_became_active":"2024-09-10T15:25:19.885543+0000","last_became_peered":"2024-09-10T15:25:19.885543+0000","last_unstale":"2024-09-10T15:28:25.479498+0000","last_undegraded":"2024-09-10T15:28:25.479498+0000","last_fullsized":"2024-09-10T15:28:25.479498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.479308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.479308+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.479308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:10.737457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"76'2","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.880847+0000","last_change":"2024-09-10T15:28:27.880909+0000","last_active":"2024-09-10T15:28:27.880847+0000","last_peered":"2024-09-10T15:28:27.880847+0000","last_clean":"2024-09-10T15:28:27.880847+0000","last_became_active":"2024-09-10T15:25:21.881743+0000","last_became_peered":"2024-09-10T15:25:21.881743+0000","last_unstale":"2024-09-10T15:28:27.880847+0000","last_undegraded":"2024-09-10T15:28:27.880847+0000","last_fullsized":"2024-09-10T15:28:27.880847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:27.880642+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:27.880642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.880642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:56.212079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:34.406358+0000","last_change":"2024-09-10T15:28:34.406414+0000","last_active":"2024-09-10T15:28:34.406358+0000","last_peered":"2024-09-10T15:28:34.406358+0000","last_clean":"2024-09-10T15:28:34.406358+0000","last_became_active":"2024-09-10T15:25:13.845632+0000","last_became_peered":"2024-09-10T15:25:13.845632+0000","last_unstale":"2024-09-10T15:28:34.406358+0000","last_undegraded":"2024-09-10T15:28:34.406358+0000","last_fullsized":"2024-09-10T15:28:34.406358+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:34.406160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:34.406160+0000","last_clean_scrub_stamp":"2024-09-10T15:28:34.406160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:06:13.416311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"94'119","reported_seq":327,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.301835+0000","last_change":"2024-09-10T15:28:18.301835+0000","last_active":"2024-09-10T15:28:18.301835+0000","last_peered":"2024-09-10T15:28:18.301835+0000","last_clean":"2024-09-10T15:28:18.301835+0000","last_became_active":"2024-09-10T15:25:00.653332+0000","last_became_peered":"2024-09-10T15:25:00.653332+0000","last_unstale":"2024-09-10T15:28:18.301835+0000","last_undegraded":"2024-09-10T15:28:18.301835+0000","last_fullsized":"2024-09-10T15:28:18.301835+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'119","last_scrub_stamp":"2024-09-10T15:28:18.301551+0000","last_deep_scrub":"94'119","last_deep_scrub_stamp":"2024-09-10T15:28:18.301551+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.301551+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:58.514533+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"94'2","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:39.421689+0000","last_change":"2024-09-10T15:28:39.421758+0000","last_active":"2024-09-10T15:28:39.421689+0000","last_peered":"2024-09-10T15:28:39.421689+0000","last_clean":"2024-09-10T15:28:39.421689+0000","last_became_active":"2024-09-10T15:25:03.730037+0000","last_became_peered":"2024-09-10T15:25:03.730037+0000","last_unstale":"2024-09-10T15:28:39.421689+0000","last_undegraded":"2024-09-10T15:28:39.421689+0000","last_fullsized":"2024-09-10T15:28:39.421689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:39.421502+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:39.421502+0000","last_clean_scrub_stamp":"2024-09-10T15:28:39.421502+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:41:52.010748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016749,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"94'24","reported_seq":198,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.617824+0000","last_change":"2024-09-10T15:28:27.617959+0000","last_active":"2024-09-10T15:28:27.617824+0000","last_peered":"2024-09-10T15:28:27.617824+0000","last_clean":"2024-09-10T15:28:27.617824+0000","last_became_active":"2024-09-10T15:25:11.821362+0000","last_became_peered":"2024-09-10T15:25:11.821362+0000","last_unstale":"2024-09-10T15:28:27.617824+0000","last_undegraded":"2024-09-10T15:28:27.617824+0000","last_fullsized":"2024-09-10T15:28:27.617824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:27.617612+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:27.617612+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.617612+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:00:11.762305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":49176,"num_write":64,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.363824+0000","last_change":"2024-09-10T15:28:06.363895+0000","last_active":"2024-09-10T15:28:06.363824+0000","last_peered":"2024-09-10T15:28:06.363824+0000","last_clean":"2024-09-10T15:28:06.363824+0000","last_became_active":"2024-09-10T15:25:15.859771+0000","last_became_peered":"2024-09-10T15:25:15.859771+0000","last_unstale":"2024-09-10T15:28:06.363824+0000","last_undegraded":"2024-09-10T15:28:06.363824+0000","last_fullsized":"2024-09-10T15:28:06.363824+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.363643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.363643+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.363643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:59:11.269225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"94'44","reported_seq":214,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.195215+0000","last_change":"2024-09-10T15:28:05.195290+0000","last_active":"2024-09-10T15:28:05.195215+0000","last_peered":"2024-09-10T15:28:05.195215+0000","last_clean":"2024-09-10T15:28:05.195215+0000","last_became_active":"2024-09-10T15:25:17.867040+0000","last_became_peered":"2024-09-10T15:25:17.867040+0000","last_unstale":"2024-09-10T15:28:05.195215+0000","last_undegraded":"2024-09-10T15:28:05.195215+0000","last_fullsized":"2024-09-10T15:28:05.195215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'44","last_scrub_stamp":"2024-09-10T15:28:05.194997+0000","last_deep_scrub":"94'44","last_deep_scrub_stamp":"2024-09-10T15:28:05.194997+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.194997+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:19.948133+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":140,"num_write":50,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.459354+0000","last_change":"2024-09-10T15:28:09.459405+0000","last_active":"2024-09-10T15:28:09.459354+0000","last_peered":"2024-09-10T15:28:09.459354+0000","last_clean":"2024-09-10T15:28:09.459354+0000","last_became_active":"2024-09-10T15:25:19.893857+0000","last_became_peered":"2024-09-10T15:25:19.893857+0000","last_unstale":"2024-09-10T15:28:09.459354+0000","last_undegraded":"2024-09-10T15:28:09.459354+0000","last_fullsized":"2024-09-10T15:28:09.459354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.459158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.459158+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.459158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.804839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.278047+0000","last_change":"2024-09-10T15:28:26.278092+0000","last_active":"2024-09-10T15:28:26.278047+0000","last_peered":"2024-09-10T15:28:26.278047+0000","last_clean":"2024-09-10T15:28:26.278047+0000","last_became_active":"2024-09-10T15:25:21.882429+0000","last_became_peered":"2024-09-10T15:25:21.882429+0000","last_unstale":"2024-09-10T15:28:26.278047+0000","last_undegraded":"2024-09-10T15:28:26.278047+0000","last_fullsized":"2024-09-10T15:28:26.278047+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.277915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.277915+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.277915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:26.996613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.399187+0000","last_change":"2024-09-10T15:28:16.399239+0000","last_active":"2024-09-10T15:28:16.399187+0000","last_peered":"2024-09-10T15:28:16.399187+0000","last_clean":"2024-09-10T15:28:16.399187+0000","last_became_active":"2024-09-10T15:25:13.860499+0000","last_became_peered":"2024-09-10T15:25:13.860499+0000","last_unstale":"2024-09-10T15:28:16.399187+0000","last_undegraded":"2024-09-10T15:28:16.399187+0000","last_fullsized":"2024-09-10T15:28:16.399187+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.399000+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.399000+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.399000+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:08.912626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:38.403495+0000","last_change":"2024-09-10T15:28:38.403495+0000","last_active":"2024-09-10T15:28:38.403495+0000","last_peered":"2024-09-10T15:28:38.403495+0000","last_clean":"2024-09-10T15:28:38.403495+0000","last_became_active":"2024-09-10T15:25:03.527416+0000","last_became_peered":"2024-09-10T15:25:03.527416+0000","last_unstale":"2024-09-10T15:28:38.403495+0000","last_undegraded":"2024-09-10T15:28:38.403495+0000","last_fullsized":"2024-09-10T15:28:38.403495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:38.403235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:38.403235+0000","last_clean_scrub_stamp":"2024-09-10T15:28:38.403235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:35:24.821902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001563465,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"94'28","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.296195+0000","last_change":"2024-09-10T15:28:22.296324+0000","last_active":"2024-09-10T15:28:22.296195+0000","last_peered":"2024-09-10T15:28:22.296195+0000","last_clean":"2024-09-10T15:28:22.296195+0000","last_became_active":"2024-09-10T15:25:11.854851+0000","last_became_peered":"2024-09-10T15:25:11.854851+0000","last_unstale":"2024-09-10T15:28:22.296195+0000","last_undegraded":"2024-09-10T15:28:22.296195+0000","last_fullsized":"2024-09-10T15:28:22.296195+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'28","last_scrub_stamp":"2024-09-10T15:28:22.295934+0000","last_deep_scrub":"94'28","last_deep_scrub_stamp":"2024-09-10T15:28:22.295934+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.295934+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:05.621936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":49164,"num_write":48,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.300687+0000","last_change":"2024-09-10T15:28:16.300738+0000","last_active":"2024-09-10T15:28:16.300687+0000","last_peered":"2024-09-10T15:28:16.300687+0000","last_clean":"2024-09-10T15:28:16.300687+0000","last_became_active":"2024-09-10T15:25:15.860241+0000","last_became_peered":"2024-09-10T15:25:15.860241+0000","last_unstale":"2024-09-10T15:28:16.300687+0000","last_undegraded":"2024-09-10T15:28:16.300687+0000","last_fullsized":"2024-09-10T15:28:16.300687+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.300492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.300492+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.300492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:09.568897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"94'69","reported_seq":274,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.839095+0000","last_change":"2024-09-10T15:28:09.839178+0000","last_active":"2024-09-10T15:28:09.839095+0000","last_peered":"2024-09-10T15:28:09.839095+0000","last_clean":"2024-09-10T15:28:09.839095+0000","last_became_active":"2024-09-10T15:25:17.869163+0000","last_became_peered":"2024-09-10T15:25:17.869163+0000","last_unstale":"2024-09-10T15:28:09.839095+0000","last_undegraded":"2024-09-10T15:28:09.839095+0000","last_fullsized":"2024-09-10T15:28:09.839095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'69","last_scrub_stamp":"2024-09-10T15:28:09.838913+0000","last_deep_scrub":"94'69","last_deep_scrub_stamp":"2024-09-10T15:28:09.838913+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.838913+0000","objects_scrubbed":10,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:15:46.716153+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":106,"num_read_kb":151,"num_write":60,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.255889+0000","last_change":"2024-09-10T15:28:14.255942+0000","last_active":"2024-09-10T15:28:14.255889+0000","last_peered":"2024-09-10T15:28:14.255889+0000","last_clean":"2024-09-10T15:28:14.255889+0000","last_became_active":"2024-09-10T15:25:19.885706+0000","last_became_peered":"2024-09-10T15:25:19.885706+0000","last_unstale":"2024-09-10T15:28:14.255889+0000","last_undegraded":"2024-09-10T15:28:14.255889+0000","last_fullsized":"2024-09-10T15:28:14.255889+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.255662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.255662+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.255662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:33.232191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"67'2","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:41.209588+0000","last_change":"2024-09-10T15:28:41.209645+0000","last_active":"2024-09-10T15:28:41.209588+0000","last_peered":"2024-09-10T15:28:41.209588+0000","last_clean":"2024-09-10T15:28:41.209588+0000","last_became_active":"2024-09-10T15:25:21.899281+0000","last_became_peered":"2024-09-10T15:25:21.899281+0000","last_unstale":"2024-09-10T15:28:41.209588+0000","last_undegraded":"2024-09-10T15:28:41.209588+0000","last_fullsized":"2024-09-10T15:28:41.209588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:41.209389+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:41.209389+0000","last_clean_scrub_stamp":"2024-09-10T15:28:41.209389+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:04.247385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.193090+0000","last_change":"2024-09-10T15:28:14.193148+0000","last_active":"2024-09-10T15:28:14.193090+0000","last_peered":"2024-09-10T15:28:14.193090+0000","last_clean":"2024-09-10T15:28:14.193090+0000","last_became_active":"2024-09-10T15:25:13.851745+0000","last_became_peered":"2024-09-10T15:25:13.851745+0000","last_unstale":"2024-09-10T15:28:14.193090+0000","last_undegraded":"2024-09-10T15:28:14.193090+0000","last_fullsized":"2024-09-10T15:28:14.193090+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.192901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.192901+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.192901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:26.237652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.810225+0000","last_change":"2024-09-10T15:28:17.810281+0000","last_active":"2024-09-10T15:28:17.810225+0000","last_peered":"2024-09-10T15:28:17.810225+0000","last_clean":"2024-09-10T15:28:17.810225+0000","last_became_active":"2024-09-10T15:25:03.528280+0000","last_became_peered":"2024-09-10T15:25:03.528280+0000","last_unstale":"2024-09-10T15:28:17.810225+0000","last_undegraded":"2024-09-10T15:28:17.810225+0000","last_fullsized":"2024-09-10T15:28:17.810225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.810031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.810031+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.810031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:29.854782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00073694400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"94'14","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.290933+0000","last_change":"2024-09-10T15:28:33.291014+0000","last_active":"2024-09-10T15:28:33.290933+0000","last_peered":"2024-09-10T15:28:33.290933+0000","last_clean":"2024-09-10T15:28:33.290933+0000","last_became_active":"2024-09-10T15:25:11.846667+0000","last_became_peered":"2024-09-10T15:25:11.846667+0000","last_unstale":"2024-09-10T15:28:33.290933+0000","last_undegraded":"2024-09-10T15:28:33.290933+0000","last_fullsized":"2024-09-10T15:28:33.290933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:33.290710+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:33.290710+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.290710+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:12:43.942169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24588,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"94'2","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.818229+0000","last_change":"2024-09-10T15:28:10.818300+0000","last_active":"2024-09-10T15:28:10.818229+0000","last_peered":"2024-09-10T15:28:10.818229+0000","last_clean":"2024-09-10T15:28:10.818229+0000","last_became_active":"2024-09-10T15:25:15.859518+0000","last_became_peered":"2024-09-10T15:25:15.859518+0000","last_unstale":"2024-09-10T15:28:10.818229+0000","last_undegraded":"2024-09-10T15:28:10.818229+0000","last_fullsized":"2024-09-10T15:28:10.818229+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:10.818023+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:10.818023+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.818023+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:48.672320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"94'24","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.328453+0000","last_change":"2024-09-10T15:28:22.328538+0000","last_active":"2024-09-10T15:28:22.328453+0000","last_peered":"2024-09-10T15:28:22.328453+0000","last_clean":"2024-09-10T15:28:22.328453+0000","last_became_active":"2024-09-10T15:25:17.866578+0000","last_became_peered":"2024-09-10T15:25:17.866578+0000","last_unstale":"2024-09-10T15:28:22.328453+0000","last_undegraded":"2024-09-10T15:28:22.328453+0000","last_fullsized":"2024-09-10T15:28:22.328453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:22.328241+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:22.328241+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.328241+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:14.841866+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:35.515859+0000","last_change":"2024-09-10T15:28:35.515920+0000","last_active":"2024-09-10T15:28:35.515859+0000","last_peered":"2024-09-10T15:28:35.515859+0000","last_clean":"2024-09-10T15:28:35.515859+0000","last_became_active":"2024-09-10T15:25:19.869170+0000","last_became_peered":"2024-09-10T15:25:19.869170+0000","last_unstale":"2024-09-10T15:28:35.515859+0000","last_undegraded":"2024-09-10T15:28:35.515859+0000","last_fullsized":"2024-09-10T15:28:35.515859+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:35.515640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:35.515640+0000","last_clean_scrub_stamp":"2024-09-10T15:28:35.515640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:14:22.401922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:40.597064+0000","last_change":"2024-09-10T15:28:40.597116+0000","last_active":"2024-09-10T15:28:40.597064+0000","last_peered":"2024-09-10T15:28:40.597064+0000","last_clean":"2024-09-10T15:28:40.597064+0000","last_became_active":"2024-09-10T15:25:21.901729+0000","last_became_peered":"2024-09-10T15:25:21.901729+0000","last_unstale":"2024-09-10T15:28:40.597064+0000","last_undegraded":"2024-09-10T15:28:40.597064+0000","last_fullsized":"2024-09-10T15:28:40.597064+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:40.596868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:40.596868+0000","last_clean_scrub_stamp":"2024-09-10T15:28:40.596868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:47.779538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.333298+0000","last_change":"2024-09-10T15:28:24.333358+0000","last_active":"2024-09-10T15:28:24.333298+0000","last_peered":"2024-09-10T15:28:24.333298+0000","last_clean":"2024-09-10T15:28:24.333298+0000","last_became_active":"2024-09-10T15:25:13.851058+0000","last_became_peered":"2024-09-10T15:25:13.851058+0000","last_unstale":"2024-09-10T15:28:24.333298+0000","last_undegraded":"2024-09-10T15:28:24.333298+0000","last_fullsized":"2024-09-10T15:28:24.333298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:24.333067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:24.333067+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.333067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:00:52.664504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"94'3","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:40.471437+0000","last_change":"2024-09-10T15:28:40.471507+0000","last_active":"2024-09-10T15:28:40.471437+0000","last_peered":"2024-09-10T15:28:40.471437+0000","last_clean":"2024-09-10T15:28:40.471437+0000","last_became_active":"2024-09-10T15:25:04.039968+0000","last_became_peered":"2024-09-10T15:25:04.039968+0000","last_unstale":"2024-09-10T15:28:40.471437+0000","last_undegraded":"2024-09-10T15:28:40.471437+0000","last_fullsized":"2024-09-10T15:28:40.471437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'3","last_scrub_stamp":"2024-09-10T15:28:40.471244+0000","last_deep_scrub":"94'3","last_deep_scrub_stamp":"2024-09-10T15:28:40.471244+0000","last_clean_scrub_stamp":"2024-09-10T15:28:40.471244+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:26:32.929614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.002471535,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"94'14","reported_seq":127,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.905405+0000","last_change":"2024-09-10T15:28:32.905527+0000","last_active":"2024-09-10T15:28:32.905405+0000","last_peered":"2024-09-10T15:28:32.905405+0000","last_clean":"2024-09-10T15:28:32.905405+0000","last_became_active":"2024-09-10T15:25:51.439106+0000","last_became_peered":"2024-09-10T15:25:51.439106+0000","last_unstale":"2024-09-10T15:28:32.905405+0000","last_undegraded":"2024-09-10T15:28:32.905405+0000","last_fullsized":"2024-09-10T15:28:32.905405+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:32.905102+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:32.905102+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.905102+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:33.623800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":28684,"num_write":34,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.767883+0000","last_change":"2024-09-10T15:28:06.767943+0000","last_active":"2024-09-10T15:28:06.767883+0000","last_peered":"2024-09-10T15:28:06.767883+0000","last_clean":"2024-09-10T15:28:06.767883+0000","last_became_active":"2024-09-10T15:25:15.869032+0000","last_became_peered":"2024-09-10T15:25:15.869032+0000","last_unstale":"2024-09-10T15:28:06.767883+0000","last_undegraded":"2024-09-10T15:28:06.767883+0000","last_fullsized":"2024-09-10T15:28:06.767883+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.767689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.767689+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.767689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:59:04.259990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"94'18","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.504780+0000","last_change":"2024-09-10T15:28:10.504864+0000","last_active":"2024-09-10T15:28:10.504780+0000","last_peered":"2024-09-10T15:28:10.504780+0000","last_clean":"2024-09-10T15:28:10.504780+0000","last_became_active":"2024-09-10T15:25:17.875310+0000","last_became_peered":"2024-09-10T15:25:17.875310+0000","last_unstale":"2024-09-10T15:28:10.504780+0000","last_undegraded":"2024-09-10T15:28:10.504780+0000","last_fullsized":"2024-09-10T15:28:10.504780+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:10.504568+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:10.504568+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.504568+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:04:35.891993+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:46.319314+0000","last_change":"2024-09-10T15:28:46.319367+0000","last_active":"2024-09-10T15:28:46.319314+0000","last_peered":"2024-09-10T15:28:46.319314+0000","last_clean":"2024-09-10T15:28:46.319314+0000","last_became_active":"2024-09-10T15:25:19.888898+0000","last_became_peered":"2024-09-10T15:25:19.888898+0000","last_unstale":"2024-09-10T15:28:46.319314+0000","last_undegraded":"2024-09-10T15:28:46.319314+0000","last_fullsized":"2024-09-10T15:28:46.319314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:46.319105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:46.319105+0000","last_clean_scrub_stamp":"2024-09-10T15:28:46.319105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:53:11.882019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.222825+0000","last_change":"2024-09-10T15:28:30.222892+0000","last_active":"2024-09-10T15:28:30.222825+0000","last_peered":"2024-09-10T15:28:30.222825+0000","last_clean":"2024-09-10T15:28:30.222825+0000","last_became_active":"2024-09-10T15:25:21.889445+0000","last_became_peered":"2024-09-10T15:25:21.889445+0000","last_unstale":"2024-09-10T15:28:30.222825+0000","last_undegraded":"2024-09-10T15:28:30.222825+0000","last_fullsized":"2024-09-10T15:28:30.222825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.222544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.222544+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.222544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:06:02.217508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.344728+0000","last_change":"2024-09-10T15:28:23.344780+0000","last_active":"2024-09-10T15:28:23.344728+0000","last_peered":"2024-09-10T15:28:23.344728+0000","last_clean":"2024-09-10T15:28:23.344728+0000","last_became_active":"2024-09-10T15:25:13.848319+0000","last_became_peered":"2024-09-10T15:25:13.848319+0000","last_unstale":"2024-09-10T15:28:23.344728+0000","last_undegraded":"2024-09-10T15:28:23.344728+0000","last_fullsized":"2024-09-10T15:28:23.344728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.344531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.344531+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.344531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:16.484999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.531208+0000","last_change":"2024-09-10T15:28:21.531275+0000","last_active":"2024-09-10T15:28:21.531208+0000","last_peered":"2024-09-10T15:28:21.531208+0000","last_clean":"2024-09-10T15:28:21.531208+0000","last_became_active":"2024-09-10T15:25:11.846795+0000","last_became_peered":"2024-09-10T15:25:11.846795+0000","last_unstale":"2024-09-10T15:28:21.531208+0000","last_undegraded":"2024-09-10T15:28:21.531208+0000","last_fullsized":"2024-09-10T15:28:21.531208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:21.531004+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:21.531004+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.531004+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:04.857005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32780,"num_write":38,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.327810+0000","last_change":"2024-09-10T15:28:27.327864+0000","last_active":"2024-09-10T15:28:27.327810+0000","last_peered":"2024-09-10T15:28:27.327810+0000","last_clean":"2024-09-10T15:28:27.327810+0000","last_became_active":"2024-09-10T15:25:04.039637+0000","last_became_peered":"2024-09-10T15:25:04.039637+0000","last_unstale":"2024-09-10T15:28:27.327810+0000","last_undegraded":"2024-09-10T15:28:27.327810+0000","last_fullsized":"2024-09-10T15:28:27.327810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:27.327624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:27.327624+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.327624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:21.069009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00074516700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.555470+0000","last_change":"2024-09-10T15:28:19.555531+0000","last_active":"2024-09-10T15:28:19.555470+0000","last_peered":"2024-09-10T15:28:19.555470+0000","last_clean":"2024-09-10T15:28:19.555470+0000","last_became_active":"2024-09-10T15:25:15.852612+0000","last_became_peered":"2024-09-10T15:25:15.852612+0000","last_unstale":"2024-09-10T15:28:19.555470+0000","last_undegraded":"2024-09-10T15:28:19.555470+0000","last_fullsized":"2024-09-10T15:28:19.555470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.555260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.555260+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.555260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.279245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"94'42","reported_seq":207,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.825700+0000","last_change":"2024-09-10T15:28:07.825818+0000","last_active":"2024-09-10T15:28:07.825700+0000","last_peered":"2024-09-10T15:28:07.825700+0000","last_clean":"2024-09-10T15:28:07.825700+0000","last_became_active":"2024-09-10T15:25:17.860103+0000","last_became_peered":"2024-09-10T15:25:17.860103+0000","last_unstale":"2024-09-10T15:28:07.825700+0000","last_undegraded":"2024-09-10T15:28:07.825700+0000","last_fullsized":"2024-09-10T15:28:07.825700+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'42","last_scrub_stamp":"2024-09-10T15:28:07.825515+0000","last_deep_scrub":"94'42","last_deep_scrub_stamp":"2024-09-10T15:28:07.825515+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.825515+0000","objects_scrubbed":8,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:25.897632+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":64,"num_read_kb":90,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.479570+0000","last_change":"2024-09-10T15:28:26.479628+0000","last_active":"2024-09-10T15:28:26.479570+0000","last_peered":"2024-09-10T15:28:26.479570+0000","last_clean":"2024-09-10T15:28:26.479570+0000","last_became_active":"2024-09-10T15:25:19.883520+0000","last_became_peered":"2024-09-10T15:25:19.883520+0000","last_unstale":"2024-09-10T15:28:26.479570+0000","last_undegraded":"2024-09-10T15:28:26.479570+0000","last_fullsized":"2024-09-10T15:28:26.479570+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:26.479384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:26.479384+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.479384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:35.158638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"76'6","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:39.263233+0000","last_change":"2024-09-10T15:28:39.263296+0000","last_active":"2024-09-10T15:28:39.263233+0000","last_peered":"2024-09-10T15:28:39.263233+0000","last_clean":"2024-09-10T15:28:39.263233+0000","last_became_active":"2024-09-10T15:25:21.896559+0000","last_became_peered":"2024-09-10T15:25:21.896559+0000","last_unstale":"2024-09-10T15:28:39.263233+0000","last_undegraded":"2024-09-10T15:28:39.263233+0000","last_fullsized":"2024-09-10T15:28:39.263233+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2024-09-10T15:28:39.263022+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2024-09-10T15:28:39.263022+0000","last_clean_scrub_stamp":"2024-09-10T15:28:39.263022+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:12.798293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.267721+0000","last_change":"2024-09-10T15:28:16.267802+0000","last_active":"2024-09-10T15:28:16.267721+0000","last_peered":"2024-09-10T15:28:16.267721+0000","last_clean":"2024-09-10T15:28:16.267721+0000","last_became_active":"2024-09-10T15:25:13.853073+0000","last_became_peered":"2024-09-10T15:25:13.853073+0000","last_unstale":"2024-09-10T15:28:16.267721+0000","last_undegraded":"2024-09-10T15:28:16.267721+0000","last_fullsized":"2024-09-10T15:28:16.267721+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.267507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.267507+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.267507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:48.314073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.288935+0000","last_change":"2024-09-10T15:28:21.288996+0000","last_active":"2024-09-10T15:28:21.288935+0000","last_peered":"2024-09-10T15:28:21.288935+0000","last_clean":"2024-09-10T15:28:21.288935+0000","last_became_active":"2024-09-10T15:25:11.854203+0000","last_became_peered":"2024-09-10T15:25:11.854203+0000","last_unstale":"2024-09-10T15:28:21.288935+0000","last_undegraded":"2024-09-10T15:28:21.288935+0000","last_fullsized":"2024-09-10T15:28:21.288935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:21.288727+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:21.288727+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.288727+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:01.501709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34828,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:37.361620+0000","last_change":"2024-09-10T15:28:37.361680+0000","last_active":"2024-09-10T15:28:37.361620+0000","last_peered":"2024-09-10T15:28:37.361620+0000","last_clean":"2024-09-10T15:28:37.361620+0000","last_became_active":"2024-09-10T15:25:03.526545+0000","last_became_peered":"2024-09-10T15:25:03.526545+0000","last_unstale":"2024-09-10T15:28:37.361620+0000","last_undegraded":"2024-09-10T15:28:37.361620+0000","last_fullsized":"2024-09-10T15:28:37.361620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:37.361424+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:37.361424+0000","last_clean_scrub_stamp":"2024-09-10T15:28:37.361424+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:24.458148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00087016299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.317978+0000","last_change":"2024-09-10T15:28:08.318036+0000","last_active":"2024-09-10T15:28:08.317978+0000","last_peered":"2024-09-10T15:28:08.317978+0000","last_clean":"2024-09-10T15:28:08.317978+0000","last_became_active":"2024-09-10T15:25:15.862780+0000","last_became_peered":"2024-09-10T15:25:15.862780+0000","last_unstale":"2024-09-10T15:28:08.317978+0000","last_undegraded":"2024-09-10T15:28:08.317978+0000","last_fullsized":"2024-09-10T15:28:08.317978+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.317783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.317783+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.317783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:43.508772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"94'21","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.336137+0000","last_change":"2024-09-10T15:28:26.336233+0000","last_active":"2024-09-10T15:28:26.336137+0000","last_peered":"2024-09-10T15:28:26.336137+0000","last_clean":"2024-09-10T15:28:26.336137+0000","last_became_active":"2024-09-10T15:25:17.872736+0000","last_became_peered":"2024-09-10T15:25:17.872736+0000","last_unstale":"2024-09-10T15:28:26.336137+0000","last_undegraded":"2024-09-10T15:28:26.336137+0000","last_fullsized":"2024-09-10T15:28:26.336137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'21","last_scrub_stamp":"2024-09-10T15:28:26.335919+0000","last_deep_scrub":"94'21","last_deep_scrub_stamp":"2024-09-10T15:28:26.335919+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.335919+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:11.594067+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"94'18","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.256042+0000","last_change":"2024-09-10T15:28:28.256105+0000","last_active":"2024-09-10T15:28:28.256042+0000","last_peered":"2024-09-10T15:28:28.256042+0000","last_clean":"2024-09-10T15:28:28.256042+0000","last_became_active":"2024-09-10T15:25:19.883772+0000","last_became_peered":"2024-09-10T15:25:19.883772+0000","last_unstale":"2024-09-10T15:28:28.256042+0000","last_undegraded":"2024-09-10T15:28:28.256042+0000","last_fullsized":"2024-09-10T15:28:28.256042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:28.255859+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:28.255859+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.255859+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:31.915459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.879894+0000","last_change":"2024-09-10T15:28:28.879949+0000","last_active":"2024-09-10T15:28:28.879894+0000","last_peered":"2024-09-10T15:28:28.879894+0000","last_clean":"2024-09-10T15:28:28.879894+0000","last_became_active":"2024-09-10T15:25:21.883193+0000","last_became_peered":"2024-09-10T15:25:21.883193+0000","last_unstale":"2024-09-10T15:28:28.879894+0000","last_undegraded":"2024-09-10T15:28:28.879894+0000","last_fullsized":"2024-09-10T15:28:28.879894+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.879705+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.879705+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.879705+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:21.393330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.614619+0000","last_change":"2024-09-10T15:28:14.614677+0000","last_active":"2024-09-10T15:28:14.614619+0000","last_peered":"2024-09-10T15:28:14.614619+0000","last_clean":"2024-09-10T15:28:14.614619+0000","last_became_active":"2024-09-10T15:25:13.845842+0000","last_became_peered":"2024-09-10T15:25:13.845842+0000","last_unstale":"2024-09-10T15:28:14.614619+0000","last_undegraded":"2024-09-10T15:28:14.614619+0000","last_fullsized":"2024-09-10T15:28:14.614619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.614427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.614427+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.614427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:05:07.754895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"94'20","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.599534+0000","last_change":"2024-09-10T15:28:32.599603+0000","last_active":"2024-09-10T15:28:32.599534+0000","last_peered":"2024-09-10T15:28:32.599534+0000","last_clean":"2024-09-10T15:28:32.599534+0000","last_became_active":"2024-09-10T15:25:11.849632+0000","last_became_peered":"2024-09-10T15:25:11.849632+0000","last_unstale":"2024-09-10T15:28:32.599534+0000","last_undegraded":"2024-09-10T15:28:32.599534+0000","last_fullsized":"2024-09-10T15:28:32.599534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:32.599347+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:32.599347+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.599347+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:32.100098+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":36876,"num_write":40,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.596651+0000","last_change":"2024-09-10T15:28:25.596703+0000","last_active":"2024-09-10T15:28:25.596651+0000","last_peered":"2024-09-10T15:28:25.596651+0000","last_clean":"2024-09-10T15:28:25.596651+0000","last_became_active":"2024-09-10T15:25:03.521369+0000","last_became_peered":"2024-09-10T15:25:03.521369+0000","last_unstale":"2024-09-10T15:28:25.596651+0000","last_undegraded":"2024-09-10T15:28:25.596651+0000","last_fullsized":"2024-09-10T15:28:25.596651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.596466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.596466+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.596466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:33.882185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00071986399999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.281806+0000","last_change":"2024-09-10T15:28:15.281864+0000","last_active":"2024-09-10T15:28:15.281806+0000","last_peered":"2024-09-10T15:28:15.281806+0000","last_clean":"2024-09-10T15:28:15.281806+0000","last_became_active":"2024-09-10T15:25:15.860391+0000","last_became_peered":"2024-09-10T15:25:15.860391+0000","last_unstale":"2024-09-10T15:28:15.281806+0000","last_undegraded":"2024-09-10T15:28:15.281806+0000","last_fullsized":"2024-09-10T15:28:15.281806+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.281594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.281594+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.281594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:23.291851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"94'15","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.158065+0000","last_change":"2024-09-10T15:28:08.158142+0000","last_active":"2024-09-10T15:28:08.158065+0000","last_peered":"2024-09-10T15:28:08.158065+0000","last_clean":"2024-09-10T15:28:08.158065+0000","last_became_active":"2024-09-10T15:25:17.860317+0000","last_became_peered":"2024-09-10T15:25:17.860317+0000","last_unstale":"2024-09-10T15:28:08.158065+0000","last_undegraded":"2024-09-10T15:28:08.158065+0000","last_fullsized":"2024-09-10T15:28:08.158065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'15","last_scrub_stamp":"2024-09-10T15:28:08.157860+0000","last_deep_scrub":"94'15","last_deep_scrub_stamp":"2024-09-10T15:28:08.157860+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.157860+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:11.817460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"94'18","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.446335+0000","last_change":"2024-09-10T15:28:05.446396+0000","last_active":"2024-09-10T15:28:05.446335+0000","last_peered":"2024-09-10T15:28:05.446335+0000","last_clean":"2024-09-10T15:28:05.446335+0000","last_became_active":"2024-09-10T15:25:19.887392+0000","last_became_peered":"2024-09-10T15:25:19.887392+0000","last_unstale":"2024-09-10T15:28:05.446335+0000","last_undegraded":"2024-09-10T15:28:05.446335+0000","last_fullsized":"2024-09-10T15:28:05.446335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:05.446121+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:05.446121+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.446121+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:08.178983+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:38.279013+0000","last_change":"2024-09-10T15:28:38.279069+0000","last_active":"2024-09-10T15:28:38.279013+0000","last_peered":"2024-09-10T15:28:38.279013+0000","last_clean":"2024-09-10T15:28:38.279013+0000","last_became_active":"2024-09-10T15:25:21.894932+0000","last_became_peered":"2024-09-10T15:25:21.894932+0000","last_unstale":"2024-09-10T15:28:38.279013+0000","last_undegraded":"2024-09-10T15:28:38.279013+0000","last_fullsized":"2024-09-10T15:28:38.279013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:38.278769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:38.278769+0000","last_clean_scrub_stamp":"2024-09-10T15:28:38.278769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:16:00.451633+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"76'80","reported_seq":237,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.489609+0000","last_change":"2024-09-10T15:28:11.489721+0000","last_active":"2024-09-10T15:28:11.489609+0000","last_peered":"2024-09-10T15:28:11.489609+0000","last_clean":"2024-09-10T15:28:11.489609+0000","last_became_active":"2024-09-10T15:25:13.840961+0000","last_became_peered":"2024-09-10T15:25:13.840961+0000","last_unstale":"2024-09-10T15:28:11.489609+0000","last_undegraded":"2024-09-10T15:28:11.489609+0000","last_fullsized":"2024-09-10T15:28:11.489609+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'80","last_scrub_stamp":"2024-09-10T15:28:11.489305+0000","last_deep_scrub":"76'80","last_deep_scrub_stamp":"2024-09-10T15:28:11.489305+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.489305+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:14.253517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":204,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"94'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.633994+0000","last_change":"2024-09-10T15:28:29.634052+0000","last_active":"2024-09-10T15:28:29.633994+0000","last_peered":"2024-09-10T15:28:29.633994+0000","last_clean":"2024-09-10T15:28:29.633994+0000","last_became_active":"2024-09-10T15:25:11.837731+0000","last_became_peered":"2024-09-10T15:25:11.837731+0000","last_unstale":"2024-09-10T15:28:29.633994+0000","last_undegraded":"2024-09-10T15:28:29.633994+0000","last_fullsized":"2024-09-10T15:28:29.633994+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:29.633771+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:29.633771+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.633771+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:37:41.123925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:36.393414+0000","last_change":"2024-09-10T15:28:36.393551+0000","last_active":"2024-09-10T15:28:36.393414+0000","last_peered":"2024-09-10T15:28:36.393414+0000","last_clean":"2024-09-10T15:28:36.393414+0000","last_became_active":"2024-09-10T15:25:03.525972+0000","last_became_peered":"2024-09-10T15:25:03.525972+0000","last_unstale":"2024-09-10T15:28:36.393414+0000","last_undegraded":"2024-09-10T15:28:36.393414+0000","last_fullsized":"2024-09-10T15:28:36.393414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:36.393126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:36.393126+0000","last_clean_scrub_stamp":"2024-09-10T15:28:36.393126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:32.453605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00086300000000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.570445+0000","last_change":"2024-09-10T15:28:15.570501+0000","last_active":"2024-09-10T15:28:15.570445+0000","last_peered":"2024-09-10T15:28:15.570445+0000","last_clean":"2024-09-10T15:28:15.570445+0000","last_became_active":"2024-09-10T15:25:15.850334+0000","last_became_peered":"2024-09-10T15:25:15.850334+0000","last_unstale":"2024-09-10T15:28:15.570445+0000","last_undegraded":"2024-09-10T15:28:15.570445+0000","last_fullsized":"2024-09-10T15:28:15.570445+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.570257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.570257+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.570257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:05.319691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"94'46","reported_seq":220,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.298198+0000","last_change":"2024-09-10T15:28:24.298277+0000","last_active":"2024-09-10T15:28:24.298198+0000","last_peered":"2024-09-10T15:28:24.298198+0000","last_clean":"2024-09-10T15:28:24.298198+0000","last_became_active":"2024-09-10T15:25:17.867117+0000","last_became_peered":"2024-09-10T15:25:17.867117+0000","last_unstale":"2024-09-10T15:28:24.298198+0000","last_undegraded":"2024-09-10T15:28:24.298198+0000","last_fullsized":"2024-09-10T15:28:24.298198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'46","last_scrub_stamp":"2024-09-10T15:28:24.297998+0000","last_deep_scrub":"94'46","last_deep_scrub_stamp":"2024-09-10T15:28:24.297998+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.297998+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:32.977252+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8302,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":73,"num_read_kb":94,"num_write":42,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:38.534520+0000","last_change":"2024-09-10T15:28:38.534574+0000","last_active":"2024-09-10T15:28:38.534520+0000","last_peered":"2024-09-10T15:28:38.534520+0000","last_clean":"2024-09-10T15:28:38.534520+0000","last_became_active":"2024-09-10T15:25:19.888640+0000","last_became_peered":"2024-09-10T15:25:19.888640+0000","last_unstale":"2024-09-10T15:28:38.534520+0000","last_undegraded":"2024-09-10T15:28:38.534520+0000","last_fullsized":"2024-09-10T15:28:38.534520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:38.534306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:38.534306+0000","last_clean_scrub_stamp":"2024-09-10T15:28:38.534306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:51.659697+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.433622+0000","last_change":"2024-09-10T15:28:28.433677+0000","last_active":"2024-09-10T15:28:28.433622+0000","last_peered":"2024-09-10T15:28:28.433622+0000","last_clean":"2024-09-10T15:28:28.433622+0000","last_became_active":"2024-09-10T15:25:21.885707+0000","last_became_peered":"2024-09-10T15:25:21.885707+0000","last_unstale":"2024-09-10T15:28:28.433622+0000","last_undegraded":"2024-09-10T15:28:28.433622+0000","last_fullsized":"2024-09-10T15:28:28.433622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:28.433429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:28.433429+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.433429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:29.152128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":138,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:39.582482+0000","last_change":"2024-09-10T15:28:39.582542+0000","last_active":"2024-09-10T15:28:39.582482+0000","last_peered":"2024-09-10T15:28:39.582482+0000","last_clean":"2024-09-10T15:28:39.582482+0000","last_became_active":"2024-09-10T15:25:21.896306+0000","last_became_peered":"2024-09-10T15:25:21.896306+0000","last_unstale":"2024-09-10T15:28:39.582482+0000","last_undegraded":"2024-09-10T15:28:39.582482+0000","last_fullsized":"2024-09-10T15:28:39.582482+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:39.582288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:39.582288+0000","last_clean_scrub_stamp":"2024-09-10T15:28:39.582288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:04:02.620284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.527560+0000","last_change":"2024-09-10T15:28:15.527614+0000","last_active":"2024-09-10T15:28:15.527560+0000","last_peered":"2024-09-10T15:28:15.527560+0000","last_clean":"2024-09-10T15:28:15.527560+0000","last_became_active":"2024-09-10T15:25:13.841121+0000","last_became_peered":"2024-09-10T15:25:13.841121+0000","last_unstale":"2024-09-10T15:28:15.527560+0000","last_undegraded":"2024-09-10T15:28:15.527560+0000","last_fullsized":"2024-09-10T15:28:15.527560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.527362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.527362+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.527362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:47.573929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.301220+0000","last_change":"2024-09-10T15:28:21.301351+0000","last_active":"2024-09-10T15:28:21.301220+0000","last_peered":"2024-09-10T15:28:21.301220+0000","last_clean":"2024-09-10T15:28:21.301220+0000","last_became_active":"2024-09-10T15:25:11.847225+0000","last_became_peered":"2024-09-10T15:25:11.847225+0000","last_unstale":"2024-09-10T15:28:21.301220+0000","last_undegraded":"2024-09-10T15:28:21.301220+0000","last_fullsized":"2024-09-10T15:28:21.301220+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:21.300929+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:21.300929+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.300929+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:07:59.989573+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":45068,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.208606+0000","last_change":"2024-09-10T15:28:07.208661+0000","last_active":"2024-09-10T15:28:07.208606+0000","last_peered":"2024-09-10T15:28:07.208606+0000","last_clean":"2024-09-10T15:28:07.208606+0000","last_became_active":"2024-09-10T15:25:15.854984+0000","last_became_peered":"2024-09-10T15:25:15.854984+0000","last_unstale":"2024-09-10T15:28:07.208606+0000","last_undegraded":"2024-09-10T15:28:07.208606+0000","last_fullsized":"2024-09-10T15:28:07.208606+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.208393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.208393+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.208393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:45.062690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"94'26","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.200051+0000","last_change":"2024-09-10T15:28:13.200199+0000","last_active":"2024-09-10T15:28:13.200051+0000","last_peered":"2024-09-10T15:28:13.200051+0000","last_clean":"2024-09-10T15:28:13.200051+0000","last_became_active":"2024-09-10T15:25:17.869179+0000","last_became_peered":"2024-09-10T15:25:17.869179+0000","last_unstale":"2024-09-10T15:28:13.200051+0000","last_undegraded":"2024-09-10T15:28:13.200051+0000","last_fullsized":"2024-09-10T15:28:13.200051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:13.199820+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:13.199820+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.199820+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:53.301663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":49,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.799437+0000","last_change":"2024-09-10T15:28:15.799494+0000","last_active":"2024-09-10T15:28:15.799437+0000","last_peered":"2024-09-10T15:28:15.799437+0000","last_clean":"2024-09-10T15:28:15.799437+0000","last_became_active":"2024-09-10T15:25:19.890429+0000","last_became_peered":"2024-09-10T15:25:19.890429+0000","last_unstale":"2024-09-10T15:28:15.799437+0000","last_undegraded":"2024-09-10T15:28:15.799437+0000","last_fullsized":"2024-09-10T15:28:15.799437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.799245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.799245+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.799245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:07.693788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.811454+0000","last_change":"2024-09-10T15:28:30.811507+0000","last_active":"2024-09-10T15:28:30.811454+0000","last_peered":"2024-09-10T15:28:30.811454+0000","last_clean":"2024-09-10T15:28:30.811454+0000","last_became_active":"2024-09-10T15:25:21.898138+0000","last_became_peered":"2024-09-10T15:25:21.898138+0000","last_unstale":"2024-09-10T15:28:30.811454+0000","last_undegraded":"2024-09-10T15:28:30.811454+0000","last_fullsized":"2024-09-10T15:28:30.811454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.811262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.811262+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.811262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:39.490517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"76'34","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.599277+0000","last_change":"2024-09-10T15:28:24.599336+0000","last_active":"2024-09-10T15:28:24.599277+0000","last_peered":"2024-09-10T15:28:24.599277+0000","last_clean":"2024-09-10T15:28:24.599277+0000","last_became_active":"2024-09-10T15:25:13.838584+0000","last_became_peered":"2024-09-10T15:25:13.838584+0000","last_unstale":"2024-09-10T15:28:24.599277+0000","last_undegraded":"2024-09-10T15:28:24.599277+0000","last_fullsized":"2024-09-10T15:28:24.599277+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'34","last_scrub_stamp":"2024-09-10T15:28:24.599078+0000","last_deep_scrub":"76'34","last_deep_scrub_stamp":"2024-09-10T15:28:24.599078+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.599078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:18:53.462459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"94'18","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.373604+0000","last_change":"2024-09-10T15:28:13.373663+0000","last_active":"2024-09-10T15:28:13.373604+0000","last_peered":"2024-09-10T15:28:13.373604+0000","last_clean":"2024-09-10T15:28:13.373604+0000","last_became_active":"2024-09-10T15:25:11.857140+0000","last_became_peered":"2024-09-10T15:25:11.857140+0000","last_unstale":"2024-09-10T15:28:13.373604+0000","last_undegraded":"2024-09-10T15:28:13.373604+0000","last_fullsized":"2024-09-10T15:28:13.373604+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:13.373405+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:13.373405+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.373405+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:02:59.338948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.524187+0000","last_change":"2024-09-10T15:28:17.524250+0000","last_active":"2024-09-10T15:28:17.524187+0000","last_peered":"2024-09-10T15:28:17.524187+0000","last_clean":"2024-09-10T15:28:17.524187+0000","last_became_active":"2024-09-10T15:25:15.852599+0000","last_became_peered":"2024-09-10T15:25:15.852599+0000","last_unstale":"2024-09-10T15:28:17.524187+0000","last_undegraded":"2024-09-10T15:28:17.524187+0000","last_fullsized":"2024-09-10T15:28:17.524187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.523948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.523948+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.523948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:54:02.782096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"94'8","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.700601+0000","last_change":"2024-09-10T15:28:08.700669+0000","last_active":"2024-09-10T15:28:08.700601+0000","last_peered":"2024-09-10T15:28:08.700601+0000","last_clean":"2024-09-10T15:28:08.700601+0000","last_became_active":"2024-09-10T15:25:17.864816+0000","last_became_peered":"2024-09-10T15:25:17.864816+0000","last_unstale":"2024-09-10T15:28:08.700601+0000","last_undegraded":"2024-09-10T15:28:08.700601+0000","last_fullsized":"2024-09-10T15:28:08.700601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:08.700414+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:08.700414+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.700414+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:03:13.046095+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.469901+0000","last_change":"2024-09-10T15:28:27.469954+0000","last_active":"2024-09-10T15:28:27.469901+0000","last_peered":"2024-09-10T15:28:27.469901+0000","last_clean":"2024-09-10T15:28:27.469901+0000","last_became_active":"2024-09-10T15:25:19.891594+0000","last_became_peered":"2024-09-10T15:25:19.891594+0000","last_unstale":"2024-09-10T15:28:27.469901+0000","last_undegraded":"2024-09-10T15:28:27.469901+0000","last_fullsized":"2024-09-10T15:28:27.469901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:27.469707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:27.469707+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.469707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:48.193692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.397496+0000","last_change":"2024-09-10T15:28:30.397615+0000","last_active":"2024-09-10T15:28:30.397496+0000","last_peered":"2024-09-10T15:28:30.397496+0000","last_clean":"2024-09-10T15:28:30.397496+0000","last_became_active":"2024-09-10T15:25:21.879876+0000","last_became_peered":"2024-09-10T15:25:21.879876+0000","last_unstale":"2024-09-10T15:28:30.397496+0000","last_undegraded":"2024-09-10T15:28:30.397496+0000","last_fullsized":"2024-09-10T15:28:30.397496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:30.397248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:30.397248+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.397248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:43.316210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.554589+0000","last_change":"2024-09-10T15:28:20.554641+0000","last_active":"2024-09-10T15:28:20.554589+0000","last_peered":"2024-09-10T15:28:20.554589+0000","last_clean":"2024-09-10T15:28:20.554589+0000","last_became_active":"2024-09-10T15:25:13.840924+0000","last_became_peered":"2024-09-10T15:25:13.840924+0000","last_unstale":"2024-09-10T15:28:20.554589+0000","last_undegraded":"2024-09-10T15:28:20.554589+0000","last_fullsized":"2024-09-10T15:28:20.554589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:20.554354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:20.554354+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.554354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:20:50.476162+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"94'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.522414+0000","last_change":"2024-09-10T15:28:18.522472+0000","last_active":"2024-09-10T15:28:18.522414+0000","last_peered":"2024-09-10T15:28:18.522414+0000","last_clean":"2024-09-10T15:28:18.522414+0000","last_became_active":"2024-09-10T15:25:11.838874+0000","last_became_peered":"2024-09-10T15:25:11.838874+0000","last_unstale":"2024-09-10T15:28:18.522414+0000","last_undegraded":"2024-09-10T15:28:18.522414+0000","last_fullsized":"2024-09-10T15:28:18.522414+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'10","last_scrub_stamp":"2024-09-10T15:28:18.522230+0000","last_deep_scrub":"94'10","last_deep_scrub_stamp":"2024-09-10T15:28:18.522230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.522230+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:20.065429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20486,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.407551+0000","last_change":"2024-09-10T15:28:06.407609+0000","last_active":"2024-09-10T15:28:06.407551+0000","last_peered":"2024-09-10T15:28:06.407551+0000","last_clean":"2024-09-10T15:28:06.407551+0000","last_became_active":"2024-09-10T15:25:15.851073+0000","last_became_peered":"2024-09-10T15:25:15.851073+0000","last_unstale":"2024-09-10T15:28:06.407551+0000","last_undegraded":"2024-09-10T15:28:06.407551+0000","last_fullsized":"2024-09-10T15:28:06.407551+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:06.407347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:06.407347+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.407347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:23.137819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"94'22","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.742879+0000","last_change":"2024-09-10T15:28:05.742964+0000","last_active":"2024-09-10T15:28:05.742879+0000","last_peered":"2024-09-10T15:28:05.742879+0000","last_clean":"2024-09-10T15:28:05.742879+0000","last_became_active":"2024-09-10T15:25:17.859551+0000","last_became_peered":"2024-09-10T15:25:17.859551+0000","last_unstale":"2024-09-10T15:28:05.742879+0000","last_undegraded":"2024-09-10T15:28:05.742879+0000","last_fullsized":"2024-09-10T15:28:05.742879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:05.742670+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:05.742670+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.742670+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:40:02.895762+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":143,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.206736+0000","last_change":"2024-09-10T15:28:27.206795+0000","last_active":"2024-09-10T15:28:27.206736+0000","last_peered":"2024-09-10T15:28:27.206736+0000","last_clean":"2024-09-10T15:28:27.206736+0000","last_became_active":"2024-09-10T15:25:19.883620+0000","last_became_peered":"2024-09-10T15:25:19.883620+0000","last_unstale":"2024-09-10T15:28:27.206736+0000","last_undegraded":"2024-09-10T15:28:27.206736+0000","last_fullsized":"2024-09-10T15:28:27.206736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:27.206515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:27.206515+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.206515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:40.125478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:47.330684+0000","last_change":"2024-09-10T15:28:47.330836+0000","last_active":"2024-09-10T15:28:47.330684+0000","last_peered":"2024-09-10T15:28:47.330684+0000","last_clean":"2024-09-10T15:28:47.330684+0000","last_became_active":"2024-09-10T15:25:21.885095+0000","last_became_peered":"2024-09-10T15:25:21.885095+0000","last_unstale":"2024-09-10T15:28:47.330684+0000","last_undegraded":"2024-09-10T15:28:47.330684+0000","last_fullsized":"2024-09-10T15:28:47.330684+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:47.330443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:47.330443+0000","last_clean_scrub_stamp":"2024-09-10T15:28:47.330443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:50:00.066922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.711513+0000","last_change":"2024-09-10T15:28:21.711566+0000","last_active":"2024-09-10T15:28:21.711513+0000","last_peered":"2024-09-10T15:28:21.711513+0000","last_clean":"2024-09-10T15:28:21.711513+0000","last_became_active":"2024-09-10T15:25:13.844209+0000","last_became_peered":"2024-09-10T15:25:13.844209+0000","last_unstale":"2024-09-10T15:28:21.711513+0000","last_undegraded":"2024-09-10T15:28:21.711513+0000","last_fullsized":"2024-09-10T15:28:21.711513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:21.711321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:21.711321+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.711321+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:13.521229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"94'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:30.318795+0000","last_change":"2024-09-10T15:28:30.318855+0000","last_active":"2024-09-10T15:28:30.318795+0000","last_peered":"2024-09-10T15:28:30.318795+0000","last_clean":"2024-09-10T15:28:30.318795+0000","last_became_active":"2024-09-10T15:25:11.848860+0000","last_became_peered":"2024-09-10T15:25:11.848860+0000","last_unstale":"2024-09-10T15:28:30.318795+0000","last_undegraded":"2024-09-10T15:28:30.318795+0000","last_fullsized":"2024-09-10T15:28:30.318795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:30.318614+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:30.318614+0000","last_clean_scrub_stamp":"2024-09-10T15:28:30.318614+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:19:38.328870+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":28696,"num_write":54,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.332560+0000","last_change":"2024-09-10T15:28:17.332613+0000","last_active":"2024-09-10T15:28:17.332560+0000","last_peered":"2024-09-10T15:28:17.332560+0000","last_clean":"2024-09-10T15:28:17.332560+0000","last_became_active":"2024-09-10T15:25:15.857817+0000","last_became_peered":"2024-09-10T15:25:15.857817+0000","last_unstale":"2024-09-10T15:28:17.332560+0000","last_undegraded":"2024-09-10T15:28:17.332560+0000","last_fullsized":"2024-09-10T15:28:17.332560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.332339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.332339+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.332339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:01.715610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"94'23","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.344733+0000","last_change":"2024-09-10T15:28:10.344885+0000","last_active":"2024-09-10T15:28:10.344733+0000","last_peered":"2024-09-10T15:28:10.344733+0000","last_clean":"2024-09-10T15:28:10.344733+0000","last_became_active":"2024-09-10T15:25:17.855699+0000","last_became_peered":"2024-09-10T15:25:17.855699+0000","last_unstale":"2024-09-10T15:28:10.344733+0000","last_undegraded":"2024-09-10T15:28:10.344733+0000","last_fullsized":"2024-09-10T15:28:10.344733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'23","last_scrub_stamp":"2024-09-10T15:28:10.344514+0000","last_deep_scrub":"94'23","last_deep_scrub_stamp":"2024-09-10T15:28:10.344514+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.344514+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:31.737059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:13.782014+0000","last_change":"2024-09-10T15:28:13.782073+0000","last_active":"2024-09-10T15:28:13.782014+0000","last_peered":"2024-09-10T15:28:13.782014+0000","last_clean":"2024-09-10T15:28:13.782014+0000","last_became_active":"2024-09-10T15:25:19.886758+0000","last_became_peered":"2024-09-10T15:25:19.886758+0000","last_unstale":"2024-09-10T15:28:13.782014+0000","last_undegraded":"2024-09-10T15:28:13.782014+0000","last_fullsized":"2024-09-10T15:28:13.782014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:13.781760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:13.781760+0000","last_clean_scrub_stamp":"2024-09-10T15:28:13.781760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:48.972749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.308004+0000","last_change":"2024-09-10T15:28:19.308056+0000","last_active":"2024-09-10T15:28:19.308004+0000","last_peered":"2024-09-10T15:28:19.308004+0000","last_clean":"2024-09-10T15:28:19.308004+0000","last_became_active":"2024-09-10T15:25:13.864291+0000","last_became_peered":"2024-09-10T15:25:13.864291+0000","last_unstale":"2024-09-10T15:28:19.308004+0000","last_undegraded":"2024-09-10T15:28:19.308004+0000","last_fullsized":"2024-09-10T15:28:19.308004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.307814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.307814+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.307814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:49:18.808566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"94'22","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.412069+0000","last_change":"2024-09-10T15:28:18.412131+0000","last_active":"2024-09-10T15:28:18.412069+0000","last_peered":"2024-09-10T15:28:18.412069+0000","last_clean":"2024-09-10T15:28:18.412069+0000","last_became_active":"2024-09-10T15:25:11.857713+0000","last_became_peered":"2024-09-10T15:25:11.857713+0000","last_unstale":"2024-09-10T15:28:18.412069+0000","last_undegraded":"2024-09-10T15:28:18.412069+0000","last_fullsized":"2024-09-10T15:28:18.412069+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:18.411860+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:18.411860+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.411860+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:10:27.091115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.302559+0000","last_change":"2024-09-10T15:28:09.302610+0000","last_active":"2024-09-10T15:28:09.302559+0000","last_peered":"2024-09-10T15:28:09.302559+0000","last_clean":"2024-09-10T15:28:09.302559+0000","last_became_active":"2024-09-10T15:25:15.859963+0000","last_became_peered":"2024-09-10T15:25:15.859963+0000","last_unstale":"2024-09-10T15:28:09.302559+0000","last_undegraded":"2024-09-10T15:28:09.302559+0000","last_fullsized":"2024-09-10T15:28:09.302559+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.302345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.302345+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.302345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:16.379652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"94'33","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.298898+0000","last_change":"2024-09-10T15:28:25.298972+0000","last_active":"2024-09-10T15:28:25.298898+0000","last_peered":"2024-09-10T15:28:25.298898+0000","last_clean":"2024-09-10T15:28:25.298898+0000","last_became_active":"2024-09-10T15:25:17.872121+0000","last_became_peered":"2024-09-10T15:25:17.872121+0000","last_unstale":"2024-09-10T15:28:25.298898+0000","last_undegraded":"2024-09-10T15:28:25.298898+0000","last_fullsized":"2024-09-10T15:28:25.298898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'33","last_scrub_stamp":"2024-09-10T15:28:25.298717+0000","last_deep_scrub":"94'33","last_deep_scrub_stamp":"2024-09-10T15:28:25.298717+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.298717+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:17.812343+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":76,"num_write":34,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.523425+0000","last_change":"2024-09-10T15:28:24.523530+0000","last_active":"2024-09-10T15:28:24.523425+0000","last_peered":"2024-09-10T15:28:24.523425+0000","last_clean":"2024-09-10T15:28:24.523425+0000","last_became_active":"2024-09-10T15:25:19.885121+0000","last_became_peered":"2024-09-10T15:25:19.885121+0000","last_unstale":"2024-09-10T15:28:24.523425+0000","last_undegraded":"2024-09-10T15:28:24.523425+0000","last_fullsized":"2024-09-10T15:28:24.523425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:24.523204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:24.523204+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.523204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:17.036830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:40.246594+0000","last_change":"2024-09-10T15:28:40.246649+0000","last_active":"2024-09-10T15:28:40.246594+0000","last_peered":"2024-09-10T15:28:40.246594+0000","last_clean":"2024-09-10T15:28:40.246594+0000","last_became_active":"2024-09-10T15:25:21.896663+0000","last_became_peered":"2024-09-10T15:25:21.896663+0000","last_unstale":"2024-09-10T15:28:40.246594+0000","last_undegraded":"2024-09-10T15:28:40.246594+0000","last_fullsized":"2024-09-10T15:28:40.246594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:40.246363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:40.246363+0000","last_clean_scrub_stamp":"2024-09-10T15:28:40.246363+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:53.371754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.570731+0000","last_change":"2024-09-10T15:28:16.570782+0000","last_active":"2024-09-10T15:28:16.570731+0000","last_peered":"2024-09-10T15:28:16.570731+0000","last_clean":"2024-09-10T15:28:16.570731+0000","last_became_active":"2024-09-10T15:25:13.842426+0000","last_became_peered":"2024-09-10T15:25:13.842426+0000","last_unstale":"2024-09-10T15:28:16.570731+0000","last_undegraded":"2024-09-10T15:28:16.570731+0000","last_fullsized":"2024-09-10T15:28:16.570731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:16.570520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:16.570520+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.570520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:47:40.436103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"94'22","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.602420+0000","last_change":"2024-09-10T15:28:31.602481+0000","last_active":"2024-09-10T15:28:31.602420+0000","last_peered":"2024-09-10T15:28:31.602420+0000","last_clean":"2024-09-10T15:28:31.602420+0000","last_became_active":"2024-09-10T15:25:11.838472+0000","last_became_peered":"2024-09-10T15:25:11.838472+0000","last_unstale":"2024-09-10T15:28:31.602420+0000","last_undegraded":"2024-09-10T15:28:31.602420+0000","last_fullsized":"2024-09-10T15:28:31.602420+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:31.602233+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:31.602233+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.602233+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:11:50.230609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38924,"num_write":42,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.533155+0000","last_change":"2024-09-10T15:28:12.533208+0000","last_active":"2024-09-10T15:28:12.533155+0000","last_peered":"2024-09-10T15:28:12.533155+0000","last_clean":"2024-09-10T15:28:12.533155+0000","last_became_active":"2024-09-10T15:25:15.867251+0000","last_became_peered":"2024-09-10T15:25:15.867251+0000","last_unstale":"2024-09-10T15:28:12.533155+0000","last_undegraded":"2024-09-10T15:28:12.533155+0000","last_fullsized":"2024-09-10T15:28:12.533155+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:12.532916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:12.532916+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.532916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:34:33.925461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"94'30","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.226795+0000","last_change":"2024-09-10T15:28:06.226877+0000","last_active":"2024-09-10T15:28:06.226795+0000","last_peered":"2024-09-10T15:28:06.226795+0000","last_clean":"2024-09-10T15:28:06.226795+0000","last_became_active":"2024-09-10T15:25:17.871512+0000","last_became_peered":"2024-09-10T15:25:17.871512+0000","last_unstale":"2024-09-10T15:28:06.226795+0000","last_undegraded":"2024-09-10T15:28:06.226795+0000","last_fullsized":"2024-09-10T15:28:06.226795+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:06.226556+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:06.226556+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.226556+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:33:06.945254+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:36.262359+0000","last_change":"2024-09-10T15:28:36.262415+0000","last_active":"2024-09-10T15:28:36.262359+0000","last_peered":"2024-09-10T15:28:36.262359+0000","last_clean":"2024-09-10T15:28:36.262359+0000","last_became_active":"2024-09-10T15:25:19.894325+0000","last_became_peered":"2024-09-10T15:25:19.894325+0000","last_unstale":"2024-09-10T15:28:36.262359+0000","last_undegraded":"2024-09-10T15:28:36.262359+0000","last_fullsized":"2024-09-10T15:28:36.262359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:36.262165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:36.262165+0000","last_clean_scrub_stamp":"2024-09-10T15:28:36.262165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:14.950810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:50.346415+0000","last_change":"2024-09-10T15:28:50.346469+0000","last_active":"2024-09-10T15:28:50.346415+0000","last_peered":"2024-09-10T15:28:50.346415+0000","last_clean":"2024-09-10T15:28:50.346415+0000","last_became_active":"2024-09-10T15:25:21.894914+0000","last_became_peered":"2024-09-10T15:25:21.894914+0000","last_unstale":"2024-09-10T15:28:50.346415+0000","last_undegraded":"2024-09-10T15:28:50.346415+0000","last_fullsized":"2024-09-10T15:28:50.346415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:50.346205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:50.346205+0000","last_clean_scrub_stamp":"2024-09-10T15:28:50.346205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:38:30.083604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"67'2","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.791411+0000","last_change":"2024-09-10T15:28:16.791472+0000","last_active":"2024-09-10T15:28:16.791411+0000","last_peered":"2024-09-10T15:28:16.791411+0000","last_clean":"2024-09-10T15:28:16.791411+0000","last_became_active":"2024-09-10T15:25:13.866313+0000","last_became_peered":"2024-09-10T15:25:13.866313+0000","last_unstale":"2024-09-10T15:28:16.791411+0000","last_undegraded":"2024-09-10T15:28:16.791411+0000","last_fullsized":"2024-09-10T15:28:16.791411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:16.791219+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:16.791219+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.791219+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:28:56.893061+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"94'12","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.207900+0000","last_change":"2024-09-10T15:28:22.207965+0000","last_active":"2024-09-10T15:28:22.207900+0000","last_peered":"2024-09-10T15:28:22.207900+0000","last_clean":"2024-09-10T15:28:22.207900+0000","last_became_active":"2024-09-10T15:25:11.846468+0000","last_became_peered":"2024-09-10T15:25:11.846468+0000","last_unstale":"2024-09-10T15:28:22.207900+0000","last_undegraded":"2024-09-10T15:28:22.207900+0000","last_fullsized":"2024-09-10T15:28:22.207900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:22.207680+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:22.207680+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.207680+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:21:14.721305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.527746+0000","last_change":"2024-09-10T15:28:10.527798+0000","last_active":"2024-09-10T15:28:10.527746+0000","last_peered":"2024-09-10T15:28:10.527746+0000","last_clean":"2024-09-10T15:28:10.527746+0000","last_became_active":"2024-09-10T15:25:15.865652+0000","last_became_peered":"2024-09-10T15:25:15.865652+0000","last_unstale":"2024-09-10T15:28:10.527746+0000","last_undegraded":"2024-09-10T15:28:10.527746+0000","last_fullsized":"2024-09-10T15:28:10.527746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.527550+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.527550+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.527550+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:45.718539+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"94'22","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.223025+0000","last_change":"2024-09-10T15:28:15.223094+0000","last_active":"2024-09-10T15:28:15.223025+0000","last_peered":"2024-09-10T15:28:15.223025+0000","last_clean":"2024-09-10T15:28:15.223025+0000","last_became_active":"2024-09-10T15:25:17.872114+0000","last_became_peered":"2024-09-10T15:25:17.872114+0000","last_unstale":"2024-09-10T15:28:15.223025+0000","last_undegraded":"2024-09-10T15:28:15.223025+0000","last_fullsized":"2024-09-10T15:28:15.223025+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:15.222819+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:15.222819+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.222819+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:01.188362+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.797589+0000","last_change":"2024-09-10T15:28:25.797643+0000","last_active":"2024-09-10T15:28:25.797589+0000","last_peered":"2024-09-10T15:28:25.797589+0000","last_clean":"2024-09-10T15:28:25.797589+0000","last_became_active":"2024-09-10T15:25:19.890979+0000","last_became_peered":"2024-09-10T15:25:19.890979+0000","last_unstale":"2024-09-10T15:28:25.797589+0000","last_undegraded":"2024-09-10T15:28:25.797589+0000","last_fullsized":"2024-09-10T15:28:25.797589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:25.797392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:25.797392+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.797392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:09.123393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:51.368389+0000","last_change":"2024-09-10T15:28:51.368447+0000","last_active":"2024-09-10T15:28:51.368389+0000","last_peered":"2024-09-10T15:28:51.368389+0000","last_clean":"2024-09-10T15:28:51.368389+0000","last_became_active":"2024-09-10T15:25:21.896779+0000","last_became_peered":"2024-09-10T15:25:21.896779+0000","last_unstale":"2024-09-10T15:28:51.368389+0000","last_undegraded":"2024-09-10T15:28:51.368389+0000","last_fullsized":"2024-09-10T15:28:51.368389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:51.368151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:51.368151+0000","last_clean_scrub_stamp":"2024-09-10T15:28:51.368151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:58:57.215911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"67'6","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.606650+0000","last_change":"2024-09-10T15:28:12.606711+0000","last_active":"2024-09-10T15:28:12.606650+0000","last_peered":"2024-09-10T15:28:12.606650+0000","last_clean":"2024-09-10T15:28:12.606650+0000","last_became_active":"2024-09-10T15:25:13.854758+0000","last_became_peered":"2024-09-10T15:25:13.854758+0000","last_unstale":"2024-09-10T15:28:12.606650+0000","last_undegraded":"2024-09-10T15:28:12.606650+0000","last_fullsized":"2024-09-10T15:28:12.606650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:12.606456+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:12.606456+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.606456+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:01:52.819438+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"94'26","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.632163+0000","last_change":"2024-09-10T15:28:28.632226+0000","last_active":"2024-09-10T15:28:28.632163+0000","last_peered":"2024-09-10T15:28:28.632163+0000","last_clean":"2024-09-10T15:28:28.632163+0000","last_became_active":"2024-09-10T15:25:11.833881+0000","last_became_peered":"2024-09-10T15:25:11.833881+0000","last_unstale":"2024-09-10T15:28:28.632163+0000","last_undegraded":"2024-09-10T15:28:28.632163+0000","last_fullsized":"2024-09-10T15:28:28.632163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:28.631967+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:28.631967+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.631967+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:57:58.389610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47122,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"94'2","reported_seq":163,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.609951+0000","last_change":"2024-09-10T15:28:11.610023+0000","last_active":"2024-09-10T15:28:11.609951+0000","last_peered":"2024-09-10T15:28:11.609951+0000","last_clean":"2024-09-10T15:28:11.609951+0000","last_became_active":"2024-09-10T15:25:15.847840+0000","last_became_peered":"2024-09-10T15:25:15.847840+0000","last_unstale":"2024-09-10T15:28:11.609951+0000","last_undegraded":"2024-09-10T15:28:11.609951+0000","last_fullsized":"2024-09-10T15:28:11.609951+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:11.609746+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:11.609746+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.609746+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:15.517396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"94'18","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.194858+0000","last_change":"2024-09-10T15:28:04.194896+0000","last_active":"2024-09-10T15:28:04.194858+0000","last_peered":"2024-09-10T15:28:04.194858+0000","last_clean":"2024-09-10T15:28:04.194858+0000","last_became_active":"2024-09-10T15:25:17.871561+0000","last_became_peered":"2024-09-10T15:25:17.871561+0000","last_unstale":"2024-09-10T15:28:04.194858+0000","last_undegraded":"2024-09-10T15:28:04.194858+0000","last_fullsized":"2024-09-10T15:28:04.194858+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:04.194769+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:04.194769+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.194769+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:32:48.602958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":770,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"94'18","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.270843+0000","last_change":"2024-09-10T15:28:25.271006+0000","last_active":"2024-09-10T15:28:25.270843+0000","last_peered":"2024-09-10T15:28:25.270843+0000","last_clean":"2024-09-10T15:28:25.270843+0000","last_became_active":"2024-09-10T15:25:19.891476+0000","last_became_peered":"2024-09-10T15:25:19.891476+0000","last_unstale":"2024-09-10T15:28:25.270843+0000","last_undegraded":"2024-09-10T15:28:25.270843+0000","last_fullsized":"2024-09-10T15:28:25.270843+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:25.270614+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:25.270614+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.270614+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:58:40.023750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:49.333754+0000","last_change":"2024-09-10T15:28:49.333836+0000","last_active":"2024-09-10T15:28:49.333754+0000","last_peered":"2024-09-10T15:28:49.333754+0000","last_clean":"2024-09-10T15:28:49.333754+0000","last_became_active":"2024-09-10T15:25:21.894735+0000","last_became_peered":"2024-09-10T15:25:21.894735+0000","last_unstale":"2024-09-10T15:28:49.333754+0000","last_undegraded":"2024-09-10T15:28:49.333754+0000","last_fullsized":"2024-09-10T15:28:49.333754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:49.333480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:49.333480+0000","last_clean_scrub_stamp":"2024-09-10T15:28:49.333480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:43:23.232501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:04.345798+0000","last_change":"2024-09-10T15:28:04.345846+0000","last_active":"2024-09-10T15:28:04.345798+0000","last_peered":"2024-09-10T15:28:04.345798+0000","last_clean":"2024-09-10T15:28:04.345798+0000","last_became_active":"2024-09-10T15:25:13.859974+0000","last_became_peered":"2024-09-10T15:25:13.859974+0000","last_unstale":"2024-09-10T15:28:04.345798+0000","last_undegraded":"2024-09-10T15:28:04.345798+0000","last_fullsized":"2024-09-10T15:28:04.345798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:04.345669+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:04.345669+0000","last_clean_scrub_stamp":"2024-09-10T15:28:04.345669+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:31:22.417786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"94'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.292588+0000","last_change":"2024-09-10T15:28:20.292654+0000","last_active":"2024-09-10T15:28:20.292588+0000","last_peered":"2024-09-10T15:28:20.292588+0000","last_clean":"2024-09-10T15:28:20.292588+0000","last_became_active":"2024-09-10T15:25:11.834702+0000","last_became_peered":"2024-09-10T15:25:11.834702+0000","last_unstale":"2024-09-10T15:28:20.292588+0000","last_undegraded":"2024-09-10T15:28:20.292588+0000","last_fullsized":"2024-09-10T15:28:20.292588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:20.292391+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:20.292391+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.292391+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:34:10.695700+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.341356+0000","last_change":"2024-09-10T15:28:08.341408+0000","last_active":"2024-09-10T15:28:08.341356+0000","last_peered":"2024-09-10T15:28:08.341356+0000","last_clean":"2024-09-10T15:28:08.341356+0000","last_became_active":"2024-09-10T15:25:15.853635+0000","last_became_peered":"2024-09-10T15:25:15.853635+0000","last_unstale":"2024-09-10T15:28:08.341356+0000","last_undegraded":"2024-09-10T15:28:08.341356+0000","last_fullsized":"2024-09-10T15:28:08.341356+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.341166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.341166+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.341166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:11.105377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"94'30","reported_seq":189,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.349890+0000","last_change":"2024-09-10T15:28:12.349970+0000","last_active":"2024-09-10T15:28:12.349890+0000","last_peered":"2024-09-10T15:28:12.349890+0000","last_clean":"2024-09-10T15:28:12.349890+0000","last_became_active":"2024-09-10T15:25:17.865548+0000","last_became_peered":"2024-09-10T15:25:17.865548+0000","last_unstale":"2024-09-10T15:28:12.349890+0000","last_undegraded":"2024-09-10T15:28:12.349890+0000","last_fullsized":"2024-09-10T15:28:12.349890+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:12.349697+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:12.349697+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.349697+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:24.394448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:34.539504+0000","last_change":"2024-09-10T15:28:34.539558+0000","last_active":"2024-09-10T15:28:34.539504+0000","last_peered":"2024-09-10T15:28:34.539504+0000","last_clean":"2024-09-10T15:28:34.539504+0000","last_became_active":"2024-09-10T15:25:19.869101+0000","last_became_peered":"2024-09-10T15:25:19.869101+0000","last_unstale":"2024-09-10T15:28:34.539504+0000","last_undegraded":"2024-09-10T15:28:34.539504+0000","last_fullsized":"2024-09-10T15:28:34.539504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:34.539306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:34.539306+0000","last_clean_scrub_stamp":"2024-09-10T15:28:34.539306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:08:13.227951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:33.192762+0000","last_change":"2024-09-10T15:28:33.192908+0000","last_active":"2024-09-10T15:28:33.192762+0000","last_peered":"2024-09-10T15:28:33.192762+0000","last_clean":"2024-09-10T15:28:33.192762+0000","last_became_active":"2024-09-10T15:25:21.903823+0000","last_became_peered":"2024-09-10T15:25:21.903823+0000","last_unstale":"2024-09-10T15:28:33.192762+0000","last_undegraded":"2024-09-10T15:28:33.192762+0000","last_fullsized":"2024-09-10T15:28:33.192762+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:33.192546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:33.192546+0000","last_clean_scrub_stamp":"2024-09-10T15:28:33.192546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:02.419640+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.384920+0000","last_change":"2024-09-10T15:28:05.384942+0000","last_active":"2024-09-10T15:28:05.384920+0000","last_peered":"2024-09-10T15:28:05.384920+0000","last_clean":"2024-09-10T15:28:05.384920+0000","last_became_active":"2024-09-10T15:25:13.854593+0000","last_became_peered":"2024-09-10T15:25:13.854593+0000","last_unstale":"2024-09-10T15:28:05.384920+0000","last_undegraded":"2024-09-10T15:28:05.384920+0000","last_fullsized":"2024-09-10T15:28:05.384920+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:05.384839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:05.384839+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.384839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:41.540594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"94'14","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:35.358109+0000","last_change":"2024-09-10T15:28:35.358170+0000","last_active":"2024-09-10T15:28:35.358109+0000","last_peered":"2024-09-10T15:28:35.358109+0000","last_clean":"2024-09-10T15:28:35.358109+0000","last_became_active":"2024-09-10T15:25:11.843523+0000","last_became_peered":"2024-09-10T15:25:11.843523+0000","last_unstale":"2024-09-10T15:28:35.358109+0000","last_undegraded":"2024-09-10T15:28:35.358109+0000","last_fullsized":"2024-09-10T15:28:35.358109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:35.357917+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:35.357917+0000","last_clean_scrub_stamp":"2024-09-10T15:28:35.357917+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:12:09.245552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":24594,"num_write":44,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":147,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:08.470384+0000","last_change":"2024-09-10T15:28:08.470502+0000","last_active":"2024-09-10T15:28:08.470384+0000","last_peered":"2024-09-10T15:28:08.470384+0000","last_clean":"2024-09-10T15:28:08.470384+0000","last_became_active":"2024-09-10T15:25:15.861910+0000","last_became_peered":"2024-09-10T15:25:15.861910+0000","last_unstale":"2024-09-10T15:28:08.470384+0000","last_undegraded":"2024-09-10T15:28:08.470384+0000","last_fullsized":"2024-09-10T15:28:08.470384+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:08.470147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:08.470147+0000","last_clean_scrub_stamp":"2024-09-10T15:28:08.470147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:17.894119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"94'22","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.726092+0000","last_change":"2024-09-10T15:28:06.726180+0000","last_active":"2024-09-10T15:28:06.726092+0000","last_peered":"2024-09-10T15:28:06.726092+0000","last_clean":"2024-09-10T15:28:06.726092+0000","last_became_active":"2024-09-10T15:25:17.865936+0000","last_became_peered":"2024-09-10T15:25:17.865936+0000","last_unstale":"2024-09-10T15:28:06.726092+0000","last_undegraded":"2024-09-10T15:28:06.726092+0000","last_fullsized":"2024-09-10T15:28:06.726092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:06.725874+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:06.725874+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.725874+0000","objects_scrubbed":4,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:18.770624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":34,"num_read_kb":47,"num_write":22,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:45.362784+0000","last_change":"2024-09-10T15:28:45.362846+0000","last_active":"2024-09-10T15:28:45.362784+0000","last_peered":"2024-09-10T15:28:45.362784+0000","last_clean":"2024-09-10T15:28:45.362784+0000","last_became_active":"2024-09-10T15:25:19.886761+0000","last_became_peered":"2024-09-10T15:25:19.886761+0000","last_unstale":"2024-09-10T15:28:45.362784+0000","last_undegraded":"2024-09-10T15:28:45.362784+0000","last_fullsized":"2024-09-10T15:28:45.362784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:45.362563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:45.362563+0000","last_clean_scrub_stamp":"2024-09-10T15:28:45.362563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:41:55.538178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"67'2","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:42.167087+0000","last_change":"2024-09-10T15:28:42.167148+0000","last_active":"2024-09-10T15:28:42.167087+0000","last_peered":"2024-09-10T15:28:42.167087+0000","last_clean":"2024-09-10T15:28:42.167087+0000","last_became_active":"2024-09-10T15:25:21.899551+0000","last_became_peered":"2024-09-10T15:25:21.899551+0000","last_unstale":"2024-09-10T15:28:42.167087+0000","last_undegraded":"2024-09-10T15:28:42.167087+0000","last_fullsized":"2024-09-10T15:28:42.167087+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:42.166888+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:42.166888+0000","last_clean_scrub_stamp":"2024-09-10T15:28:42.166888+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:35:49.349557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"67'2","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.711119+0000","last_change":"2024-09-10T15:28:22.711182+0000","last_active":"2024-09-10T15:28:22.711119+0000","last_peered":"2024-09-10T15:28:22.711119+0000","last_clean":"2024-09-10T15:28:22.711119+0000","last_became_active":"2024-09-10T15:25:13.854923+0000","last_became_peered":"2024-09-10T15:25:13.854923+0000","last_unstale":"2024-09-10T15:28:22.711119+0000","last_undegraded":"2024-09-10T15:28:22.711119+0000","last_fullsized":"2024-09-10T15:28:22.711119+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'2","last_scrub_stamp":"2024-09-10T15:28:22.710926+0000","last_deep_scrub":"67'2","last_deep_scrub_stamp":"2024-09-10T15:28:22.710926+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.710926+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:24.254126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"94'12","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.327375+0000","last_change":"2024-09-10T15:28:31.327432+0000","last_active":"2024-09-10T15:28:31.327375+0000","last_peered":"2024-09-10T15:28:31.327375+0000","last_clean":"2024-09-10T15:28:31.327375+0000","last_became_active":"2024-09-10T15:25:11.849491+0000","last_became_peered":"2024-09-10T15:25:11.849491+0000","last_unstale":"2024-09-10T15:28:31.327375+0000","last_undegraded":"2024-09-10T15:28:31.327375+0000","last_fullsized":"2024-09-10T15:28:31.327375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:31.327190+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:31.327190+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.327190+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:45:24.595594+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22540,"num_write":32,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"94'2","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:06.362550+0000","last_change":"2024-09-10T15:28:06.362631+0000","last_active":"2024-09-10T15:28:06.362550+0000","last_peered":"2024-09-10T15:28:06.362550+0000","last_clean":"2024-09-10T15:28:06.362550+0000","last_became_active":"2024-09-10T15:25:15.852217+0000","last_became_peered":"2024-09-10T15:25:15.852217+0000","last_unstale":"2024-09-10T15:28:06.362550+0000","last_undegraded":"2024-09-10T15:28:06.362550+0000","last_fullsized":"2024-09-10T15:28:06.362550+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:06.362369+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:06.362369+0000","last_clean_scrub_stamp":"2024-09-10T15:28:06.362369+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:13.439676+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"94'18","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.255748+0000","last_change":"2024-09-10T15:28:11.255817+0000","last_active":"2024-09-10T15:28:11.255748+0000","last_peered":"2024-09-10T15:28:11.255748+0000","last_clean":"2024-09-10T15:28:11.255748+0000","last_became_active":"2024-09-10T15:25:17.863327+0000","last_became_peered":"2024-09-10T15:25:17.863327+0000","last_unstale":"2024-09-10T15:28:11.255748+0000","last_undegraded":"2024-09-10T15:28:11.255748+0000","last_fullsized":"2024-09-10T15:28:11.255748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:11.255531+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:11.255531+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.255531+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:14.019743+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":65,"num_write":22,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.171492+0000","last_change":"2024-09-10T15:28:10.171544+0000","last_active":"2024-09-10T15:28:10.171492+0000","last_peered":"2024-09-10T15:28:10.171492+0000","last_clean":"2024-09-10T15:28:10.171492+0000","last_became_active":"2024-09-10T15:25:19.883301+0000","last_became_peered":"2024-09-10T15:25:19.883301+0000","last_unstale":"2024-09-10T15:28:10.171492+0000","last_undegraded":"2024-09-10T15:28:10.171492+0000","last_fullsized":"2024-09-10T15:28:10.171492+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.171291+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.171291+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.171291+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:05:42.166255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:48.376723+0000","last_change":"2024-09-10T15:28:48.376776+0000","last_active":"2024-09-10T15:28:48.376723+0000","last_peered":"2024-09-10T15:28:48.376723+0000","last_clean":"2024-09-10T15:28:48.376723+0000","last_became_active":"2024-09-10T15:25:21.885203+0000","last_became_peered":"2024-09-10T15:25:21.885203+0000","last_unstale":"2024-09-10T15:28:48.376723+0000","last_undegraded":"2024-09-10T15:28:48.376723+0000","last_fullsized":"2024-09-10T15:28:48.376723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:48.376527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:48.376527+0000","last_clean_scrub_stamp":"2024-09-10T15:28:48.376527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:19:11.067083+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.457308+0000","last_change":"2024-09-10T15:28:07.457361+0000","last_active":"2024-09-10T15:28:07.457308+0000","last_peered":"2024-09-10T15:28:07.457308+0000","last_clean":"2024-09-10T15:28:07.457308+0000","last_became_active":"2024-09-10T15:25:13.842304+0000","last_became_peered":"2024-09-10T15:25:13.842304+0000","last_unstale":"2024-09-10T15:28:07.457308+0000","last_undegraded":"2024-09-10T15:28:07.457308+0000","last_fullsized":"2024-09-10T15:28:07.457308+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.457108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.457108+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.457108+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:48:45.311405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"94'14","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.278582+0000","last_change":"2024-09-10T15:28:32.278639+0000","last_active":"2024-09-10T15:28:32.278582+0000","last_peered":"2024-09-10T15:28:32.278582+0000","last_clean":"2024-09-10T15:28:32.278582+0000","last_became_active":"2024-09-10T15:25:11.849005+0000","last_became_peered":"2024-09-10T15:25:11.849005+0000","last_unstale":"2024-09-10T15:28:32.278582+0000","last_undegraded":"2024-09-10T15:28:32.278582+0000","last_fullsized":"2024-09-10T15:28:32.278582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:32.278389+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:32.278389+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.278389+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T20:33:16.661660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"94'2","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:21.567698+0000","last_change":"2024-09-10T15:28:21.567764+0000","last_active":"2024-09-10T15:28:21.567698+0000","last_peered":"2024-09-10T15:28:21.567698+0000","last_clean":"2024-09-10T15:28:21.567698+0000","last_became_active":"2024-09-10T15:25:15.860200+0000","last_became_peered":"2024-09-10T15:25:15.860200+0000","last_unstale":"2024-09-10T15:28:21.567698+0000","last_undegraded":"2024-09-10T15:28:21.567698+0000","last_fullsized":"2024-09-10T15:28:21.567698+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'2","last_scrub_stamp":"2024-09-10T15:28:21.567500+0000","last_deep_scrub":"94'2","last_deep_scrub_stamp":"2024-09-10T15:28:21.567500+0000","last_clean_scrub_stamp":"2024-09-10T15:28:21.567500+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:25.227099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"94'20","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.185943+0000","last_change":"2024-09-10T15:28:09.186040+0000","last_active":"2024-09-10T15:28:09.185943+0000","last_peered":"2024-09-10T15:28:09.185943+0000","last_clean":"2024-09-10T15:28:09.185943+0000","last_became_active":"2024-09-10T15:25:17.858379+0000","last_became_peered":"2024-09-10T15:25:17.858379+0000","last_unstale":"2024-09-10T15:28:09.185943+0000","last_undegraded":"2024-09-10T15:28:09.185943+0000","last_fullsized":"2024-09-10T15:28:09.185943+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:09.185740+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:09.185740+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.185740+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:41:04.655249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":142,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:36.493632+0000","last_change":"2024-09-10T15:28:36.493685+0000","last_active":"2024-09-10T15:28:36.493632+0000","last_peered":"2024-09-10T15:28:36.493632+0000","last_clean":"2024-09-10T15:28:36.493632+0000","last_became_active":"2024-09-10T15:25:19.886035+0000","last_became_peered":"2024-09-10T15:25:19.886035+0000","last_unstale":"2024-09-10T15:28:36.493632+0000","last_undegraded":"2024-09-10T15:28:36.493632+0000","last_fullsized":"2024-09-10T15:28:36.493632+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:36.493428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:36.493428+0000","last_clean_scrub_stamp":"2024-09-10T15:28:36.493428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:58.666292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"76'2","reported_seq":140,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:27.280925+0000","last_change":"2024-09-10T15:28:27.280991+0000","last_active":"2024-09-10T15:28:27.280925+0000","last_peered":"2024-09-10T15:28:27.280925+0000","last_clean":"2024-09-10T15:28:27.280925+0000","last_became_active":"2024-09-10T15:25:21.897491+0000","last_became_peered":"2024-09-10T15:25:21.897491+0000","last_unstale":"2024-09-10T15:28:27.280925+0000","last_undegraded":"2024-09-10T15:28:27.280925+0000","last_fullsized":"2024-09-10T15:28:27.280925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2024-09-10T15:28:27.280695+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2024-09-10T15:28:27.280695+0000","last_clean_scrub_stamp":"2024-09-10T15:28:27.280695+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:40.199658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.556659+0000","last_change":"2024-09-10T15:28:22.556714+0000","last_active":"2024-09-10T15:28:22.556659+0000","last_peered":"2024-09-10T15:28:22.556659+0000","last_clean":"2024-09-10T15:28:22.556659+0000","last_became_active":"2024-09-10T15:25:13.838632+0000","last_became_peered":"2024-09-10T15:25:13.838632+0000","last_unstale":"2024-09-10T15:28:22.556659+0000","last_undegraded":"2024-09-10T15:28:22.556659+0000","last_fullsized":"2024-09-10T15:28:22.556659+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:22.556457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:22.556457+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.556457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:44:53.008242+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"94'16","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.480197+0000","last_change":"2024-09-10T15:28:20.480255+0000","last_active":"2024-09-10T15:28:20.480197+0000","last_peered":"2024-09-10T15:28:20.480197+0000","last_clean":"2024-09-10T15:28:20.480197+0000","last_became_active":"2024-09-10T15:25:11.846760+0000","last_became_peered":"2024-09-10T15:25:11.846760+0000","last_unstale":"2024-09-10T15:28:20.480197+0000","last_undegraded":"2024-09-10T15:28:20.480197+0000","last_fullsized":"2024-09-10T15:28:20.480197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:20.480004+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:20.480004+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.480004+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:00.692986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:14.830048+0000","last_change":"2024-09-10T15:28:14.830105+0000","last_active":"2024-09-10T15:28:14.830048+0000","last_peered":"2024-09-10T15:28:14.830048+0000","last_clean":"2024-09-10T15:28:14.830048+0000","last_became_active":"2024-09-10T15:25:13.868081+0000","last_became_peered":"2024-09-10T15:25:13.868081+0000","last_unstale":"2024-09-10T15:28:14.830048+0000","last_undegraded":"2024-09-10T15:28:14.830048+0000","last_fullsized":"2024-09-10T15:28:14.830048+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:14.829829+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:14.829829+0000","last_clean_scrub_stamp":"2024-09-10T15:28:14.829829+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:17.594040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"94'6","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.787268+0000","last_change":"2024-09-10T15:28:18.787333+0000","last_active":"2024-09-10T15:28:18.787268+0000","last_peered":"2024-09-10T15:28:18.787268+0000","last_clean":"2024-09-10T15:28:18.787268+0000","last_became_active":"2024-09-10T15:25:11.833286+0000","last_became_peered":"2024-09-10T15:25:11.833286+0000","last_unstale":"2024-09-10T15:28:18.787268+0000","last_undegraded":"2024-09-10T15:28:18.787268+0000","last_fullsized":"2024-09-10T15:28:18.787268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'6","last_scrub_stamp":"2024-09-10T15:28:18.787079+0000","last_deep_scrub":"94'6","last_deep_scrub_stamp":"2024-09-10T15:28:18.787079+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.787079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:03:04.752621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":152,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:32.398023+0000","last_change":"2024-09-10T15:28:32.398078+0000","last_active":"2024-09-10T15:28:32.398023+0000","last_peered":"2024-09-10T15:28:32.398023+0000","last_clean":"2024-09-10T15:28:32.398023+0000","last_became_active":"2024-09-10T15:25:13.844829+0000","last_became_peered":"2024-09-10T15:25:13.844829+0000","last_unstale":"2024-09-10T15:28:32.398023+0000","last_undegraded":"2024-09-10T15:28:32.398023+0000","last_fullsized":"2024-09-10T15:28:32.398023+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:32.397824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:32.397824+0000","last_clean_scrub_stamp":"2024-09-10T15:28:32.397824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T15:36:28.098101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"94'22","reported_seq":191,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:25.322946+0000","last_change":"2024-09-10T15:28:25.323089+0000","last_active":"2024-09-10T15:28:25.322946+0000","last_peered":"2024-09-10T15:28:25.322946+0000","last_clean":"2024-09-10T15:28:25.322946+0000","last_became_active":"2024-09-10T15:25:11.846464+0000","last_became_peered":"2024-09-10T15:25:11.846464+0000","last_unstale":"2024-09-10T15:28:25.322946+0000","last_undegraded":"2024-09-10T15:28:25.322946+0000","last_fullsized":"2024-09-10T15:28:25.322946+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'22","last_scrub_stamp":"2024-09-10T15:28:25.322723+0000","last_deep_scrub":"94'22","last_deep_scrub_stamp":"2024-09-10T15:28:25.322723+0000","last_clean_scrub_stamp":"2024-09-10T15:28:25.322723+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:38.448114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":43020,"num_write":42,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.404835+0000","last_change":"2024-09-10T15:28:19.404885+0000","last_active":"2024-09-10T15:28:19.404835+0000","last_peered":"2024-09-10T15:28:19.404835+0000","last_clean":"2024-09-10T15:28:19.404835+0000","last_became_active":"2024-09-10T15:25:13.867849+0000","last_became_peered":"2024-09-10T15:25:13.867849+0000","last_unstale":"2024-09-10T15:28:19.404835+0000","last_undegraded":"2024-09-10T15:28:19.404835+0000","last_fullsized":"2024-09-10T15:28:19.404835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:19.404642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:19.404642+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.404642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:39:40.128627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"94'26","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:28.343029+0000","last_change":"2024-09-10T15:28:28.343087+0000","last_active":"2024-09-10T15:28:28.343029+0000","last_peered":"2024-09-10T15:28:28.343029+0000","last_clean":"2024-09-10T15:28:28.343029+0000","last_became_active":"2024-09-10T15:25:11.845728+0000","last_became_peered":"2024-09-10T15:25:11.845728+0000","last_unstale":"2024-09-10T15:28:28.343029+0000","last_undegraded":"2024-09-10T15:28:28.343029+0000","last_fullsized":"2024-09-10T15:28:28.343029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'26","last_scrub_stamp":"2024-09-10T15:28:28.342849+0000","last_deep_scrub":"94'26","last_deep_scrub_stamp":"2024-09-10T15:28:28.342849+0000","last_clean_scrub_stamp":"2024-09-10T15:28:28.342849+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:25:29.769035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":51212,"num_write":46,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.462630+0000","last_change":"2024-09-10T15:28:11.462804+0000","last_active":"2024-09-10T15:28:11.462630+0000","last_peered":"2024-09-10T15:28:11.462630+0000","last_clean":"2024-09-10T15:28:11.462630+0000","last_became_active":"2024-09-10T15:25:13.865940+0000","last_became_peered":"2024-09-10T15:25:13.865940+0000","last_unstale":"2024-09-10T15:28:11.462630+0000","last_undegraded":"2024-09-10T15:28:11.462630+0000","last_fullsized":"2024-09-10T15:28:11.462630+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:11.462398+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:11.462398+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.462398+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:13.005598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"94'24","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.248422+0000","last_change":"2024-09-10T15:28:19.248484+0000","last_active":"2024-09-10T15:28:19.248422+0000","last_peered":"2024-09-10T15:28:19.248422+0000","last_clean":"2024-09-10T15:28:19.248422+0000","last_became_active":"2024-09-10T15:25:11.842026+0000","last_became_peered":"2024-09-10T15:25:11.842026+0000","last_unstale":"2024-09-10T15:28:19.248422+0000","last_undegraded":"2024-09-10T15:28:19.248422+0000","last_fullsized":"2024-09-10T15:28:19.248422+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:19.248230+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:19.248230+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.248230+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:49:20.791430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":43020,"num_write":44,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:11.340347+0000","last_change":"2024-09-10T15:28:11.340454+0000","last_active":"2024-09-10T15:28:11.340347+0000","last_peered":"2024-09-10T15:28:11.340347+0000","last_clean":"2024-09-10T15:28:11.340347+0000","last_became_active":"2024-09-10T15:25:13.845029+0000","last_became_peered":"2024-09-10T15:25:13.845029+0000","last_unstale":"2024-09-10T15:28:11.340347+0000","last_undegraded":"2024-09-10T15:28:11.340347+0000","last_fullsized":"2024-09-10T15:28:11.340347+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:11.340123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:11.340123+0000","last_clean_scrub_stamp":"2024-09-10T15:28:11.340123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:17:14.072984+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"94'16","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:18.230865+0000","last_change":"2024-09-10T15:28:18.230923+0000","last_active":"2024-09-10T15:28:18.230865+0000","last_peered":"2024-09-10T15:28:18.230865+0000","last_clean":"2024-09-10T15:28:18.230865+0000","last_became_active":"2024-09-10T15:25:11.841151+0000","last_became_peered":"2024-09-10T15:25:11.841151+0000","last_unstale":"2024-09-10T15:28:18.230865+0000","last_undegraded":"2024-09-10T15:28:18.230865+0000","last_fullsized":"2024-09-10T15:28:18.230865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:18.230663+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:18.230663+0000","last_clean_scrub_stamp":"2024-09-10T15:28:18.230663+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:10.040571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":30732,"num_write":36,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"67'10","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.257991+0000","last_change":"2024-09-10T15:28:10.258058+0000","last_active":"2024-09-10T15:28:10.257991+0000","last_peered":"2024-09-10T15:28:10.257991+0000","last_clean":"2024-09-10T15:28:10.257991+0000","last_became_active":"2024-09-10T15:25:13.861262+0000","last_became_peered":"2024-09-10T15:25:13.861262+0000","last_unstale":"2024-09-10T15:28:10.257991+0000","last_undegraded":"2024-09-10T15:28:10.257991+0000","last_fullsized":"2024-09-10T15:28:10.257991+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'10","last_scrub_stamp":"2024-09-10T15:28:10.257770+0000","last_deep_scrub":"67'10","last_deep_scrub_stamp":"2024-09-10T15:28:10.257770+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.257770+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:45.448759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"94'16","reported_seq":180,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.494825+0000","last_change":"2024-09-10T15:28:19.494885+0000","last_active":"2024-09-10T15:28:19.494825+0000","last_peered":"2024-09-10T15:28:19.494825+0000","last_clean":"2024-09-10T15:28:19.494825+0000","last_became_active":"2024-09-10T15:25:11.839179+0000","last_became_peered":"2024-09-10T15:25:11.839179+0000","last_unstale":"2024-09-10T15:28:19.494825+0000","last_undegraded":"2024-09-10T15:28:19.494825+0000","last_fullsized":"2024-09-10T15:28:19.494825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:19.494637+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:19.494637+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.494637+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:21.062678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30726,"num_write":26,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"76'34","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:05.332629+0000","last_change":"2024-09-10T15:28:05.332688+0000","last_active":"2024-09-10T15:28:05.332629+0000","last_peered":"2024-09-10T15:28:05.332629+0000","last_clean":"2024-09-10T15:28:05.332629+0000","last_became_active":"2024-09-10T15:25:13.872082+0000","last_became_peered":"2024-09-10T15:25:13.872082+0000","last_unstale":"2024-09-10T15:28:05.332629+0000","last_undegraded":"2024-09-10T15:28:05.332629+0000","last_fullsized":"2024-09-10T15:28:05.332629+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'34","last_scrub_stamp":"2024-09-10T15:28:05.332434+0000","last_deep_scrub":"76'34","last_deep_scrub_stamp":"2024-09-10T15:28:05.332434+0000","last_clean_scrub_stamp":"2024-09-10T15:28:05.332434+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:18:14.756406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":87,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"94'16","reported_seq":181,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:22.397335+0000","last_change":"2024-09-10T15:28:22.397393+0000","last_active":"2024-09-10T15:28:22.397335+0000","last_peered":"2024-09-10T15:28:22.397335+0000","last_clean":"2024-09-10T15:28:22.397335+0000","last_became_active":"2024-09-10T15:25:11.849708+0000","last_became_peered":"2024-09-10T15:25:11.849708+0000","last_unstale":"2024-09-10T15:28:22.397335+0000","last_undegraded":"2024-09-10T15:28:22.397335+0000","last_fullsized":"2024-09-10T15:28:22.397335+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'16","last_scrub_stamp":"2024-09-10T15:28:22.397138+0000","last_deep_scrub":"94'16","last_deep_scrub_stamp":"2024-09-10T15:28:22.397138+0000","last_clean_scrub_stamp":"2024-09-10T15:28:22.397138+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:59:26.056738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28684,"num_write":36,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.741685+0000","last_change":"2024-09-10T15:28:23.741820+0000","last_active":"2024-09-10T15:28:23.741685+0000","last_peered":"2024-09-10T15:28:23.741685+0000","last_clean":"2024-09-10T15:28:23.741685+0000","last_became_active":"2024-09-10T15:25:13.857486+0000","last_became_peered":"2024-09-10T15:25:13.857486+0000","last_unstale":"2024-09-10T15:28:23.741685+0000","last_undegraded":"2024-09-10T15:28:23.741685+0000","last_fullsized":"2024-09-10T15:28:23.741685+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:23.741458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:23.741458+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.741458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:25.309499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"94'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:20.315200+0000","last_change":"2024-09-10T15:28:20.315261+0000","last_active":"2024-09-10T15:28:20.315200+0000","last_peered":"2024-09-10T15:28:20.315200+0000","last_clean":"2024-09-10T15:28:20.315200+0000","last_became_active":"2024-09-10T15:25:11.852791+0000","last_became_peered":"2024-09-10T15:25:11.852791+0000","last_unstale":"2024-09-10T15:28:20.315200+0000","last_undegraded":"2024-09-10T15:28:20.315200+0000","last_fullsized":"2024-09-10T15:28:20.315200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:20.314984+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:20.314984+0000","last_clean_scrub_stamp":"2024-09-10T15:28:20.314984+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:46:32.734678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26636,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.329904+0000","last_change":"2024-09-10T15:28:07.329963+0000","last_active":"2024-09-10T15:28:07.329904+0000","last_peered":"2024-09-10T15:28:07.329904+0000","last_clean":"2024-09-10T15:28:07.329904+0000","last_became_active":"2024-09-10T15:25:13.851486+0000","last_became_peered":"2024-09-10T15:25:13.851486+0000","last_unstale":"2024-09-10T15:28:07.329904+0000","last_undegraded":"2024-09-10T15:28:07.329904+0000","last_fullsized":"2024-09-10T15:28:07.329904+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.329679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.329679+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.329679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:54:14.406986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"94'8","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.377612+0000","last_change":"2024-09-10T15:28:26.377724+0000","last_active":"2024-09-10T15:28:26.377612+0000","last_peered":"2024-09-10T15:28:26.377612+0000","last_clean":"2024-09-10T15:28:26.377612+0000","last_became_active":"2024-09-10T15:25:11.852672+0000","last_became_peered":"2024-09-10T15:25:11.852672+0000","last_unstale":"2024-09-10T15:28:26.377612+0000","last_undegraded":"2024-09-10T15:28:26.377612+0000","last_fullsized":"2024-09-10T15:28:26.377612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:26.377309+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:26.377309+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.377309+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:59:05.967429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"67'6","reported_seq":160,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:12.417169+0000","last_change":"2024-09-10T15:28:12.417229+0000","last_active":"2024-09-10T15:28:12.417169+0000","last_peered":"2024-09-10T15:28:12.417169+0000","last_clean":"2024-09-10T15:28:12.417169+0000","last_became_active":"2024-09-10T15:25:13.863830+0000","last_became_peered":"2024-09-10T15:25:13.863830+0000","last_unstale":"2024-09-10T15:28:12.417169+0000","last_undegraded":"2024-09-10T15:28:12.417169+0000","last_fullsized":"2024-09-10T15:28:12.417169+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"67'6","last_scrub_stamp":"2024-09-10T15:28:12.416983+0000","last_deep_scrub":"67'6","last_deep_scrub_stamp":"2024-09-10T15:28:12.416983+0000","last_clean_scrub_stamp":"2024-09-10T15:28:12.416983+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:13.985024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"94'12","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.252318+0000","last_change":"2024-09-10T15:28:19.252386+0000","last_active":"2024-09-10T15:28:19.252318+0000","last_peered":"2024-09-10T15:28:19.252318+0000","last_clean":"2024-09-10T15:28:19.252318+0000","last_became_active":"2024-09-10T15:25:11.832825+0000","last_became_peered":"2024-09-10T15:25:11.832825+0000","last_unstale":"2024-09-10T15:28:19.252318+0000","last_undegraded":"2024-09-10T15:28:19.252318+0000","last_fullsized":"2024-09-10T15:28:19.252318+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'12","last_scrub_stamp":"2024-09-10T15:28:19.252120+0000","last_deep_scrub":"94'12","last_deep_scrub_stamp":"2024-09-10T15:28:19.252120+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.252120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:08:02.578122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":22,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:15.333085+0000","last_change":"2024-09-10T15:28:15.333145+0000","last_active":"2024-09-10T15:28:15.333085+0000","last_peered":"2024-09-10T15:28:15.333085+0000","last_clean":"2024-09-10T15:28:15.333085+0000","last_became_active":"2024-09-10T15:25:13.858546+0000","last_became_peered":"2024-09-10T15:25:13.858546+0000","last_unstale":"2024-09-10T15:28:15.333085+0000","last_undegraded":"2024-09-10T15:28:15.333085+0000","last_fullsized":"2024-09-10T15:28:15.333085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:15.332891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:15.332891+0000","last_clean_scrub_stamp":"2024-09-10T15:28:15.332891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:07.142799+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"94'30","reported_seq":204,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:26.611710+0000","last_change":"2024-09-10T15:28:26.611782+0000","last_active":"2024-09-10T15:28:26.611710+0000","last_peered":"2024-09-10T15:28:26.611710+0000","last_clean":"2024-09-10T15:28:26.611710+0000","last_became_active":"2024-09-10T15:25:11.821371+0000","last_became_peered":"2024-09-10T15:25:11.821371+0000","last_unstale":"2024-09-10T15:28:26.611710+0000","last_undegraded":"2024-09-10T15:28:26.611710+0000","last_fullsized":"2024-09-10T15:28:26.611710+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'30","last_scrub_stamp":"2024-09-10T15:28:26.611481+0000","last_deep_scrub":"94'30","last_deep_scrub_stamp":"2024-09-10T15:28:26.611481+0000","last_clean_scrub_stamp":"2024-09-10T15:28:26.611481+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:22:55.838575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":53254,"num_write":40,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.374584+0000","last_change":"2024-09-10T15:28:09.374751+0000","last_active":"2024-09-10T15:28:09.374584+0000","last_peered":"2024-09-10T15:28:09.374584+0000","last_clean":"2024-09-10T15:28:09.374584+0000","last_became_active":"2024-09-10T15:25:13.870178+0000","last_became_peered":"2024-09-10T15:25:13.870178+0000","last_unstale":"2024-09-10T15:28:09.374584+0000","last_undegraded":"2024-09-10T15:28:09.374584+0000","last_fullsized":"2024-09-10T15:28:09.374584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:09.374359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:09.374359+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.374359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:40:01.268902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"94'20","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:16.308768+0000","last_change":"2024-09-10T15:28:16.308828+0000","last_active":"2024-09-10T15:28:16.308768+0000","last_peered":"2024-09-10T15:28:16.308768+0000","last_clean":"2024-09-10T15:28:16.308768+0000","last_became_active":"2024-09-10T15:25:11.837108+0000","last_became_peered":"2024-09-10T15:25:11.837108+0000","last_unstale":"2024-09-10T15:28:16.308768+0000","last_undegraded":"2024-09-10T15:28:16.308768+0000","last_fullsized":"2024-09-10T15:28:16.308768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'20","last_scrub_stamp":"2024-09-10T15:28:16.308571+0000","last_deep_scrub":"94'20","last_deep_scrub_stamp":"2024-09-10T15:28:16.308571+0000","last_clean_scrub_stamp":"2024-09-10T15:28:16.308571+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:10:08.118479+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38930,"num_write":50,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"76'68","reported_seq":225,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:24.764778+0000","last_change":"2024-09-10T15:28:24.764843+0000","last_active":"2024-09-10T15:28:24.764778+0000","last_peered":"2024-09-10T15:28:24.764778+0000","last_clean":"2024-09-10T15:28:24.764778+0000","last_became_active":"2024-09-10T15:25:13.862790+0000","last_became_peered":"2024-09-10T15:25:13.862790+0000","last_unstale":"2024-09-10T15:28:24.764778+0000","last_undegraded":"2024-09-10T15:28:24.764778+0000","last_fullsized":"2024-09-10T15:28:24.764778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'68","last_scrub_stamp":"2024-09-10T15:28:24.764577+0000","last_deep_scrub":"76'68","last_deep_scrub_stamp":"2024-09-10T15:28:24.764577+0000","last_clean_scrub_stamp":"2024-09-10T15:28:24.764577+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:02:04.977559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":173,"num_write":100,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"94'14","reported_seq":178,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:43.405304+0000","last_change":"2024-09-10T15:28:43.405448+0000","last_active":"2024-09-10T15:28:43.405304+0000","last_peered":"2024-09-10T15:28:43.405304+0000","last_clean":"2024-09-10T15:28:43.405304+0000","last_became_active":"2024-09-10T15:25:11.843129+0000","last_became_peered":"2024-09-10T15:25:11.843129+0000","last_unstale":"2024-09-10T15:28:43.405304+0000","last_undegraded":"2024-09-10T15:28:43.405304+0000","last_fullsized":"2024-09-10T15:28:43.405304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:43.405043+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:43.405043+0000","last_clean_scrub_stamp":"2024-09-10T15:28:43.405043+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:39:59.517669+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:10.653228+0000","last_change":"2024-09-10T15:28:10.653280+0000","last_active":"2024-09-10T15:28:10.653228+0000","last_peered":"2024-09-10T15:28:10.653228+0000","last_clean":"2024-09-10T15:28:10.653228+0000","last_became_active":"2024-09-10T15:25:13.864838+0000","last_became_peered":"2024-09-10T15:25:13.864838+0000","last_unstale":"2024-09-10T15:28:10.653228+0000","last_undegraded":"2024-09-10T15:28:10.653228+0000","last_fullsized":"2024-09-10T15:28:10.653228+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:10.653043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:10.653043+0000","last_clean_scrub_stamp":"2024-09-10T15:28:10.653043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:21:55.490592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"94'18","reported_seq":183,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:19.741569+0000","last_change":"2024-09-10T15:28:19.741689+0000","last_active":"2024-09-10T15:28:19.741569+0000","last_peered":"2024-09-10T15:28:19.741569+0000","last_clean":"2024-09-10T15:28:19.741569+0000","last_became_active":"2024-09-10T15:25:11.849394+0000","last_became_peered":"2024-09-10T15:25:11.849394+0000","last_unstale":"2024-09-10T15:28:19.741569+0000","last_undegraded":"2024-09-10T15:28:19.741569+0000","last_fullsized":"2024-09-10T15:28:19.741569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'18","last_scrub_stamp":"2024-09-10T15:28:19.741288+0000","last_deep_scrub":"94'18","last_deep_scrub_stamp":"2024-09-10T15:28:19.741288+0000","last_clean_scrub_stamp":"2024-09-10T15:28:19.741288+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:47:51.787854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:07.333833+0000","last_change":"2024-09-10T15:28:07.333882+0000","last_active":"2024-09-10T15:28:07.333833+0000","last_peered":"2024-09-10T15:28:07.333833+0000","last_clean":"2024-09-10T15:28:07.333833+0000","last_became_active":"2024-09-10T15:25:13.870070+0000","last_became_peered":"2024-09-10T15:25:13.870070+0000","last_unstale":"2024-09-10T15:28:07.333833+0000","last_undegraded":"2024-09-10T15:28:07.333833+0000","last_fullsized":"2024-09-10T15:28:07.333833+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:07.333654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:07.333654+0000","last_clean_scrub_stamp":"2024-09-10T15:28:07.333654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:42.524643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"94'24","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:31.367992+0000","last_change":"2024-09-10T15:28:31.368051+0000","last_active":"2024-09-10T15:28:31.367992+0000","last_peered":"2024-09-10T15:28:31.367992+0000","last_clean":"2024-09-10T15:28:31.367992+0000","last_became_active":"2024-09-10T15:25:11.843305+0000","last_became_peered":"2024-09-10T15:25:11.843305+0000","last_unstale":"2024-09-10T15:28:31.367992+0000","last_undegraded":"2024-09-10T15:28:31.367992+0000","last_fullsized":"2024-09-10T15:28:31.367992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'24","last_scrub_stamp":"2024-09-10T15:28:31.367789+0000","last_deep_scrub":"94'24","last_deep_scrub_stamp":"2024-09-10T15:28:31.367789+0000","last_clean_scrub_stamp":"2024-09-10T15:28:31.367789+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:26:58.457495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":47122,"num_write":54,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"94'14","reported_seq":177,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:23.320905+0000","last_change":"2024-09-10T15:28:23.320968+0000","last_active":"2024-09-10T15:28:23.320905+0000","last_peered":"2024-09-10T15:28:23.320905+0000","last_clean":"2024-09-10T15:28:23.320905+0000","last_became_active":"2024-09-10T15:25:11.847282+0000","last_became_peered":"2024-09-10T15:25:11.847282+0000","last_unstale":"2024-09-10T15:28:23.320905+0000","last_undegraded":"2024-09-10T15:28:23.320905+0000","last_fullsized":"2024-09-10T15:28:23.320905+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'14","last_scrub_stamp":"2024-09-10T15:28:23.320714+0000","last_deep_scrub":"94'14","last_deep_scrub_stamp":"2024-09-10T15:28:23.320714+0000","last_clean_scrub_stamp":"2024-09-10T15:28:23.320714+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T00:15:45.493578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":28672,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"76'46","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:09.659962+0000","last_change":"2024-09-10T15:28:09.660026+0000","last_active":"2024-09-10T15:28:09.659962+0000","last_peered":"2024-09-10T15:28:09.659962+0000","last_clean":"2024-09-10T15:28:09.659962+0000","last_became_active":"2024-09-10T15:25:13.866947+0000","last_became_peered":"2024-09-10T15:25:13.866947+0000","last_unstale":"2024-09-10T15:28:09.659962+0000","last_undegraded":"2024-09-10T15:28:09.659962+0000","last_fullsized":"2024-09-10T15:28:09.659962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'46","last_scrub_stamp":"2024-09-10T15:28:09.659764+0000","last_deep_scrub":"76'46","last_deep_scrub_stamp":"2024-09-10T15:28:09.659764+0000","last_clean_scrub_stamp":"2024-09-10T15:28:09.659764+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:18:39.198632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":117,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"94'8","reported_seq":167,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:29.362495+0000","last_change":"2024-09-10T15:28:29.362552+0000","last_active":"2024-09-10T15:28:29.362495+0000","last_peered":"2024-09-10T15:28:29.362495+0000","last_clean":"2024-09-10T15:28:29.362495+0000","last_became_active":"2024-09-10T15:25:11.846373+0000","last_became_peered":"2024-09-10T15:25:11.846373+0000","last_unstale":"2024-09-10T15:28:29.362495+0000","last_undegraded":"2024-09-10T15:28:29.362495+0000","last_fullsized":"2024-09-10T15:28:29.362495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"94'8","last_scrub_stamp":"2024-09-10T15:28:29.362312+0000","last_deep_scrub":"94'8","last_deep_scrub_stamp":"2024-09-10T15:28:29.362312+0000","last_clean_scrub_stamp":"2024-09-10T15:28:29.362312+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:44:48.338840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-10T15:28:17.300150+0000","last_change":"2024-09-10T15:28:17.300207+0000","last_active":"2024-09-10T15:28:17.300150+0000","last_peered":"2024-09-10T15:28:17.300150+0000","last_clean":"2024-09-10T15:28:17.300150+0000","last_became_active":"2024-09-10T15:25:13.853060+0000","last_became_peered":"2024-09-10T15:25:13.853060+0000","last_unstale":"2024-09-10T15:28:17.300150+0000","last_undegraded":"2024-09-10T15:28:17.300150+0000","last_fullsized":"2024-09-10T15:28:17.300150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T15:28:17.299957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T15:28:17.299957+0000","last_clean_scrub_stamp":"2024-09-10T15:28:17.299957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T23:37:18.867998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":181,"num_object_clones":0,"num_object_copies":362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":181,"num_whiteouts":0,"num_read":1215,"num_read_kb":1591,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1790,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":855,"ondisk_log_size":855,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1650,"num_read_kb":1231,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1540,"num_read_kb":2048660,"num_write":2200,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574903,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1150976,"data_stored":629940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574901,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32312,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339528,"statfs":{"total":96636764160,"available":96603676672,"internally_reserved":0,"allocated":1155072,"data_stored":630988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1704,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1744896,"data_stored":1220454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1132,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1159168,"data_stored":631125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":629821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1100,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1126400,"data_stored":629426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1773568,"data_stored":1221384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574902,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1179648,"data_stored":631034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T15:29:07.329 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T15:29:07.679 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T15:29:07.679 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T15:29:07.679 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T15:29:07.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:10.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-10T15:29:13.782 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T15:29:13.782 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T15:29:13.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:13.845 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T15:29:13.846 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T15:29:13.846 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:13.926 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T15:29:13.926 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T15:29:13.927 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.024 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T15:29:14.024 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T15:29:14.024 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.089 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T15:29:14.089 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T15:29:14.089 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.172 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T15:29:14.172 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-10T15:29:14.173 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.268 INFO:tasks.ceph.osd.6:Stopped 2024-09-10T15:29:14.268 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-10T15:29:14.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.351 INFO:tasks.ceph.osd.7:Stopped 2024-09-10T15:29:14.352 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T15:29:14.352 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-10T15:29:14.352 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.379 INFO:tasks.ceph.mgr.y:Stopped 2024-09-10T15:29:14.380 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T15:29:14.380 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.410 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T15:29:14.411 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T15:29:14.411 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T15:29:14.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.436 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T15:29:14.436 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T15:29:14.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.492 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T15:29:14.493 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T15:29:14.493 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T15:29:14.516 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T15:29:14.516 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T15:29:14.517 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-10T15:29:14.550 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:29:14.550 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T15:29:14.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:29:14.989 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T15:29:15.205 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:29:15.205 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T15:29:15.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:29:15.397 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T15:29:15.573 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:29:15.573 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T15:29:15.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-10T15:29:15.880 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:29:15.880 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T15:29:16.132 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:29:16.132 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-10T15:29:16.349 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:29:16.349 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-10T15:29:16.546 INFO:tasks.ceph:Archiving mon data... 2024-09-10T15:29:16.547 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/data/mon.a.tgz 2024-09-10T15:29:16.548 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-10T15:29:16.554 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.ljEHyFjkNi 2024-09-10T15:29:16.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ljEHyFjkNi 2024-09-10T15:29:16.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.ljEHyFjkNi 2024-09-10T15:29:16.778 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.ljEHyFjkNi is 482KB 2024-09-10T15:29:16.840 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.ljEHyFjkNi 2024-09-10T15:29:16.845 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/data/mon.c.tgz 2024-09-10T15:29:16.845 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-09-10T15:29:16.890 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.hJc6nMi7Wj 2024-09-10T15:29:16.891 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.hJc6nMi7Wj 2024-09-10T15:29:17.083 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.hJc6nMi7Wj 2024-09-10T15:29:17.146 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.hJc6nMi7Wj is 634KB 2024-09-10T15:29:17.209 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.hJc6nMi7Wj 2024-09-10T15:29:17.214 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/data/mon.b.tgz 2024-09-10T15:29:17.214 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-09-10T15:29:17.220 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.kP5uFrik5E 2024-09-10T15:29:17.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kP5uFrik5E 2024-09-10T15:29:17.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.kP5uFrik5E 2024-09-10T15:29:17.481 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.kP5uFrik5E is 634KB 2024-09-10T15:29:17.543 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.kP5uFrik5E 2024-09-10T15:29:17.548 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T15:29:17.549 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T15:29:17.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T15:29:17.611 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T15:29:17.653 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T15:29:17.653 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T15:29:17.655 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/remote/smithi099/crash 2024-09-10T15:29:17.656 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T15:29:17.669 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/crash to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/remote/smithi159/crash 2024-09-10T15:29:17.670 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T15:29:17.709 INFO:tasks.ceph:Compressing logs... 2024-09-10T15:29:17.709 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T15:29:17.716 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T15:29:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35894.log 2024-09-10T15:29:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32961.log 2024-09-10T15:29:17.735 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35894.log.gz 2024-09-10T15:29:17.736 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-09-10T15:29:17.736 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43050.log 2024-09-10T15:29:17.737 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32961.log: /var/log/ceph/ceph-client.admin.39359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-09-10T15:29:17.737 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35984.log 2024-09-10T15:29:17.737 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32961.log.gz 2024-09-10T15:29:17.738 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43050.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.35023.log -- replaced with /var/log/ceph/ceph-client.admin.43050.log.gz 2024-09-10T15:29:17.738 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.738 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35984.log.gz 2024-09-10T15:29:17.738 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41299.log 2024-09-10T15:29:17.738 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log/var/log/ceph/ceph-client.admin.35023.log: 2024-09-10T15:29:17.739 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35023.log.gz 2024-09-10T15:29:17.739 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41299.log.gz 2024-09-10T15:29:17.740 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2024-09-10T15:29:17.740 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42972.log 2024-09-10T15:29:17.740 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz 2024-09-10T15:29:17.740 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32365.log 2024-09-10T15:29:17.740 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41909.log 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42972.log: /var/log/ceph/ceph-client.admin.32365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32365.log.gz 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40764.log 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42972.log.gz 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr: 91.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37056.log 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41909.log.gz 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32177.log 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40764.log.gz 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35641.log 2024-09-10T15:29:17.744 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37056.log.gz 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32177.log.gz 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37518.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35641.log.gz 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34367.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37518.log.gz 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35188.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34367.log.gz 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34182.log 2024-09-10T15:29:17.745 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35188.log.gz 2024-09-10T15:29:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41313.log 2024-09-10T15:29:17.766 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-09-10T15:29:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38957.log 2024-09-10T15:29:17.766 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34182.log.gz 2024-09-10T15:29:17.766 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39657.log 2024-09-10T15:29:17.766 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41313.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42582.log 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38957.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39092.log 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39657.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34987.log 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42582.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39092.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39092.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41499.log 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34987.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43076.log 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41499.log.gz 2024-09-10T15:29:17.767 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32363.log 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41104.log 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43076.log.gz 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32363.log.gz 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39813.log 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41294.log 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41104.log.gz 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39813.log.gz 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35530.log 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41540.log 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41294.log.gz 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35530.log.gz 2024-09-10T15:29:17.768 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41739.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41500.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41540.log.gz 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41739.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41739.log.gz 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39836.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32763.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41500.log.gz 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39836.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39836.log.gz /var/log/ceph/ceph-client.admin.41300.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39763.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32763.log.gz 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41300.log.gz 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21463.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36150.log 2024-09-10T15:29:17.769 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39763.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.21463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32568.log 0.0% 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.21463.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41883.log 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36150.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35415.log 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32568.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41883.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37082.log 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35415.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37082.log.gz 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40842.log 2024-09-10T15:29:17.770 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32545.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40842.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40842.log.gz 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34178.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35233.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32545.log.gz 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34178.log.gz 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42790.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35233.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35233.log.gz 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42790.log.gzgzip 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32358.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35753.log 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.32358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32358.log.gz 2024-09-10T15:29:17.771 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33901.log 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35753.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35753.log.gz --verbose 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.32259.log 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33901.log.gz 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34111.log 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32259.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.32259.log.gz 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36279.log 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34111.log.gz 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35864.log 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35374.log 0.0% 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36279.log.gz 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35864.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.35864.log.gz 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-mon.a.log 2024-09-10T15:29:17.772 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42660.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35374.log.gz 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34136.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42660.log.gz 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37244.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39500.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34136.log.gz 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37244.log.gz 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32354.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39500.log.gz 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32354.log.gz 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40920.log 2024-09-10T15:29:17.773 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37425.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40920.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42608.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.37425.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34307.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37425.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42608.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42868.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40972.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34307.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42868.log.gz 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41539.log 2024-09-10T15:29:17.774 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33063.log 2024-09-10T15:29:17.775 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40972.log.gz 2024-09-10T15:29:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40686.log 2024-09-10T15:29:17.775 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41539.log.gz 2024-09-10T15:29:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33063.log.gz 2024-09-10T15:29:17.775 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32573.log 2024-09-10T15:29:17.786 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26540.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26516.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26468.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26540.log.gz 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26516.log.gz 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26468.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26468.log.gz 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26564.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T15:29:17.787 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26564.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26564.log.gz 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26420.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26396.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26420.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26420.log.gz 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26396.log.gz 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26492.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26444.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26492.log.gz 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-10T15:29:17.788 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.26444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26444.log.gz 2024-09-10T15:29:17.789 INFO:teuthology.orchestra.run.smithi159.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T15:29:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40686.log: /var/log/ceph/ceph-client.admin.43152.log 2024-09-10T15:29:17.811 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40686.log.gz 2024-09-10T15:29:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32573.log.gz 2024-09-10T15:29:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32555.log 2024-09-10T15:29:17.811 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37400.log 2024-09-10T15:29:17.811 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43152.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34371.log 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32555.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37400.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42530.log 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40998.log 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34371.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42530.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36207.log 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40577.log 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40998.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36207.log.gz 2024-09-10T15:29:17.812 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40577.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40577.log.gz 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38843.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41094.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.38843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38904.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38843.log.gz 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41095.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41094.log.gz 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35613.log 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38904.log.gz 2024-09-10T15:29:17.813 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32778.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41095.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32285.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35613.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43024.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32778.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42712.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32285.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41506.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43024.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:gzip/var/log/ceph/ceph-client.admin.42712.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26317.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42712.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32569.log 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41506.log.gz 2024-09-10T15:29:17.814 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.26317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26317.log.gz 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32208.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41700.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32569.log.gz 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43128.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32208.log.gz 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41700.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41700.log.gz 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41050.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32562.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33793.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41292.log 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32562.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41050.log.gz 2024-09-10T15:29:17.815 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32562.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33793.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32777.log 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40429.log 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41292.log: /var/log/ceph/ceph-client.admin.32777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32777.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41292.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40429.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37171.log 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34490.log 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40738.log: /var/log/ceph/ceph-client.admin.37171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32765.log 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37171.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2024-09-10T15:29:17.816 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34490.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33087.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34490.log.gz 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42842.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32765.log.gz 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41307.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33087.log: /var/log/ceph/ceph-client.admin.42842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34271.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33087.log.gz 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42842.log.gz/var/log/ceph/ceph-client.admin.41307.log: 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41307.log.gz 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38996.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33113.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34271.log: /var/log/ceph/ceph-client.admin.38996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34271.log.gz 2024-09-10T15:29:17.817 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38996.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33113.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34427.log 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32239.log 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34065.log: /var/log/ceph/ceph-client.admin.34427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40868.log 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34427.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32239.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34620.log 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37209.log 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39475.log 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0%/var/log/ceph/ceph-client.admin.34620.log: -- replaced with /var/log/ceph/ceph-client.admin.40868.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0%/var/log/ceph/ceph-client.admin.37209.log: -- replaced with /var/log/ceph/ceph-client.admin.34620.log.gz 2024-09-10T15:29:17.818 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37209.log.gz 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39475.log.gz 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41937.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39406.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.41937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41937.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42946.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39406.log.gz 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42946.log.gz 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34834.log 2024-09-10T15:29:17.819 INFO:teuthology.orchestra.run.smithi099.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34891.log 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32348.log: 0.0%/var/log/ceph/ceph-client.admin.34834.log: -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40634.log 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34834.log.gz 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34891.log.gz 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34234.log 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32362.log 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40634.log.gz 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40790.log 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34234.log.gz 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-09-10T15:29:17.820 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32362.log: /var/log/ceph/ceph-client.admin.40790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40608.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32362.log.gz 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40790.log.gz 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26594.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41512.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40608.log: /var/log/ceph/ceph-client.admin.26594.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40608.log.gz 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26594.log.gz 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26464.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41512.log.gz 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42816.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.26464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33943.log 2024-09-10T15:29:17.821 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26464.log.gz 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42816.log.gz 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41857.log 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41492.log 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33943.log.gz 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41857.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40946.log 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41492.log.gz 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34520.log 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40946.log.gz 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36361.log 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.822 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34520.log.gz 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35267.log 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36361.log.gz 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34558.log 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35267.log.gz 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39570.log 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41704.log 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34558.log.gz 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39570.log.gzgzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41704.log.gz 2024-09-10T15:29:17.823 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41024.log 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33944.log 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.41024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41024.log.gz 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41103.log 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33944.log.gz 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38170.log 2024-09-10T15:29:17.824 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41103.log.gz 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42686.log 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38170.log.gz 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33037.log 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42686.log.gz 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39569.log 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33037.log: /var/log/ceph/ceph-client.admin.36957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33037.log.gz 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-09-10T15:29:17.843 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39569.log: /var/log/ceph/ceph-client.admin.34621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39569.log.gz 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41099.log 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42634.log: /var/log/ceph/ceph-client.admin.41099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41099.log.gz 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41083.log 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39234.log 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41083.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41284.log 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39234.log.gz 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36050.log 2024-09-10T15:29:17.844 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41284.log: /var/log/ceph/ceph-client.admin.36050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41284.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36050.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37519.log 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35327.log 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37519.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32364.log 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35327.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34735.log 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40894.log 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32364.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34735.log.gz 2024-09-10T15:29:17.845 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32987.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40894.log.gz 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35085.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41734.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32987.log.gz 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35085.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35712.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41734.log.gz 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35947.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32311.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35712.log.gz 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38775.log 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35947.log.gz 2024-09-10T15:29:17.846 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32311.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33871.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40660.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.38775.log: /var/log/ceph/ceph-client.admin.33871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38775.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33871.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35448.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40660.log: /var/log/ceph/ceph-client.admin.32753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40660.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36054.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35448.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33819.log 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.36054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36054.log.gz 2024-09-10T15:29:17.847 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41511.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33819.log.gz 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41511.log.gz 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33845.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37359.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39121.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33845.log.gz 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37359.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39698.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37359.log.gz 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39121.log.gz 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40551.log 2024-09-10T15:29:17.848 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39194.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39698.log: /var/log/ceph/ceph-client.admin.40551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39698.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40551.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42764.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41740.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39194.log: /var/log/ceph/ceph-client.admin.42764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39194.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42764.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40712.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41740.log: /var/log/ceph/ceph-client.admin.40712.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41740.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40712.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41308.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35554.log 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2024-09-10T15:29:17.849 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41308.log.gz 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35554.log.gz 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37005.log 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41708.log 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.37301.log: /var/log/ceph/ceph-client.admin.37005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37005.log.gz 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35081.log 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40517.log 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35081.log: /var/log/ceph/ceph-client.admin.41708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35081.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41708.log.gz 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.850 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34562.log 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32764.log 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40517.log.gz 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34562.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35803.log 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32764.log.gz 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32554.log 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34917.log 2024-09-10T15:29:17.854 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.35803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35803.log.gz 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32554.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33946.log 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.34917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34917.log.gz 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32352.log 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42738.log 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33946.log.gz 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32352.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40816.log 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42738.log.gz 2024-09-10T15:29:17.855 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40816.log.gz 2024-09-10T15:29:17.856 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T15:29:17.961 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T15:29:17.963 INFO:teuthology.orchestra.run.smithi159.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T15:29:18.030 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T15:29:18.223 INFO:teuthology.orchestra.run.smithi159.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-10T15:29:18.229 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-10T15:29:18.295 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T15:29:18.304 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T15:29:18.321 INFO:teuthology.orchestra.run.smithi099.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T15:29:18.333 INFO:teuthology.orchestra.run.smithi159.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T15:29:18.367 INFO:teuthology.orchestra.run.smithi159.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T15:29:18.368 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-09-10T15:29:18.368 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m0.612s 2024-09-10T15:29:18.369 INFO:teuthology.orchestra.run.smithi159.stderr:user 0m2.250s 2024-09-10T15:29:18.369 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m0.112s 2024-09-10T15:29:18.485 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T15:29:18.486 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-09-10T15:29:18.486 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m0.769s 2024-09-10T15:29:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m2.870s 2024-09-10T15:29:18.487 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m0.164s 2024-09-10T15:29:18.487 INFO:tasks.ceph:Archiving logs... 2024-09-10T15:29:18.487 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/remote/smithi099/log 2024-09-10T15:29:18.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T15:29:19.039 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/remote/smithi159/log 2024-09-10T15:29:19.040 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T15:29:19.305 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T15:29:19.315 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T15:29:19.316 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T15:29:19.318 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T15:29:19.388 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T15:29:19.396 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T15:29:19.397 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T15:29:19.399 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T15:29:19.408 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T15:29:19.408 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-09-10T15:29:19.408 INFO:teuthology.orchestra.run.smithi099.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 177 0.157 -1.291 0.881 2024-09-10T15:29:19.408 INFO:teuthology.orchestra.run.smithi099.stdout:*hv02.front.sepi 63.231.80.2 3 u 32 64 177 0.111 -0.789 0.704 2024-09-10T15:29:19.408 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 27 64 177 0.096 -0.132 0.744 2024-09-10T15:29:19.408 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:29:19.411 INFO:teuthology.orchestra.run.smithi159.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T15:29:19.411 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================== 2024-09-10T15:29:19.412 INFO:teuthology.orchestra.run.smithi159.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 177 0.066 -0.936 0.801 2024-09-10T15:29:19.412 INFO:teuthology.orchestra.run.smithi159.stdout:*hv02.front.sepi 63.231.80.2 3 u 20 64 177 0.057 -0.692 0.619 2024-09-10T15:29:19.412 INFO:teuthology.orchestra.run.smithi159.stdout:+hv03.front.sepi 74.6.168.72 3 u 23 64 177 0.083 +0.484 0.909 2024-09-10T15:29:19.412 INFO:teuthology.orchestra.run.smithi159.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T15:29:19.413 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T15:29:19.434 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T15:29:19.434 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T15:29:19.485 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T15:29:19.535 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T15:29:19.584 INFO:teuthology.task.internal:Duration was 877.966883 seconds 2024-09-10T15:29:19.585 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T15:29:19.635 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T15:29:19.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T15:29:19.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T15:29:19.674 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T15:29:19.674 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-09-10T15:29:19.674 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T15:29:19.726 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-09-10T15:29:19.727 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T15:29:19.737 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T15:29:19.738 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T15:29:19.775 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T15:29:19.807 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T15:29:19.807 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T15:29:19.843 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T15:29:19.913 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T15:29:19.923 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T15:29:19.923 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T15:29:19.933 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T15:29:19.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T15:29:19.969 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T15:29:19.975 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T15:29:19.982 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-09-10T15:29:19.999 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-09-10T15:29:20.105 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T15:29:20.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:29:20.110 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T15:29:20.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T15:29:20.153 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T15:29:20.164 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T15:29:20.165 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/remote/smithi099 2024-09-10T15:29:20.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T15:29:20.187 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/tchandra-2024-09-10_07:44:33-rgw-wip-tejas-testing-2024-09-09-1611-squid-distro-default-smithi/7899133/remote/smithi159 2024-09-10T15:29:20.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T15:29:20.217 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T15:29:20.217 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T15:29:20.227 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T15:29:20.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T15:29:20.272 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T15:29:20.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T15:29:20.303 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T15:29:20.303 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T15:29:20.306 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T15:29:20.309 INFO:teuthology.orchestra.run.smithi099.stdout: 655474 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 15:29 /home/ubuntu/cephtest 2024-09-10T15:29:20.311 INFO:teuthology.orchestra.run.smithi159.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 15:29 /home/ubuntu/cephtest 2024-09-10T15:29:20.313 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T15:29:20.353 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T15:29:20.464 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} duration: 877.9668831825256 flavor: default owner: scheduled_tchandra@teuthology success: true 2024-09-10T15:29:20.464 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T15:29:20.528 INFO:teuthology.run:pass